-- Logs begin at Wed 2022-06-29 11:39:56 UTC, end at Wed 2022-06-29 13:12:58 UTC. -- Jun 29 12:05:59.871864 dv-cinder-797608-38-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 29 12:05:59.880101 dv-cinder-797608-38-iscsi devstack@keystone.service[80072]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 29 12:05:59.882113 dv-cinder-797608-38-iscsi devstack@keystone.service[80072]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 29 12:05:59 2022] *** Jun 29 12:05:59.882113 dv-cinder-797608-38-iscsi devstack@keystone.service[80072]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 29 12:05:59.882113 dv-cinder-797608-38-iscsi devstack@keystone.service[80072]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 29 12:05:59.882113 dv-cinder-797608-38-iscsi devstack@keystone.service[80072]: nodename: dv-cinder-797608-38-iscsi Jun 29 12:05:59.882113 dv-cinder-797608-38-iscsi devstack@keystone.service[80072]: machine: x86_64 Jun 29 12:05:59.882113 dv-cinder-797608-38-iscsi devstack@keystone.service[80072]: clock source: unix Jun 29 12:05:59.882113 dv-cinder-797608-38-iscsi devstack@keystone.service[80072]: pcre jit disabled Jun 29 12:05:59.882113 dv-cinder-797608-38-iscsi devstack@keystone.service[80072]: detected number of CPU cores: 4 Jun 29 12:05:59.882113 dv-cinder-797608-38-iscsi devstack@keystone.service[80072]: current working directory: / Jun 29 12:05:59.882113 dv-cinder-797608-38-iscsi devstack@keystone.service[80072]: detected binary path: /usr/bin/uwsgi-core Jun 29 12:05:59.882113 dv-cinder-797608-38-iscsi devstack@keystone.service[80072]: your processes number limit is 47680 Jun 29 12:05:59.882716 dv-cinder-797608-38-iscsi devstack@keystone.service[80072]: your memory page size is 4096 bytes Jun 29 12:05:59.882716 dv-cinder-797608-38-iscsi devstack@keystone.service[80072]: detected max file descriptor number: 2048 Jun 29 12:05:59.882716 dv-cinder-797608-38-iscsi devstack@keystone.service[80072]: lock engine: pthread robust mutexes Jun 29 12:05:59.882716 dv-cinder-797608-38-iscsi devstack@keystone.service[80072]: thunder lock: enabled Jun 29 12:05:59.882716 dv-cinder-797608-38-iscsi devstack@keystone.service[80072]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 29 12:05:59.882716 dv-cinder-797608-38-iscsi devstack@keystone.service[80072]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 29 12:05:59.925977 dv-cinder-797608-38-iscsi devstack@keystone.service[80072]: Python main interpreter initialized at 0x55be184b09c0 Jun 29 12:05:59.925977 dv-cinder-797608-38-iscsi devstack@keystone.service[80072]: python threads support enabled Jun 29 12:05:59.925977 dv-cinder-797608-38-iscsi devstack@keystone.service[80072]: your server socket listen backlog is limited to 100 connections Jun 29 12:05:59.925977 dv-cinder-797608-38-iscsi devstack@keystone.service[80072]: your mercy for graceful operations on workers is 90 seconds Jun 29 12:05:59.926327 dv-cinder-797608-38-iscsi devstack@keystone.service[80072]: mapped 403077 bytes (393 KB) for 2 cores Jun 29 12:05:59.926442 dv-cinder-797608-38-iscsi devstack@keystone.service[80072]: *** Operational MODE: preforking *** Jun 29 12:05:59.926737 dv-cinder-797608-38-iscsi devstack@keystone.service[80072]: *** uWSGI is running in multiple interpreter mode *** Jun 29 12:05:59.926737 dv-cinder-797608-38-iscsi devstack@keystone.service[80072]: spawned uWSGI master process (pid: 80072) Jun 29 12:05:59.926930 dv-cinder-797608-38-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 29 12:05:59.928427 dv-cinder-797608-38-iscsi devstack@keystone.service[80072]: spawned uWSGI worker 1 (pid: 80081, cores: 1) Jun 29 12:05:59.928427 dv-cinder-797608-38-iscsi devstack@keystone.service[80072]: spawned uWSGI worker 2 (pid: 80082, cores: 1) Jun 29 12:05:59.928427 dv-cinder-797608-38-iscsi devstack@keystone.service[80072]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 29 12:06:05.356984 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 12:06:05.356984 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: from cryptography.utils import int_from_bytes Jun 29 12:06:05.357831 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 12:06:05.357831 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: from cryptography.utils import int_from_bytes Jun 29 12:06:05.366903 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 12:06:05.366903 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: from cryptography.utils import int_from_bytes Jun 29 12:06:05.367362 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 12:06:05.367362 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: from cryptography.utils import int_from_bytes Jun 29 12:06:05.406794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 12:06:05.406963 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 12:06:05.407158 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] command line args: [] {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 12:06:05.407427 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 12:06:05.407604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ================================================================================ {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 12:06:05.407859 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] admin_token = **** {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.408107 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] config_dir = [] {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.408295 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.408475 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] config_source = [] {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.408652 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] debug = True {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.408848 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.409341 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.409426 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.409639 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.409890 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.410123 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] list_limit = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.410303 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] log_config_append = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.410481 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.410701 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] log_dir = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.410859 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] log_file = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.411101 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.411347 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.411594 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.411840 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.412018 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.412193 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.412438 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.412684 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.412918 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.413150 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.413383 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.413879 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.414125 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.414372 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.414592 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 12:06:05.414715 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.414838 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 12:06:05.415020 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] command line args: [] {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 12:06:05.415143 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.415300 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 12:06:05.415389 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] publish_errors = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.415518 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ================================================================================ {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 12:06:05.415630 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.415793 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] admin_token = **** {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.415894 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.415894 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.416016 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] config_dir = [] {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.416185 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.416276 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.416373 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] config_source = [] {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.416478 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.416560 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] debug = True {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.416642 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] standard_threads = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.416753 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.416862 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.416991 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.417070 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.417164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.417259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.417409 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] use_journal = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.417500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.417583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] use_json = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.417661 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.417731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] use_stderr = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.417872 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] list_limit = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.417998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] use_syslog = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.418125 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] log_config_append = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.418259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.418388 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.418511 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.418654 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] log_dir = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.418654 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] log_file = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.418838 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.418928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.419005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.419076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.419144 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.419245 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.419328 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.419489 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.419574 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.419671 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.419800 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.419890 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.420023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.420107 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.420270 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.420347 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.420501 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.420644 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.420718 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.420787 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.420949 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.421032 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.421178 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.421260 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.421421 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.421500 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.421663 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.421739 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.421911 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.421989 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.422149 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.422402 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.422477 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.422589 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] publish_errors = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.422704 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.422848 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.422929 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.423075 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.423162 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.423253 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.423366 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.423498 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.423727 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.423802 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.423957 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] standard_threads = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.424034 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.424245 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.424374 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.424489 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.424620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.424710 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.424793 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.424905 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.424988 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] use_journal = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.425079 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] use_json = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.425144 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.425254 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] use_stderr = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.425379 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.425461 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] use_syslog = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.425629 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.425705 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:05.425862 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.426014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.426088 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.426162 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.426334 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.426409 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.426572 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.426688 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.426844 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.426922 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.427093 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.427180 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.427326 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.427466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.427563 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.427768 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.427849 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.428016 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.428090 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.428246 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.428323 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.428474 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.428549 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.428705 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.428852 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.428935 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.429088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.429176 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.429324 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.429404 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.429572 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.429657 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.429820 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.429903 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.430057 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.430133 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.430293 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.430370 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.430540 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.430616 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.430797 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.430875 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.431029 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.431112 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.431265 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.431340 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.431502 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.431579 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.431723 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.432333 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.432509 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.432586 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.432743 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.432825 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.432970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.433046 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.433198 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.433285 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.433445 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.433533 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.433676 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.433806 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.433935 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.434056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.434172 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.434339 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.434451 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.434581 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.434738 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.434878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.434979 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.435145 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.435262 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.435386 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.435507 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.435639 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.435753 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.435885 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.436071 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.436154 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.436342 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.436422 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.436581 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.436678 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.436830 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.436911 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.437069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.437190 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.437306 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.437422 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.437547 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.437654 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.437784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.437998 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.438083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.438241 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.438324 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.438475 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.438555 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.438719 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.438797 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.438961 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.439040 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.439198 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.439280 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.439432 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.439550 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.439667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.439744 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.439899 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.439976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.440133 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.440210 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.440367 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.440444 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.440597 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.440674 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.440826 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.440907 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.441055 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.441132 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.441282 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.441366 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.441515 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.441592 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.441744 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.441822 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.441978 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.442055 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.442209 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.442295 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.442452 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.442528 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.442710 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.442792 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.442941 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.443017 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.443178 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.443257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.443412 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.443491 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.443657 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] auth.external = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.443733 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.443886 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.443963 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.444133 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.444217 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.444374 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.444450 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.444606 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.444689 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] auth.password = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.444837 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.444924 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] auth.token = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.445069 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.445147 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.445302 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.445379 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.445537 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.445616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.445768 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.445845 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.446004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.446079 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.446237 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.446323 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.446465 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.446541 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.446716 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.446796 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] credential.caching = True {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.446949 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.447038 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.447181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.447264 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.447492 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.448108 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.448263 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.448355 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.448502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.448579 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.448736 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.448819 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.448973 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.449079 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.449252 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.449348 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.449486 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.449565 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.449723 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.449799 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.450007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.450093 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.450251 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.450331 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.450512 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.450590 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.450779 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.450871 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.451036 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.451144 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.451271 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] federation.caching = True {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.451387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.451509 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.451631 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.451754 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.451879 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.452000 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.452118 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.452230 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.452371 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.452476 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.452631 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.452709 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.452870 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.452947 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.453101 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] auth.external = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.453180 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.453329 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.453406 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.453622 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.453709 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.453853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.453932 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.454080 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] auth.password = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.454158 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] identity.caching = True {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.454307 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] auth.token = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.454385 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.454545 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.454629 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.454801 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.454971 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.455049 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.455119 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.455264 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.455342 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.455494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.455570 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.455730 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.455807 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.455955 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.456034 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.456187 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] credential.caching = True {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.456264 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.456431 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.456509 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.456666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.456744 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.456897 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.456975 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.457132 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.457209 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.457374 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.457459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.457606 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.457683 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.457858 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.457934 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.458104 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.458183 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.458342 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.458427 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.458593 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.458794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.458872 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.458942 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.459072 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.459150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.459310 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.459396 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.459541 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.459618 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.459777 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.459855 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.460021 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.460108 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] federation.caching = True {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.460277 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.460361 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.460525 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.460603 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.460759 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.460844 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.460985 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.461061 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.461230 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.461308 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.461466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.461551 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.461710 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.461794 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.461942 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.462019 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.462174 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.462259 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.462412 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.462490 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.462657 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.462738 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.462893 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] identity.caching = True {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.462981 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.463261 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.463429 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.463508 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.463696 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.463773 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.463932 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.464012 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.464167 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.464245 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.464413 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.464490 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.464643 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.464722 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.464871 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.464948 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.465120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.465196 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.465365 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.465443 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.465595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.465672 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.465827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.465904 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.466057 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.466136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.466285 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.user = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.466362 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.466527 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.466609 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.466807 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.466887 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.467038 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.467115 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.467285 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.467362 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.467532 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.467610 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.467787 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.467906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.468021 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.468095 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.468230 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.468308 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.468464 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.468541 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.468691 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.468766 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.468925 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.469003 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.469153 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.469230 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.469387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.469464 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.469632 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.469716 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.469860 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.469936 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.470106 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.470190 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.470350 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.470428 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.470580 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.470688 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.470848 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.470937 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.471082 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.471159 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.471310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.471386 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.471544 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.471631 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.471769 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.471850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.472004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.472081 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.472239 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.472324 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.472475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.472553 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.472710 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.472787 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.472941 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.473026 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.473184 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.473260 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.473418 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.473494 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.473646 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.473731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.473874 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.473952 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.474119 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.474196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.474361 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.474445 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.474592 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.474686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.474848 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.474924 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.475081 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.475170 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] resource.caching = True {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.475309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.user = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.475387 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.475547 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.475632 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.475791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.475875 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.476020 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.476096 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.476262 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.476339 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.476499 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.476583 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.476739 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.476815 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.476974 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.477050 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.477201 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.477286 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.477432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] role.caching = True {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.477509 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.477668 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.477743 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] role.driver = sql {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.477897 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.477982 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.478122 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.478203 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.478370 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.478448 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.478615 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.478753 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.478918 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.479057 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.479167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.479419 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.479576 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.479719 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.480013 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.480246 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.480246 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.480464 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.480546 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.480628 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.480702 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.480857 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.480935 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.481110 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.481261 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.481525 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.481605 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.481761 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.481837 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.482007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.482085 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.482252 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.482332 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.482488 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.482572 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.482758 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.482853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.482988 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.483065 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.483231 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.483309 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.483468 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.483554 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.483700 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.483778 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.483932 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.484008 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.484165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.484254 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.484397 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.484475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.484625 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.484701 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.484859 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.484945 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.485097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] resource.caching = True {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.485175 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.485344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.485420 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.485587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.485671 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.485818 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.485895 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.486054 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] token.caching = True {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.486132 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.486290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.486378 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.486520 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.486597 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.486790 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.486868 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.487024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.487112 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.487262 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.487340 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.487493 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] role.caching = True {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.487570 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.487735 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.487819 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] role.driver = sql {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.487962 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.488039 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.488211 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.488287 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.488449 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.488535 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.488687 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.488764 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.488921 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.488998 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.489161 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.489246 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.489407 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.489483 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.489638 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.489715 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.489879 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.489965 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.490108 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.490184 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.490352 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.490430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] database.connection = **** {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.490596 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.490753 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.490868 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.490948 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.491114 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.491192 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.491364 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.491520 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.491606 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.491757 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.491835 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.492006 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.492084 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.492254 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.492341 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.492497 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.492573 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.492731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.492809 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.492960 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.493045 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.493194 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.493272 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.493441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.493519 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.493676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.493766 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.493908 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.493986 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.494136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.494214 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.494919 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.495015 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.495156 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.495240 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.495313 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 12:06:05.495416 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.495665 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.495901 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.496134 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.496362 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.496594 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] token.caching = True {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.496828 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.497071 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.497306 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.497558 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.497803 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.498040 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.498281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.498522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.498799 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.499038 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.499273 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.499504 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.499746 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.499991 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.500220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.500459 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.500759 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.501019 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] database.connection = **** {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.501270 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.501515 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.501751 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.501991 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.502222 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.502457 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.502711 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.502946 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.503187 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.503420 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.503661 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.503893 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.504137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.504371 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.504611 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.504838 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.505075 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.505306 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:05.505473 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 12:06:05.525739 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.525968 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.526192 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.531507 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.531739 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.531966 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.534536 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.540785 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.563044 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.563276 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.567446 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.567677 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.705499 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.707101 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.756019 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.756179 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.756288 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.756367 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.822154 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.822379 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.822524 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.822682 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.822795 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.822914 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.822998 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.823132 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.823215 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.823346 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.823431 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.823582 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.847134 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.847359 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.847587 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.847809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.847892 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.848025 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.848108 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.848238 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.848324 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.848452 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.848535 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.848690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.848904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.849117 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.859927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.860285 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.873095 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.873330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.873554 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.873639 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.873776 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.873858 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.873994 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.874086 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.874207 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.874289 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.874420 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.874503 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.874658 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.874895 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:05.891642 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.891744 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.891849 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 29 12:06:05.891932 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 29 12:06:05.892187 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.892390 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 29 12:06:05.892472 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.892587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 29 12:06:05.892668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.892853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.892944 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.893111 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.893194 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.893364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.893444 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.893616 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.904179 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.904364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.904449 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.904634 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.904717 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.904897 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.904980 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.905167 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.913158 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:05.913315 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:05.917208 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:05.917339 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:05.917483 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.917612 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.917758 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.917885 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.918035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.918162 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.918312 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.918439 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.918571 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.918719 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.918861 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.918984 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.919129 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.919251 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.919395 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.919518 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.919665 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.919785 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.919927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.920047 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.946751 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.947009 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.948373 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:05.948619 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:05.948717 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.948893 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.953852 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:05.954073 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:05.954157 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.954348 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.954504 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.954622 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.961780 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:05.961934 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:05.962021 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.962211 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.966472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:05.966670 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:05.966782 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.966955 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.967049 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.967231 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.967315 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.967510 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.967593 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.967777 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.967868 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.968042 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.968123 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.968329 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.968576 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.968840 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.987325 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.987595 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.987898 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.988175 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.992209 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:05.992688 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:05.996385 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.996751 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.997327 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:05.997613 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.001743 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:06.002735 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:06.005347 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:06.006300 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:06.009000 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.009296 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.009577 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.009865 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.010038 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.010165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.010332 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.010468 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.010611 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.010892 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.011179 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.011448 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.029832 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:06.030112 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.030375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.030645 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.031503 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:06.032135 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.032280 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.032824 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.038739 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.040440 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.040713 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.040878 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.043059 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.043399 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.044503 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:06.044785 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.045052 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.045323 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.045592 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.046862 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:06.047141 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.047415 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.047689 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.047967 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.058793 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:06.059067 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.059342 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.059624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.059907 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.061338 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:06.061476 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.061609 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.061739 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.061868 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.062126 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.062398 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.062691 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.062971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.079454 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:06.082202 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:06.082716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:06.085451 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:06.086020 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.087760 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.089271 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.089897 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:06.090171 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.090454 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.090880 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.092620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:06.092892 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.093168 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.097761 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.099447 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:06.100522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.102115 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:06.102630 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.102936 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.103325 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.103599 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.105900 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.106189 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.106467 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.106765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.113177 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:06.113467 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.113742 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.115916 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:06.116200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.116481 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.121584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:06.121861 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.122137 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.122409 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.122703 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.123077 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.123361 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.123629 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.123910 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.124189 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.124315 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:06.124465 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.124605 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.124743 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.124874 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.125003 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.125141 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.125320 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.125449 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.125578 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.125826 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.126159 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.126872 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.127143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.127417 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.127676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.127939 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.128205 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:06.163146 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55be184b09c0 pid: 80082 (default app) Jun 29 12:06:06.167216 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55be184b09c0 pid: 80081 (default app) Jun 29 12:06:06.167368 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d2ed7-a55f-4c54-bd97-47a96b5f0dd1 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:06.167660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d2ed7-a55f-4c54-bd97-47a96b5f0dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:06.167939 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d2ed7-a55f-4c54-bd97-47a96b5f0dd1 None None] PATH_INFO: `/v3` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:06.172177 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 791 bytes} [Wed Jun 29 12:06:06 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:13.923805 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f19c4-282c-496a-a8a7-69a0765db46c None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:13.924367 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f19c4-282c-496a-a8a7-69a0765db46c None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:13.924367 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f19c4-282c-496a-a8a7-69a0765db46c None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:13.928644 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:06:13.933839 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632243d9-d5f8-4af4-9f89-85e2cd2ba05e None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:13.934254 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632243d9-d5f8-4af4-9f89-85e2cd2ba05e None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:13.934395 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632243d9-d5f8-4af4-9f89-85e2cd2ba05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:14.005452 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: INFO dbcounter [None req-632243d9-d5f8-4af4-9f89-85e2cd2ba05e None None] Registered counter for database keystone Jun 29 12:06:14.027156 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG oslo_db.sqlalchemy.engines [None req-632243d9-d5f8-4af4-9f89-85e2cd2ba05e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80082) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 12:06:14.033224 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writer thread running {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 12:06:14.206579 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG passlib.handlers.bcrypt [None req-632243d9-d5f8-4af4-9f89-85e2cd2ba05e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80082) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 29 12:06:14.207115 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG passlib.handlers.bcrypt [None req-632243d9-d5f8-4af4-9f89-85e2cd2ba05e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80082) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 29 12:06:14.261508 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-632243d9-d5f8-4af4-9f89-85e2cd2ba05e None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:14.263096 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-632243d9-d5f8-4af4-9f89-85e2cd2ba05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:14.384067 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 29 12:06:14.636452 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f19c4-282c-496a-a8a7-69a0765db46c None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:14.707795 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: INFO dbcounter [None req-b28f19c4-282c-496a-a8a7-69a0765db46c None None] Registered counter for database keystone Jun 29 12:06:14.727496 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG oslo_db.sqlalchemy.engines [None req-b28f19c4-282c-496a-a8a7-69a0765db46c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80081) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 12:06:14.733967 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writer thread running {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 12:06:14.850802 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f19c4-282c-496a-a8a7-69a0765db46c None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:14.855011 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa52bd5-dfa6-435c-be94-9f48d3f7743f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:14.855657 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa52bd5-dfa6-435c-be94-9f48d3f7743f admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:14.855942 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa52bd5-dfa6-435c-be94-9f48d3f7743f admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:14.856219 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa52bd5-dfa6-435c-be94-9f48d3f7743f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:14.864426 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa52bd5-dfa6-435c-be94-9f48d3f7743f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:14.917654 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2aa52bd5-dfa6-435c-be94-9f48d3f7743f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 29 12:06:14.917944 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa52bd5-dfa6-435c-be94-9f48d3f7743f admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:14.927643 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Jun 29 12:06:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 29 12:06:14.933629 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632243d9-d5f8-4af4-9f89-85e2cd2ba05e None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:14.948410 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632243d9-d5f8-4af4-9f89-85e2cd2ba05e None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:14.952810 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451fd3a-ba41-410b-8561-5342113f69e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:14.953920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451fd3a-ba41-410b-8561-5342113f69e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:14.954211 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451fd3a-ba41-410b-8561-5342113f69e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:14.954493 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451fd3a-ba41-410b-8561-5342113f69e8 admin admin] PATH_INFO: `/v3/projects/74e1ea071109496291a5ab7856fef887` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:14.956056 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451fd3a-ba41-410b-8561-5342113f69e8 admin admin] RBAC: Authorizing `identity:get_project(project_id=74e1ea071109496291a5ab7856fef887)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:15.014124 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1451fd3a-ba41-410b-8561-5342113f69e8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 29 12:06:15.014469 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451fd3a-ba41-410b-8561-5342113f69e8 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:15.019211 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 3/5] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Jun 29 12:06:14 2022] GET /identity/v3/projects/74e1ea071109496291a5ab7856fef887 => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:17.029595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1820c39-2910-4361-9aad-1964cf996695 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:17.030102 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1820c39-2910-4361-9aad-1964cf996695 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:17.030102 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1820c39-2910-4361-9aad-1964cf996695 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:17.034177 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 3/6] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:06:17.039745 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c547efb-a8e4-4f33-8006-f3bb4f556998 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:17.040160 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c547efb-a8e4-4f33-8006-f3bb4f556998 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:17.040322 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c547efb-a8e4-4f33-8006-f3bb4f556998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:17.058834 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-4c547efb-a8e4-4f33-8006-f3bb4f556998 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:17.060360 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-4c547efb-a8e4-4f33-8006-f3bb4f556998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:17.068211 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 29 12:06:17.091379 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1820c39-2910-4361-9aad-1964cf996695 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:17.103276 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1820c39-2910-4361-9aad-1964cf996695 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:17.107432 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51404ab7-28fa-4cec-9e06-035753dc6958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:17.108066 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51404ab7-28fa-4cec-9e06-035753dc6958 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:17.108355 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51404ab7-28fa-4cec-9e06-035753dc6958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:17.108644 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51404ab7-28fa-4cec-9e06-035753dc6958 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:17.116196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51404ab7-28fa-4cec-9e06-035753dc6958 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:17.117985 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51404ab7-28fa-4cec-9e06-035753dc6958 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:17.127020 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Jun 29 12:06:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 12:06:17.132192 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c547efb-a8e4-4f33-8006-f3bb4f556998 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:17.141583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c547efb-a8e4-4f33-8006-f3bb4f556998 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:17.145866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e7d27-585e-4d88-831a-0cf89a95b5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:17.146761 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e7d27-585e-4d88-831a-0cf89a95b5bc admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:17.147049 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e7d27-585e-4d88-831a-0cf89a95b5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:17.147326 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e7d27-585e-4d88-831a-0cf89a95b5bc admin admin] PATH_INFO: `/v3/users/08fcb1f35af24620b53142bf98880fe8` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:17.148702 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e7d27-585e-4d88-831a-0cf89a95b5bc admin admin] RBAC: Authorizing `identity:get_user(user_id=08fcb1f35af24620b53142bf98880fe8)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:17.151195 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e7d27-585e-4d88-831a-0cf89a95b5bc admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:17.152749 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 5/9] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Jun 29 12:06:17 2022] GET /identity/v3/users/08fcb1f35af24620b53142bf98880fe8 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:06:19.225992 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca926dd0-3b0f-4af8-9ef9-b3a6969e8257 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:19.226531 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca926dd0-3b0f-4af8-9ef9-b3a6969e8257 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:19.226531 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca926dd0-3b0f-4af8-9ef9-b3a6969e8257 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:19.227963 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:19.233661 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b41e2f-eb70-45d3-acfd-575b3ab45f3f None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:19.234101 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b41e2f-eb70-45d3-acfd-575b3ab45f3f None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:19.234225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b41e2f-eb70-45d3-acfd-575b3ab45f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:19.251159 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-34b41e2f-eb70-45d3-acfd-575b3ab45f3f None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:19.252330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-34b41e2f-eb70-45d3-acfd-575b3ab45f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:19.269156 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a5c01-5811-48e4-9fa0-94267b27c0e3 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:19.269516 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a5c01-5811-48e4-9fa0-94267b27c0e3 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:19.269805 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a5c01-5811-48e4-9fa0-94267b27c0e3 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:19.271122 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 6/11] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:06:19.276247 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6954a48-cdec-4927-a890-8417e300de21 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:19.276531 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6954a48-cdec-4927-a890-8417e300de21 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:19.276811 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6954a48-cdec-4927-a890-8417e300de21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:19.317029 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG passlib.handlers.bcrypt [None req-f6954a48-cdec-4927-a890-8417e300de21 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80081) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 29 12:06:19.317447 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG passlib.handlers.bcrypt [None req-f6954a48-cdec-4927-a890-8417e300de21 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80081) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 29 12:06:19.332834 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 6/12] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:06:19.357514 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b41e2f-eb70-45d3-acfd-575b3ab45f3f None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:19.363370 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-f6954a48-cdec-4927-a890-8417e300de21 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:19.364974 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-f6954a48-cdec-4927-a890-8417e300de21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:19.381951 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:19.461925 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b41e2f-eb70-45d3-acfd-575b3ab45f3f None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:19.466188 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 7/13] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:06:19.488374 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6954a48-cdec-4927-a890-8417e300de21 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:19.496864 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f0202-cd45-4232-8252-6a6f49ca9aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:19.497662 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f0202-cd45-4232-8252-6a6f49ca9aba None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:19.497947 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f0202-cd45-4232-8252-6a6f49ca9aba None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:19.498249 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f0202-cd45-4232-8252-6a6f49ca9aba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:19.510157 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f0202-cd45-4232-8252-6a6f49ca9aba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:06:19.521234 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-c32f0202-cd45-4232-8252-6a6f49ca9aba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:06:19.521234 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:06:19.521234 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:06:19.521234 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:06:19.521234 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:06:19.521234 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:06:19.521234 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:06:19.521234 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:06:19.521234 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:06:19.521234 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:06:19.521234 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:06:19.521234 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:06:19.521234 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:06:19.521234 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:06:19.521234 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:06:19.521234 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:06:19.522309 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:06:19.522309 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:06:19.522309 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:06:19.522309 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:06:19.522309 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:06:19.522309 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:06:19.522309 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:06:19.522309 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:06:19.522309 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:06:19.522309 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:06:19.522309 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:06:19.522309 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:06:19.522309 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:06:19.522309 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:06:19.522309 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:06:19.522309 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:06:19.523252 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:06:19.523252 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:06:19.523252 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:06:19.523252 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:06:19.523252 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:06:19.523252 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:06:19.523252 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:06:19.523252 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:06:19.523252 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:06:19.523252 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:06:19.523252 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:06:19.523252 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:06:19.523252 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 7/14] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:06:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:06:19.528890 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f0202-cd45-4232-8252-6a6f49ca9aba None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:19.588958 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6954a48-cdec-4927-a890-8417e300de21 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:19.591260 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:19.609988 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:19.627697 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc556d7-6c94-44dd-9f82-eca3b6cb78f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:19.628542 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f0202-cd45-4232-8252-6a6f49ca9aba None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:19.628676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc556d7-6c94-44dd-9f82-eca3b6cb78f8 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:19.628869 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc556d7-6c94-44dd-9f82-eca3b6cb78f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:19.629141 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc556d7-6c94-44dd-9f82-eca3b6cb78f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:19.662095 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e22dd-3c98-4f63-aec4-3131b1366ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:19.662805 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e22dd-3c98-4f63-aec4-3131b1366ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:19.663097 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e22dd-3c98-4f63-aec4-3131b1366ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:19.663631 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e22dd-3c98-4f63-aec4-3131b1366ea6 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:19.664391 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e22dd-3c98-4f63-aec4-3131b1366ea6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:19.664702 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e22dd-3c98-4f63-aec4-3131b1366ea6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:19.666186 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e22dd-3c98-4f63-aec4-3131b1366ea6 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:19.677783 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 8/15] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:06:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:06:19.684021 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e22dd-3c98-4f63-aec4-3131b1366ea6 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:19.702195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc556d7-6c94-44dd-9f82-eca3b6cb78f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:19.703771 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc556d7-6c94-44dd-9f82-eca3b6cb78f8 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:19.787572 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e22dd-3c98-4f63-aec4-3131b1366ea6 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:19.801079 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 8/16] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:06:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 12:06:19.807630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc556d7-6c94-44dd-9f82-eca3b6cb78f8 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:19.810885 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:19.821484 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc86a53-4de2-4bc6-a65d-ca41c566bdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:19.823090 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc86a53-4de2-4bc6-a65d-ca41c566bdac None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:19.823380 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc86a53-4de2-4bc6-a65d-ca41c566bdac None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:19.823655 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc86a53-4de2-4bc6-a65d-ca41c566bdac None admin] PATH_INFO: `/v3/users/08fcb1f35af24620b53142bf98880fe8` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:19.824860 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc86a53-4de2-4bc6-a65d-ca41c566bdac None admin] RBAC: Authorizing `identity:get_user(user_id=08fcb1f35af24620b53142bf98880fe8)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:19.826333 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc86a53-4de2-4bc6-a65d-ca41c566bdac None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:19.827974 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 9/17] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:06:19 2022] GET /identity/v3/users/08fcb1f35af24620b53142bf98880fe8 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:06:19.833173 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc86a53-4de2-4bc6-a65d-ca41c566bdac None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:19.847739 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:19.909993 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc556d7-6c94-44dd-9f82-eca3b6cb78f8 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:19.935651 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc86a53-4de2-4bc6-a65d-ca41c566bdac None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:19.944440 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e5b1d-2006-4347-ada3-0160881858e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:19.945236 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e5b1d-2006-4347-ada3-0160881858e5 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:19.945523 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e5b1d-2006-4347-ada3-0160881858e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:19.945799 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e5b1d-2006-4347-ada3-0160881858e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:19.965342 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e5b1d-2006-4347-ada3-0160881858e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:19.966864 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e5b1d-2006-4347-ada3-0160881858e5 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:19.969388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b0b4e-686a-4fd0-b0ec-9f39945d5ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:19.970181 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b0b4e-686a-4fd0-b0ec-9f39945d5ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:19.970464 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b0b4e-686a-4fd0-b0ec-9f39945d5ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:19.970775 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b0b4e-686a-4fd0-b0ec-9f39945d5ef2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:19.971946 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b0b4e-686a-4fd0-b0ec-9f39945d5ef2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:19.973389 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b0b4e-686a-4fd0-b0ec-9f39945d5ef2 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:19.975209 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 10/18] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:06:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:06:19.981142 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b0b4e-686a-4fd0-b0ec-9f39945d5ef2 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:19.987661 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-611e5b1d-2006-4347-ada3-0160881858e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:06:19.987661 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:06:19.987661 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:06:19.987661 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:06:19.987661 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:06:19.987661 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:06:19.987661 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:06:19.987661 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:06:19.987661 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:06:19.987661 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:06:19.987661 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:06:19.987661 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:06:19.987661 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:06:19.987661 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:06:19.987661 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:06:19.988522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:06:19.988522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:06:19.988522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:06:19.988522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:06:19.988522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:06:19.988522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:06:19.988522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:06:19.988522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:06:19.988522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:06:19.988522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:06:19.988522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:06:19.988522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:06:19.988522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:06:19.988522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:06:19.988522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:06:19.988522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:06:19.988522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:06:19.989311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:06:19.989311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:06:19.989311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:06:19.989311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:06:19.989311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 9/19] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:06:19.995776 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e5b1d-2006-4347-ada3-0160881858e5 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:20.051886 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:20.061158 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:20.080827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b0b4e-686a-4fd0-b0ec-9f39945d5ef2 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:20.096827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e5b1d-2006-4347-ada3-0160881858e5 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:20.113900 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8082bc-d209-4d12-97d0-2d2bba6ba165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:20.114561 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8082bc-d209-4d12-97d0-2d2bba6ba165 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:20.114867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8082bc-d209-4d12-97d0-2d2bba6ba165 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:20.115144 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8082bc-d209-4d12-97d0-2d2bba6ba165 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:20.115973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8082bc-d209-4d12-97d0-2d2bba6ba165 None admin] RBAC: Adding query filter params (role.id=5ef3464f4436446b88430cdf7cc1a3d7, scope.domain.id=default, user.id=08fcb1f35af24620b53142bf98880fe8) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:20.116286 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8082bc-d209-4d12-97d0-2d2bba6ba165 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:20.117729 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8082bc-d209-4d12-97d0-2d2bba6ba165 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:20.124976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 11/20] 10.222.0.13 () {56 vars in 1322 bytes} [Wed Jun 29 12:06:19 2022] GET /identity/v3/role_assignments?user.id=08fcb1f35af24620b53142bf98880fe8&scope.domain.id=default&role.id=5ef3464f4436446b88430cdf7cc1a3d7 => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:06:20.131808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22899122-4248-434c-9b06-369b9e422c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:20.132491 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22899122-4248-434c-9b06-369b9e422c18 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:20.132778 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22899122-4248-434c-9b06-369b9e422c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:20.133053 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22899122-4248-434c-9b06-369b9e422c18 None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:20.133799 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22899122-4248-434c-9b06-369b9e422c18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:20.134107 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22899122-4248-434c-9b06-369b9e422c18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:20.135659 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22899122-4248-434c-9b06-369b9e422c18 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:20.155170 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 10/21] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:06:22.379395 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061a8fd-6d50-4080-8198-bcd18bb8396c None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:22.379911 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061a8fd-6d50-4080-8198-bcd18bb8396c None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:22.380007 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061a8fd-6d50-4080-8198-bcd18bb8396c None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:22.381304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 12/22] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:22.388780 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a80ca-ad4b-46b6-84c9-f352b62d2b58 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:22.389624 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a80ca-ad4b-46b6-84c9-f352b62d2b58 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:22.390157 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a80ca-ad4b-46b6-84c9-f352b62d2b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:22.420195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-8d9a80ca-ad4b-46b6-84c9-f352b62d2b58 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:22.421752 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-8d9a80ca-ad4b-46b6-84c9-f352b62d2b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:22.513388 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 11/23] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:06:22.552139 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061a8fd-6d50-4080-8198-bcd18bb8396c None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:22.687515 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061a8fd-6d50-4080-8198-bcd18bb8396c None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:22.734659 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28369f86-1e58-4396-9edc-0082b0bff4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:22.734659 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28369f86-1e58-4396-9edc-0082b0bff4af None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:22.734850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28369f86-1e58-4396-9edc-0082b0bff4af None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:22.735104 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28369f86-1e58-4396-9edc-0082b0bff4af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:22.752454 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28369f86-1e58-4396-9edc-0082b0bff4af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:06:22.760755 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-28369f86-1e58-4396-9edc-0082b0bff4af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:06:22.760755 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:06:22.760755 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:06:22.760755 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:06:22.760755 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:06:22.760755 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:06:22.760755 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:06:22.760755 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:06:22.760755 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:06:22.760755 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:06:22.760755 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:06:22.760755 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:06:22.760755 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:06:22.760755 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:06:22.760755 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:06:22.760755 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:06:22.761583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:06:22.761583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:06:22.761583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:06:22.761583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:06:22.761583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:06:22.761583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:06:22.761583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:06:22.761583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:06:22.761583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:06:22.761583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:06:22.761583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:06:22.761583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:06:22.761583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:06:22.761583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:06:22.761583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:06:22.761583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:06:22.762358 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:06:22.762358 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:06:22.762358 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:06:22.762358 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:06:22.762358 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:06:22.762358 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:06:22.762358 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:06:22.762358 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:06:22.762358 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:06:22.762358 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:06:22.762358 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:06:22.762358 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:06:22.762358 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 13/24] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:06:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:06:22.771770 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a80ca-ad4b-46b6-84c9-f352b62d2b58 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:22.857574 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:22.929397 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a80ca-ad4b-46b6-84c9-f352b62d2b58 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:22.933057 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77558317-7ac3-473a-bb14-fc2468bce028 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:22.933351 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77558317-7ac3-473a-bb14-fc2468bce028 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:22.933636 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77558317-7ac3-473a-bb14-fc2468bce028 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:22.935383 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 14/25] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:22.939967 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcaf001-e75f-4776-8d88-f3e40d0f40f8 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:22.940200 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcaf001-e75f-4776-8d88-f3e40d0f40f8 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:22.940487 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcaf001-e75f-4776-8d88-f3e40d0f40f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:22.952046 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:22.975812 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-0bcaf001-e75f-4776-8d88-f3e40d0f40f8 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:22.977575 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-0bcaf001-e75f-4776-8d88-f3e40d0f40f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:23.005069 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c856645-b89d-4625-b999-62043fd13c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:23.006294 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c856645-b89d-4625-b999-62043fd13c34 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:23.006653 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c856645-b89d-4625-b999-62043fd13c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:23.007014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c856645-b89d-4625-b999-62043fd13c34 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:23.007783 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c856645-b89d-4625-b999-62043fd13c34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:23.008093 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c856645-b89d-4625-b999-62043fd13c34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:23.010261 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c856645-b89d-4625-b999-62043fd13c34 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:23.031957 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 12/26] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:06:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:23.033272 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b126c-292b-41c8-8a53-d8eadf515ca9 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:23.033560 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b126c-292b-41c8-8a53-d8eadf515ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:23.033836 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b126c-292b-41c8-8a53-d8eadf515ca9 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:23.035083 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 13/27] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:23.043899 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d1f46-3940-439e-b786-7bd6b5778dd3 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:23.044366 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d1f46-3940-439e-b786-7bd6b5778dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:23.044786 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d1f46-3940-439e-b786-7bd6b5778dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:23.062204 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-359d1f46-3940-439e-b786-7bd6b5778dd3 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:23.063626 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-359d1f46-3940-439e-b786-7bd6b5778dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:23.103983 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 15/28] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:06:23.104833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcaf001-e75f-4776-8d88-f3e40d0f40f8 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:23.191039 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 14/29] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:06:23.191679 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d1f46-3940-439e-b786-7bd6b5778dd3 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:23.256399 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcaf001-e75f-4776-8d88-f3e40d0f40f8 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:23.263003 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:23.300759 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece12c1-c16f-49ab-baba-ee5e2617d000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:23.302429 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece12c1-c16f-49ab-baba-ee5e2617d000 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:23.302756 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece12c1-c16f-49ab-baba-ee5e2617d000 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:23.303037 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece12c1-c16f-49ab-baba-ee5e2617d000 None admin] PATH_INFO: `/v3/users/08fcb1f35af24620b53142bf98880fe8` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:23.304646 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece12c1-c16f-49ab-baba-ee5e2617d000 None admin] RBAC: Authorizing `identity:get_user(user_id=08fcb1f35af24620b53142bf98880fe8)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:23.306541 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece12c1-c16f-49ab-baba-ee5e2617d000 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:23.309652 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 16/30] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:06:23 2022] GET /identity/v3/users/08fcb1f35af24620b53142bf98880fe8 => generated 247 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:23.311795 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466c224-9943-418d-aaa6-990fc9e011c5 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:23.312268 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466c224-9943-418d-aaa6-990fc9e011c5 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:23.312726 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466c224-9943-418d-aaa6-990fc9e011c5 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:23.314377 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 17/31] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:23.319996 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466c224-9943-418d-aaa6-990fc9e011c5 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:23.323533 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:23.337942 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d1f46-3940-439e-b786-7bd6b5778dd3 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:23.375009 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19721bbe-fada-4faa-92f8-5fe3d7a0d32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:23.376067 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19721bbe-fada-4faa-92f8-5fe3d7a0d32d None admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:23.376535 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19721bbe-fada-4faa-92f8-5fe3d7a0d32d None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:23.377014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19721bbe-fada-4faa-92f8-5fe3d7a0d32d None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:23.377983 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19721bbe-fada-4faa-92f8-5fe3d7a0d32d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:23.379690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19721bbe-fada-4faa-92f8-5fe3d7a0d32d None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:23.443542 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466c224-9943-418d-aaa6-990fc9e011c5 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:23.482439 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb177a-8c56-4f47-ad4c-0b1bcaaf7a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:23.483271 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb177a-8c56-4f47-ad4c-0b1bcaaf7a70 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:23.483554 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb177a-8c56-4f47-ad4c-0b1bcaaf7a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:23.483830 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb177a-8c56-4f47-ad4c-0b1bcaaf7a70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:23.495543 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb177a-8c56-4f47-ad4c-0b1bcaaf7a70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:23.497107 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb177a-8c56-4f47-ad4c-0b1bcaaf7a70 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:23.516154 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-a5fb177a-8c56-4f47-ad4c-0b1bcaaf7a70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:06:23.516154 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:06:23.516154 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:06:23.516154 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:06:23.516154 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:06:23.516154 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:06:23.516154 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:06:23.516154 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:06:23.516154 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:06:23.516154 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:06:23.516154 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:06:23.516154 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:06:23.516154 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:06:23.516154 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:06:23.516154 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:06:23.516968 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:06:23.516968 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:06:23.516968 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:06:23.516968 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:06:23.516968 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:06:23.516968 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:06:23.516968 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:06:23.516968 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:06:23.516968 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:06:23.516968 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:06:23.516968 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:06:23.516968 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:06:23.516968 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:06:23.516968 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:06:23.516968 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:06:23.516968 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:06:23.516968 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:06:23.517938 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:06:23.517938 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:06:23.517938 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:06:23.517938 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:06:23.517938 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 18/32] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:06:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:06:23.522967 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb177a-8c56-4f47-ad4c-0b1bcaaf7a70 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:23.543013 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 15/33] 10.222.0.13 () {60 vars in 1131 bytes} [Wed Jun 29 12:06:23 2022] POST /identity/v3/roles => generated 225 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:06:23.545358 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a5745-bc87-4387-b0f0-4ec72c5f42dc None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:23.545840 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a5745-bc87-4387-b0f0-4ec72c5f42dc None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:23.546269 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a5745-bc87-4387-b0f0-4ec72c5f42dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:23.585488 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-5d8a5745-bc87-4387-b0f0-4ec72c5f42dc None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:23.587118 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-5d8a5745-bc87-4387-b0f0-4ec72c5f42dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:23.643022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:23.705159 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb177a-8c56-4f47-ad4c-0b1bcaaf7a70 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:23.729658 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 16/34] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:06:23.730838 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a5745-bc87-4387-b0f0-4ec72c5f42dc None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:23.749368 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8ceb3-7d30-4425-b1b7-76515ade8b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:23.751138 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8ceb3-7d30-4425-b1b7-76515ade8b16 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:23.751647 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8ceb3-7d30-4425-b1b7-76515ade8b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:23.753045 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8ceb3-7d30-4425-b1b7-76515ade8b16 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:23.754516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8ceb3-7d30-4425-b1b7-76515ade8b16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:23.756318 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8ceb3-7d30-4425-b1b7-76515ade8b16 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:23.758574 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 19/35] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:06:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:23.763497 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:23.766924 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8ceb3-7d30-4425-b1b7-76515ade8b16 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:23.844922 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a5745-bc87-4387-b0f0-4ec72c5f42dc None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:23.890268 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1d6a7-c273-4f37-af1f-89bafc5472a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:23.890986 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1d6a7-c273-4f37-af1f-89bafc5472a2 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:23.891273 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1d6a7-c273-4f37-af1f-89bafc5472a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:23.891552 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1d6a7-c273-4f37-af1f-89bafc5472a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:23.892270 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1d6a7-c273-4f37-af1f-89bafc5472a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:23.892577 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1d6a7-c273-4f37-af1f-89bafc5472a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:23.893681 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8ceb3-7d30-4425-b1b7-76515ade8b16 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:23.894089 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1d6a7-c273-4f37-af1f-89bafc5472a2 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:23.906625 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 17/36] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:23.907282 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1d6a7-c273-4f37-af1f-89bafc5472a2 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:23.925216 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:23.937479 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c278c22-f570-4eeb-a4b2-35077e277d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:23.938401 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c278c22-f570-4eeb-a4b2-35077e277d42 None admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:23.938713 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c278c22-f570-4eeb-a4b2-35077e277d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:23.938997 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c278c22-f570-4eeb-a4b2-35077e277d42 None admin] PATH_INFO: `/v3/domains/default/users/08fcb1f35af24620b53142bf98880fe8/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:23.941017 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c278c22-f570-4eeb-a4b2-35077e277d42 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=08fcb1f35af24620b53142bf98880fe8, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:23.942593 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c278c22-f570-4eeb-a4b2-35077e277d42 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:24.001733 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:24.015757 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1d6a7-c273-4f37-af1f-89bafc5472a2 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:24.049971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebeaf3f-b8f0-4ac8-a943-5a64219c93dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:24.050669 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebeaf3f-b8f0-4ac8-a943-5a64219c93dd None admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:24.050946 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebeaf3f-b8f0-4ac8-a943-5a64219c93dd None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:24.051220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebeaf3f-b8f0-4ac8-a943-5a64219c93dd None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:24.051971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebeaf3f-b8f0-4ac8-a943-5a64219c93dd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:24.053354 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebeaf3f-b8f0-4ac8-a943-5a64219c93dd None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:24.067541 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 18/37] 10.222.0.13 () {60 vars in 1131 bytes} [Wed Jun 29 12:06:23 2022] POST /identity/v3/roles => generated 219 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:06:24.068607 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41416b9a-e654-4ee2-a797-5293200c6d0a None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:24.068898 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41416b9a-e654-4ee2-a797-5293200c6d0a None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:24.069175 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41416b9a-e654-4ee2-a797-5293200c6d0a None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:24.074910 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 20/38] 10.222.0.13 () {58 vars in 1361 bytes} [Wed Jun 29 12:06:23 2022] PUT /identity/v3/domains/default/users/08fcb1f35af24620b53142bf98880fe8/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:06:24.075130 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 19/39] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:24.080815 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c278c22-f570-4eeb-a4b2-35077e277d42 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:24.081009 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7858238-0f5d-4aed-b16f-e622396d3107 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:24.081009 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7858238-0f5d-4aed-b16f-e622396d3107 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:24.081009 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7858238-0f5d-4aed-b16f-e622396d3107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:24.114771 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-a7858238-0f5d-4aed-b16f-e622396d3107 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:24.120508 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-a7858238-0f5d-4aed-b16f-e622396d3107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:24.264959 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 20/40] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:06:24.278167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c278c22-f570-4eeb-a4b2-35077e277d42 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:24.287744 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7858238-0f5d-4aed-b16f-e622396d3107 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:24.387087 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:24.413716 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7858238-0f5d-4aed-b16f-e622396d3107 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:24.426547 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be810f-1889-40f5-9788-c5282f89ffee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:24.427250 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be810f-1889-40f5-9788-c5282f89ffee None admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:24.427546 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be810f-1889-40f5-9788-c5282f89ffee None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:24.427829 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be810f-1889-40f5-9788-c5282f89ffee None admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:24.428550 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be810f-1889-40f5-9788-c5282f89ffee None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:24.430233 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be810f-1889-40f5-9788-c5282f89ffee None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:24.454340 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43402db2-3fe1-4c10-b150-f85225873e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:24.455378 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43402db2-3fe1-4c10-b150-f85225873e9c None admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:24.455809 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43402db2-3fe1-4c10-b150-f85225873e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:24.456258 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43402db2-3fe1-4c10-b150-f85225873e9c None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:24.457164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43402db2-3fe1-4c10-b150-f85225873e9c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:24.458702 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43402db2-3fe1-4c10-b150-f85225873e9c None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:24.462685 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 21/41] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Jun 29 12:06:24 2022] POST /identity/v3/projects => generated 301 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:06:24.464530 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d058f-a43e-4e79-9f55-49a0102e7287 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:24.465038 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d058f-a43e-4e79-9f55-49a0102e7287 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:24.465539 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d058f-a43e-4e79-9f55-49a0102e7287 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:24.471017 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 22/42] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:24.474067 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f273b6f-5eac-4756-9ce5-1a276c95923e None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:24.474358 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f273b6f-5eac-4756-9ce5-1a276c95923e None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:24.474664 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f273b6f-5eac-4756-9ce5-1a276c95923e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:24.495520 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-5f273b6f-5eac-4756-9ce5-1a276c95923e None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:24.497105 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-5f273b6f-5eac-4756-9ce5-1a276c95923e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:24.503102 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 21/43] 10.222.0.13 () {60 vars in 1131 bytes} [Wed Jun 29 12:06:24 2022] POST /identity/v3/roles => generated 223 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:06:24.527604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:24.579008 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 23/44] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:06:24.603799 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43402db2-3fe1-4c10-b150-f85225873e9c None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:24.729393 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43402db2-3fe1-4c10-b150-f85225873e9c None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:24.765625 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337365b-655c-4e43-b80d-bec076370c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:24.766436 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337365b-655c-4e43-b80d-bec076370c5d None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:24.766750 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337365b-655c-4e43-b80d-bec076370c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:24.767031 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337365b-655c-4e43-b80d-bec076370c5d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:24.768475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7337365b-655c-4e43-b80d-bec076370c5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:24.769951 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7337365b-655c-4e43-b80d-bec076370c5d None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:24.771772 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 22/45] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:06:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:24.778787 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f273b6f-5eac-4756-9ce5-1a276c95923e None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:24.878193 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f273b6f-5eac-4756-9ce5-1a276c95923e None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:24.911978 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20c878-80b7-445c-b4d2-3524ea483bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:24.912637 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20c878-80b7-445c-b4d2-3524ea483bc6 None admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:24.912921 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20c878-80b7-445c-b4d2-3524ea483bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:24.913197 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20c878-80b7-445c-b4d2-3524ea483bc6 None admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:24.914163 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20c878-80b7-445c-b4d2-3524ea483bc6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:24.916300 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20c878-80b7-445c-b4d2-3524ea483bc6 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:24.941505 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 24/46] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Jun 29 12:06:24 2022] POST /identity/v3/projects => generated 312 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:06:26.245088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205e3b3-7fa3-4ff2-8e2f-64df02f16017 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:26.245613 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205e3b3-7fa3-4ff2-8e2f-64df02f16017 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:26.245698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205e3b3-7fa3-4ff2-8e2f-64df02f16017 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:26.247054 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 23/47] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:26.252245 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d44557-c1cb-413b-8d89-e20c52d854c8 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:26.252732 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d44557-c1cb-413b-8d89-e20c52d854c8 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:26.252938 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d44557-c1cb-413b-8d89-e20c52d854c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:26.270741 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-78d44557-c1cb-413b-8d89-e20c52d854c8 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:26.271907 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-78d44557-c1cb-413b-8d89-e20c52d854c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:26.282805 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:26.337005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 25/48] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:06:26.367964 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205e3b3-7fa3-4ff2-8e2f-64df02f16017 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:26.377664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:26.473881 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205e3b3-7fa3-4ff2-8e2f-64df02f16017 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:26.507882 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb706030-f091-4c03-9c4a-557c0d04e921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:26.508592 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb706030-f091-4c03-9c4a-557c0d04e921 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:26.508878 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb706030-f091-4c03-9c4a-557c0d04e921 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:26.509183 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb706030-f091-4c03-9c4a-557c0d04e921 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:26.520505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb706030-f091-4c03-9c4a-557c0d04e921 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:06:26.529681 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-eb706030-f091-4c03-9c4a-557c0d04e921 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:06:26.529681 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:06:26.529681 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:06:26.529681 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:06:26.529681 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:06:26.529681 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:06:26.529681 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:06:26.529681 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:06:26.529681 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:06:26.529681 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:06:26.529681 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:06:26.529681 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:06:26.529681 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:06:26.529681 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:06:26.529681 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:06:26.529681 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:06:26.530536 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:06:26.530536 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:06:26.530536 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:06:26.530536 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:06:26.530536 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:06:26.530536 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:06:26.530536 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:06:26.530536 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:06:26.530536 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:06:26.530536 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:06:26.530536 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:06:26.530536 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:06:26.530536 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:06:26.530536 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:06:26.530536 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:06:26.530536 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:06:26.531404 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:06:26.531404 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:06:26.531404 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:06:26.531404 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:06:26.531404 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:06:26.531404 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:06:26.531404 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:06:26.531404 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:06:26.531404 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:06:26.531404 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:06:26.531404 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:06:26.531404 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:06:26.531404 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 24/49] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:06:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:06:26.536601 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d44557-c1cb-413b-8d89-e20c52d854c8 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:26.636311 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d44557-c1cb-413b-8d89-e20c52d854c8 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:26.672943 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a48b87-f9ab-44b8-942f-4085e7e40bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:26.673624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a48b87-f9ab-44b8-942f-4085e7e40bbb None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:26.673917 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a48b87-f9ab-44b8-942f-4085e7e40bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:26.674204 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a48b87-f9ab-44b8-942f-4085e7e40bbb None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:26.674998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a48b87-f9ab-44b8-942f-4085e7e40bbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:26.675315 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a48b87-f9ab-44b8-942f-4085e7e40bbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:26.676731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a48b87-f9ab-44b8-942f-4085e7e40bbb None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:26.685104 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 26/50] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:06:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:26.690545 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb706030-f091-4c03-9c4a-557c0d04e921 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:26.772385 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:26.809580 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb706030-f091-4c03-9c4a-557c0d04e921 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:26.844202 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe9ec1-6c14-4e34-9b36-8dd359cdf3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:26.845075 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe9ec1-6c14-4e34-9b36-8dd359cdf3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:26.845360 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe9ec1-6c14-4e34-9b36-8dd359cdf3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:26.845634 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe9ec1-6c14-4e34-9b36-8dd359cdf3a1 None admin] PATH_INFO: `/v3/users/08fcb1f35af24620b53142bf98880fe8` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:26.847078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe9ec1-6c14-4e34-9b36-8dd359cdf3a1 None admin] RBAC: Authorizing `identity:get_user(user_id=08fcb1f35af24620b53142bf98880fe8)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:26.848536 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe9ec1-6c14-4e34-9b36-8dd359cdf3a1 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:26.850155 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 25/51] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:06:26 2022] GET /identity/v3/users/08fcb1f35af24620b53142bf98880fe8 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:26.855823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a48b87-f9ab-44b8-942f-4085e7e40bbb None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:26.867168 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:26.954937 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a48b87-f9ab-44b8-942f-4085e7e40bbb None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:26.987475 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba28990-9e8e-4103-9b85-b32453ac1583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:26.988269 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba28990-9e8e-4103-9b85-b32453ac1583 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:26.988553 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba28990-9e8e-4103-9b85-b32453ac1583 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:26.988830 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba28990-9e8e-4103-9b85-b32453ac1583 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:26.989989 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba28990-9e8e-4103-9b85-b32453ac1583 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:26.990132 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dee42-ae50-4f90-9fe6-58b614a5a2bf None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:26.990431 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dee42-ae50-4f90-9fe6-58b614a5a2bf None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:26.990750 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dee42-ae50-4f90-9fe6-58b614a5a2bf None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:26.991492 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba28990-9e8e-4103-9b85-b32453ac1583 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:26.992122 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 26/52] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:26.993082 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 27/53] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:06:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:26.997209 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b049255-b0d3-4596-b1ca-123b8700da4f None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:26.997505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b049255-b0d3-4596-b1ca-123b8700da4f None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:26.997788 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b049255-b0d3-4596-b1ca-123b8700da4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:26.999370 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba28990-9e8e-4103-9b85-b32453ac1583 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:27.015358 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-1b049255-b0d3-4596-b1ca-123b8700da4f None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:27.016577 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-1b049255-b0d3-4596-b1ca-123b8700da4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:27.080401 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:27.087726 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 27/54] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:06:27.106392 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba28990-9e8e-4103-9b85-b32453ac1583 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:27.110954 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b049255-b0d3-4596-b1ca-123b8700da4f None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:27.141755 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b5143-2b69-4e00-8017-2c0c406a3b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:27.142415 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b5143-2b69-4e00-8017-2c0c406a3b13 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:27.142737 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b5143-2b69-4e00-8017-2c0c406a3b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:27.143022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b5143-2b69-4e00-8017-2c0c406a3b13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:27.143858 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b5143-2b69-4e00-8017-2c0c406a3b13 None admin] RBAC: Adding query filter params (role.id=5ef3464f4436446b88430cdf7cc1a3d7, scope.domain.id=default, user.id=08fcb1f35af24620b53142bf98880fe8) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:27.144183 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b5143-2b69-4e00-8017-2c0c406a3b13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:27.145664 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b5143-2b69-4e00-8017-2c0c406a3b13 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:27.151598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 28/55] 10.222.0.13 () {56 vars in 1322 bytes} [Wed Jun 29 12:06:26 2022] GET /identity/v3/role_assignments?user.id=08fcb1f35af24620b53142bf98880fe8&scope.domain.id=default&role.id=5ef3464f4436446b88430cdf7cc1a3d7 => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:06:27.283061 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:27.326837 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b049255-b0d3-4596-b1ca-123b8700da4f None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:27.362073 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82ae89-9b90-4c5c-a430-9fd2ebcb9dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:27.362835 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82ae89-9b90-4c5c-a430-9fd2ebcb9dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:27.363117 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82ae89-9b90-4c5c-a430-9fd2ebcb9dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:27.363398 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82ae89-9b90-4c5c-a430-9fd2ebcb9dc1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:27.364559 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82ae89-9b90-4c5c-a430-9fd2ebcb9dc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:27.366021 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82ae89-9b90-4c5c-a430-9fd2ebcb9dc1 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:27.367673 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 28/56] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:06:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:06:27.374341 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b5143-2b69-4e00-8017-2c0c406a3b13 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:27.481645 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b5143-2b69-4e00-8017-2c0c406a3b13 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:27.515942 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04233b37-4039-4da0-b5bb-5b884b71a800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:27.516600 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04233b37-4039-4da0-b5bb-5b884b71a800 None admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:27.516886 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04233b37-4039-4da0-b5bb-5b884b71a800 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:27.517165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04233b37-4039-4da0-b5bb-5b884b71a800 None admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:27.517897 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04233b37-4039-4da0-b5bb-5b884b71a800 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:27.519370 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04233b37-4039-4da0-b5bb-5b884b71a800 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:27.528997 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:27.545111 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 29/57] 10.222.0.13 () {60 vars in 1140 bytes} [Wed Jun 29 12:06:27 2022] POST /identity/v3/projects => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:06:29.550975 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ab57f-2877-47f6-84a3-e0e3d46c80d5 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:29.551498 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ab57f-2877-47f6-84a3-e0e3d46c80d5 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:29.551606 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ab57f-2877-47f6-84a3-e0e3d46c80d5 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:29.552912 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 29/58] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:29.558161 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15e7a8-ad0f-47dd-803d-9f22098f51d0 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:29.558552 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15e7a8-ad0f-47dd-803d-9f22098f51d0 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:29.558758 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15e7a8-ad0f-47dd-803d-9f22098f51d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:29.574869 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-ea15e7a8-ad0f-47dd-803d-9f22098f51d0 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:29.576041 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-ea15e7a8-ad0f-47dd-803d-9f22098f51d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:29.640298 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 30/59] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:06:29.665148 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ab57f-2877-47f6-84a3-e0e3d46c80d5 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:29.763742 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ab57f-2877-47f6-84a3-e0e3d46c80d5 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:29.792020 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:29.797108 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6aac7-6864-4085-86e3-341e9d7cac39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:29.797899 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6aac7-6864-4085-86e3-341e9d7cac39 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:29.798184 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6aac7-6864-4085-86e3-341e9d7cac39 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:29.798457 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6aac7-6864-4085-86e3-341e9d7cac39 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:29.799649 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e6aac7-6864-4085-86e3-341e9d7cac39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:29.801218 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e6aac7-6864-4085-86e3-341e9d7cac39 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:29.802789 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 30/60] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:06:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:29.808275 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15e7a8-ad0f-47dd-803d-9f22098f51d0 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:29.911658 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15e7a8-ad0f-47dd-803d-9f22098f51d0 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:29.935372 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:29.948353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249cd621-fef8-453d-90a9-9f407c150a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:29.949028 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249cd621-fef8-453d-90a9-9f407c150a25 None admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:29.949316 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249cd621-fef8-453d-90a9-9f407c150a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:29.949598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249cd621-fef8-453d-90a9-9f407c150a25 None admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:29.950317 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249cd621-fef8-453d-90a9-9f407c150a25 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:29.951825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249cd621-fef8-453d-90a9-9f407c150a25 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:29.975711 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 31/61] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 29 12:06:29 2022] POST /identity/v3/users => generated 275 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:06:33.039520 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8aa11-34da-4dfd-bde6-c82362a96ef0 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:33.040515 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8aa11-34da-4dfd-bde6-c82362a96ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:33.041079 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8aa11-34da-4dfd-bde6-c82362a96ef0 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:33.042926 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 31/62] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:33.048345 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589c2a9-f37c-450f-9dea-19c836630405 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:33.049170 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589c2a9-f37c-450f-9dea-19c836630405 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:33.049697 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589c2a9-f37c-450f-9dea-19c836630405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:33.071182 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-e589c2a9-f37c-450f-9dea-19c836630405 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:33.073366 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-e589c2a9-f37c-450f-9dea-19c836630405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:33.088630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f7fca-3da6-4e64-bd14-7eddf1276648 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:33.089222 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f7fca-3da6-4e64-bd14-7eddf1276648 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:33.089715 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f7fca-3da6-4e64-bd14-7eddf1276648 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:33.091547 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 32/63] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:33.096724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc581548-70ae-4f3c-bdaf-16bdf5e40d70 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:33.097234 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc581548-70ae-4f3c-bdaf-16bdf5e40d70 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:33.097723 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc581548-70ae-4f3c-bdaf-16bdf5e40d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:33.114942 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-dc581548-70ae-4f3c-bdaf-16bdf5e40d70 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:33.116403 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-dc581548-70ae-4f3c-bdaf-16bdf5e40d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:33.170205 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 32/64] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:06:33.194276 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589c2a9-f37c-450f-9dea-19c836630405 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:33.251735 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 33/65] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:06:33.277186 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc581548-70ae-4f3c-bdaf-16bdf5e40d70 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:33.377148 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589c2a9-f37c-450f-9dea-19c836630405 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:33.396799 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:33.403798 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc581548-70ae-4f3c-bdaf-16bdf5e40d70 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:33.438830 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:33.442722 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5f31f-6247-4d07-8602-a0bd46f4d4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:33.443782 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5f31f-6247-4d07-8602-a0bd46f4d4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:33.444218 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5f31f-6247-4d07-8602-a0bd46f4d4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:33.444644 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5f31f-6247-4d07-8602-a0bd46f4d4f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:33.451514 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5d8c6-78f0-4785-a2fe-08d7acbd12a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:33.452649 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5d8c6-78f0-4785-a2fe-08d7acbd12a3 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:33.453079 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5d8c6-78f0-4785-a2fe-08d7acbd12a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:33.453574 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5d8c6-78f0-4785-a2fe-08d7acbd12a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:33.456286 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5f31f-6247-4d07-8602-a0bd46f4d4f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:06:33.464469 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-fdc5f31f-6247-4d07-8602-a0bd46f4d4f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:06:33.464469 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:06:33.464469 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:06:33.464469 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:06:33.464469 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:06:33.464469 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:06:33.464469 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:06:33.464469 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:06:33.464469 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:06:33.464469 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:06:33.464469 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:06:33.464469 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:06:33.464469 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:06:33.464469 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:06:33.464469 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:06:33.464469 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:06:33.465521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:06:33.465521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:06:33.465521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:06:33.465521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:06:33.465521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:06:33.465521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:06:33.465521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:06:33.465521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:06:33.465521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:06:33.465521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:06:33.465521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:06:33.465521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:06:33.465521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:06:33.465521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:06:33.465521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:06:33.465521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:06:33.466558 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:06:33.466558 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:06:33.466558 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:06:33.466558 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:06:33.466558 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:06:33.466558 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:06:33.466558 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:06:33.466558 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:06:33.466558 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:06:33.466558 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:06:33.466558 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:06:33.466558 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:06:33.468595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 34/66] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:06:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:06:33.482663 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5f31f-6247-4d07-8602-a0bd46f4d4f8 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:33.482825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5d8c6-78f0-4785-a2fe-08d7acbd12a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:06:33.489902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-d7d5d8c6-78f0-4785-a2fe-08d7acbd12a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:06:33.489902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:06:33.489902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:06:33.489902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:06:33.489902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:06:33.489902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:06:33.489902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:06:33.489902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:06:33.489902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:06:33.489902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:06:33.489902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:06:33.489902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:06:33.489902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:06:33.489902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:06:33.489902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:06:33.489902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:06:33.490806 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:06:33.490806 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:06:33.490806 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:06:33.490806 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:06:33.490806 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:06:33.490806 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:06:33.490806 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:06:33.490806 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:06:33.490806 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:06:33.490806 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:06:33.490806 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:06:33.490806 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:06:33.490806 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:06:33.490806 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:06:33.490806 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:06:33.490806 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:06:33.491969 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:06:33.491969 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:06:33.491969 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:06:33.491969 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:06:33.491969 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:06:33.491969 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:06:33.491969 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:06:33.491969 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:06:33.491969 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:06:33.491969 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:06:33.491969 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:06:33.491969 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:06:33.491969 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 33/67] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:06:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:06:33.492826 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a9c75-ca7a-4936-8961-e6e4570680de None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:33.492826 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a9c75-ca7a-4936-8961-e6e4570680de None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:33.493143 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a9c75-ca7a-4936-8961-e6e4570680de None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:33.495056 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 34/68] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:33.501473 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a9c75-ca7a-4936-8961-e6e4570680de None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:33.604596 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5f31f-6247-4d07-8602-a0bd46f4d4f8 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:33.635698 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a9c75-ca7a-4936-8961-e6e4570680de None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:33.642927 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3f6ae-5027-4cec-9b18-813d721aad26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:33.643839 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3f6ae-5027-4cec-9b18-813d721aad26 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:33.644304 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3f6ae-5027-4cec-9b18-813d721aad26 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:33.644834 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3f6ae-5027-4cec-9b18-813d721aad26 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:33.645772 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3f6ae-5027-4cec-9b18-813d721aad26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:33.646264 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3f6ae-5027-4cec-9b18-813d721aad26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:33.647987 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3f6ae-5027-4cec-9b18-813d721aad26 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:33.659185 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 35/69] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:06:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:33.660515 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd2be7-7fbc-47f9-b11f-ac9c7be4ec05 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:33.660806 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd2be7-7fbc-47f9-b11f-ac9c7be4ec05 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:33.661083 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd2be7-7fbc-47f9-b11f-ac9c7be4ec05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:33.678429 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151ffc9-c249-4a3f-9c82-f673af8f3225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:33.679482 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151ffc9-c249-4a3f-9c82-f673af8f3225 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:33.679995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151ffc9-c249-4a3f-9c82-f673af8f3225 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:33.680490 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151ffc9-c249-4a3f-9c82-f673af8f3225 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:33.682160 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151ffc9-c249-4a3f-9c82-f673af8f3225 None admin] RBAC: Adding query filter params (name=member) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:33.682972 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151ffc9-c249-4a3f-9c82-f673af8f3225 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:33.683078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-ebdd2be7-7fbc-47f9-b11f-ac9c7be4ec05 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:33.684172 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-ebdd2be7-7fbc-47f9-b11f-ac9c7be4ec05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:33.685450 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151ffc9-c249-4a3f-9c82-f673af8f3225 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:33.695488 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 35/70] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 29 12:06:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:33.696781 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151ffc9-c249-4a3f-9c82-f673af8f3225 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:33.731497 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:33.736669 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:33.760258 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 36/71] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:06:33.761850 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea929f-c673-44a3-b34c-dc25e2402e47 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:33.762289 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea929f-c673-44a3-b34c-dc25e2402e47 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:33.762740 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea929f-c673-44a3-b34c-dc25e2402e47 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:33.764473 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 37/72] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:33.765466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea929f-c673-44a3-b34c-dc25e2402e47 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:33.815511 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151ffc9-c249-4a3f-9c82-f673af8f3225 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:33.856083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b37b2b-8de0-4a8a-8b4b-184e0cd16413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:33.856505 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b37b2b-8de0-4a8a-8b4b-184e0cd16413 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:33.856798 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b37b2b-8de0-4a8a-8b4b-184e0cd16413 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:33.857076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b37b2b-8de0-4a8a-8b4b-184e0cd16413 None admin] PATH_INFO: `/v3/users/08fcb1f35af24620b53142bf98880fe8` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:33.858368 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b37b2b-8de0-4a8a-8b4b-184e0cd16413 None admin] RBAC: Authorizing `identity:get_user(user_id=08fcb1f35af24620b53142bf98880fe8)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:33.859886 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b37b2b-8de0-4a8a-8b4b-184e0cd16413 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:33.866207 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 36/73] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:06:33 2022] GET /identity/v3/users/08fcb1f35af24620b53142bf98880fe8 => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:33.866207 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f374c4-1d68-41cd-add3-665a0385adf8 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:33.866207 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f374c4-1d68-41cd-add3-665a0385adf8 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:33.866207 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f374c4-1d68-41cd-add3-665a0385adf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:33.880816 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-56f374c4-1d68-41cd-add3-665a0385adf8 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:33.882014 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-56f374c4-1d68-41cd-add3-665a0385adf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:33.892661 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea929f-c673-44a3-b34c-dc25e2402e47 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:33.931565 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d2454-94ef-48f9-9b4e-46d04a019935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:33.932819 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d2454-94ef-48f9-9b4e-46d04a019935 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:33.933283 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d2454-94ef-48f9-9b4e-46d04a019935 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:33.933704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d2454-94ef-48f9-9b4e-46d04a019935 None admin] PATH_INFO: `/v3/users/831d3cfb8ffd4317a4ffe611c92f5d05` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:33.948555 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 37/74] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:06:33.949602 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f374c4-1d68-41cd-add3-665a0385adf8 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:33.952692 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d2454-94ef-48f9-9b4e-46d04a019935 None admin] RBAC: Authorizing `identity:get_user(user_id=831d3cfb8ffd4317a4ffe611c92f5d05)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:33.954185 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d2454-94ef-48f9-9b4e-46d04a019935 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:33.960560 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 38/75] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:06:33 2022] GET /identity/v3/users/831d3cfb8ffd4317a4ffe611c92f5d05 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:33.960560 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d2454-94ef-48f9-9b4e-46d04a019935 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:33.981460 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:34.002080 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:34.053060 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f374c4-1d68-41cd-add3-665a0385adf8 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:34.061593 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d2454-94ef-48f9-9b4e-46d04a019935 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:34.088665 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf3d86e-3cf9-4667-9b9a-0678ceb4d890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:34.089690 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3d86e-3cf9-4667-9b9a-0678ceb4d890 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:34.090014 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3d86e-3cf9-4667-9b9a-0678ceb4d890 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:34.090300 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3d86e-3cf9-4667-9b9a-0678ceb4d890 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:34.095920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f4537-257e-4c67-b355-7b9f22c1b632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:34.096576 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f4537-257e-4c67-b355-7b9f22c1b632 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:34.096860 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f4537-257e-4c67-b355-7b9f22c1b632 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:34.097143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f4537-257e-4c67-b355-7b9f22c1b632 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:34.101700 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf3d86e-3cf9-4667-9b9a-0678ceb4d890 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:06:34.111867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-acf3d86e-3cf9-4667-9b9a-0678ceb4d890 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:06:34.111867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:06:34.111867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:06:34.111867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:06:34.111867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:06:34.111867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:06:34.111867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:06:34.111867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:06:34.111867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:06:34.111867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:06:34.111867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:06:34.111867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:06:34.111867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:06:34.111867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:06:34.111867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:06:34.111867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:06:34.112886 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:06:34.112886 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:06:34.112886 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:06:34.112886 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:06:34.112886 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:06:34.112886 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:06:34.112886 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:06:34.112886 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:06:34.112886 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:06:34.112886 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:06:34.112886 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:06:34.112886 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:06:34.112886 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:06:34.112886 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:06:34.112886 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:06:34.112886 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:06:34.113889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:06:34.113889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:06:34.113889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:06:34.113889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:06:34.113889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:06:34.113889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:06:34.113889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:06:34.113889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:06:34.113889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:06:34.113889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:06:34.113889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:06:34.113889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:06:34.113889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 38/76] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 29 12:06:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:06:34.115048 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbe798-f836-4755-b373-89869d8c9889 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:34.115048 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbe798-f836-4755-b373-89869d8c9889 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:34.115272 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbe798-f836-4755-b373-89869d8c9889 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:34.116729 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 39/77] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:34.117244 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbe798-f836-4755-b373-89869d8c9889 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:34.169181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f4537-257e-4c67-b355-7b9f22c1b632 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:34.170683 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f4537-257e-4c67-b355-7b9f22c1b632 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:34.208266 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:34.210037 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:34.221964 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbe798-f836-4755-b373-89869d8c9889 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:34.254593 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2fd72-cb9a-4e21-9272-6ad4d664ae74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:34.255338 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2fd72-cb9a-4e21-9272-6ad4d664ae74 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:34.255745 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2fd72-cb9a-4e21-9272-6ad4d664ae74 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:34.256165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2fd72-cb9a-4e21-9272-6ad4d664ae74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:34.269676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 39/78] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:06:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:06:34.270590 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f4537-257e-4c67-b355-7b9f22c1b632 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:34.326005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c2fd72-cb9a-4e21-9272-6ad4d664ae74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:34.327591 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c2fd72-cb9a-4e21-9272-6ad4d664ae74 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:34.370526 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f4537-257e-4c67-b355-7b9f22c1b632 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:34.402751 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48bde7-2631-4b06-93b1-f7d720f38b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:34.403540 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48bde7-2631-4b06-93b1-f7d720f38b19 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:34.403826 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48bde7-2631-4b06-93b1-f7d720f38b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:34.404101 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48bde7-2631-4b06-93b1-f7d720f38b19 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:34.411765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:34.415729 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48bde7-2631-4b06-93b1-f7d720f38b19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:06:34.418197 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:34.423786 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-bb48bde7-2631-4b06-93b1-f7d720f38b19 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:06:34.423786 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:06:34.423786 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:06:34.423786 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:06:34.423786 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:06:34.423786 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:06:34.423786 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:06:34.423786 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:06:34.423786 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:06:34.423786 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:06:34.423786 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:06:34.423786 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:06:34.423786 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:06:34.423786 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:06:34.423786 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:06:34.423786 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:06:34.424677 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:06:34.424677 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:06:34.424677 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:06:34.424677 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:06:34.424677 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:06:34.424677 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:06:34.424677 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:06:34.424677 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:06:34.424677 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:06:34.424677 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:06:34.424677 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:06:34.424677 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:06:34.424677 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:06:34.424677 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:06:34.424677 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:06:34.424677 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:06:34.425413 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:06:34.425413 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:06:34.425413 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:06:34.425413 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:06:34.425413 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:06:34.425413 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:06:34.425413 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:06:34.425413 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:06:34.425413 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:06:34.425413 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:06:34.425413 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:06:34.425413 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:06:34.425413 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 40/79] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:06:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:06:34.426043 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48bde7-2631-4b06-93b1-f7d720f38b19 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:34.435871 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 40/80] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:06:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:06:34.437127 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb31246-5a5e-41f6-9aa5-0f1f044a90c7 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:34.437421 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb31246-5a5e-41f6-9aa5-0f1f044a90c7 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:34.437700 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb31246-5a5e-41f6-9aa5-0f1f044a90c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:34.453425 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-adb31246-5a5e-41f6-9aa5-0f1f044a90c7 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:34.454596 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-adb31246-5a5e-41f6-9aa5-0f1f044a90c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:34.523177 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 41/81] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:06:34.524017 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb31246-5a5e-41f6-9aa5-0f1f044a90c7 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:34.539780 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48bde7-2631-4b06-93b1-f7d720f38b19 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:34.577305 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dad2a0-777a-49d4-a6b6-295511406ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:34.577990 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dad2a0-777a-49d4-a6b6-295511406ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:34.578280 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dad2a0-777a-49d4-a6b6-295511406ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:34.578562 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dad2a0-777a-49d4-a6b6-295511406ad7 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:34.579343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dad2a0-777a-49d4-a6b6-295511406ad7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:34.579653 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dad2a0-777a-49d4-a6b6-295511406ad7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:34.581045 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dad2a0-777a-49d4-a6b6-295511406ad7 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:34.589430 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 41/82] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:06:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:34.590251 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dad2a0-777a-49d4-a6b6-295511406ad7 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:34.627250 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb31246-5a5e-41f6-9aa5-0f1f044a90c7 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:34.643627 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:34.648999 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:34.661152 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a726b-2bd7-4360-9d7d-b0d3884b6606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:34.662020 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a726b-2bd7-4360-9d7d-b0d3884b6606 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:34.662304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a726b-2bd7-4360-9d7d-b0d3884b6606 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:34.662582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a726b-2bd7-4360-9d7d-b0d3884b6606 None admin] PATH_INFO: `/v3/projects/db721c414b9e4fec93c61aef1313fdb0` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:34.664040 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a726b-2bd7-4360-9d7d-b0d3884b6606 None admin] RBAC: Authorizing `identity:get_project(project_id=db721c414b9e4fec93c61aef1313fdb0)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:34.666137 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a726b-2bd7-4360-9d7d-b0d3884b6606 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:34.667877 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 42/83] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:06:34 2022] GET /identity/v3/projects/db721c414b9e4fec93c61aef1313fdb0 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:34.668638 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a726b-2bd7-4360-9d7d-b0d3884b6606 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:34.691152 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dad2a0-777a-49d4-a6b6-295511406ad7 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:34.725517 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0da454-31ee-40a4-8d1e-6c2f12b136c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:34.726201 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0da454-31ee-40a4-8d1e-6c2f12b136c2 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:34.726502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0da454-31ee-40a4-8d1e-6c2f12b136c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:34.726800 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0da454-31ee-40a4-8d1e-6c2f12b136c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:34.728171 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0da454-31ee-40a4-8d1e-6c2f12b136c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:34.728487 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0da454-31ee-40a4-8d1e-6c2f12b136c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:34.729886 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0da454-31ee-40a4-8d1e-6c2f12b136c2 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:34.738125 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 42/84] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 29 12:06:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:34.738948 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0da454-31ee-40a4-8d1e-6c2f12b136c2 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:34.775198 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a726b-2bd7-4360-9d7d-b0d3884b6606 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:34.812450 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45724671-8d35-4915-99a8-e02f9ae7dc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:34.813306 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45724671-8d35-4915-99a8-e02f9ae7dc15 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:34.813587 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45724671-8d35-4915-99a8-e02f9ae7dc15 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:34.813862 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45724671-8d35-4915-99a8-e02f9ae7dc15 None admin] PATH_INFO: `/v3/projects/db721c414b9e4fec93c61aef1313fdb0` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:34.815050 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45724671-8d35-4915-99a8-e02f9ae7dc15 None admin] RBAC: Authorizing `identity:get_project(project_id=db721c414b9e4fec93c61aef1313fdb0)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:34.816514 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45724671-8d35-4915-99a8-e02f9ae7dc15 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:34.818215 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 43/85] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:06:34 2022] GET /identity/v3/projects/db721c414b9e4fec93c61aef1313fdb0 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:34.818994 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45724671-8d35-4915-99a8-e02f9ae7dc15 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:34.845584 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0da454-31ee-40a4-8d1e-6c2f12b136c2 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:34.868808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:34.872333 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:34.880998 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d8f7b-764d-476a-910e-b49ef61e5bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:34.881809 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d8f7b-764d-476a-910e-b49ef61e5bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:34.882087 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d8f7b-764d-476a-910e-b49ef61e5bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:34.882364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d8f7b-764d-476a-910e-b49ef61e5bf7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:34.883568 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d8f7b-764d-476a-910e-b49ef61e5bf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:34.885543 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d8f7b-764d-476a-910e-b49ef61e5bf7 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:34.887180 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 43/86] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:06:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:34.887942 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d8f7b-764d-476a-910e-b49ef61e5bf7 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:34.922780 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45724671-8d35-4915-99a8-e02f9ae7dc15 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:34.957436 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd4ccb-65e3-409c-a598-b510baeec9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:34.958239 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd4ccb-65e3-409c-a598-b510baeec9ee None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:34.958527 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd4ccb-65e3-409c-a598-b510baeec9ee None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:34.958836 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd4ccb-65e3-409c-a598-b510baeec9ee None admin] PATH_INFO: `/v3/users/831d3cfb8ffd4317a4ffe611c92f5d05` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:34.960024 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd4ccb-65e3-409c-a598-b510baeec9ee None admin] RBAC: Authorizing `identity:get_user(user_id=831d3cfb8ffd4317a4ffe611c92f5d05)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:34.961495 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd4ccb-65e3-409c-a598-b510baeec9ee None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:34.963874 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 44/87] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:06:34 2022] GET /identity/v3/users/831d3cfb8ffd4317a4ffe611c92f5d05 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:34.964639 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd4ccb-65e3-409c-a598-b510baeec9ee None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:34.992189 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d8f7b-764d-476a-910e-b49ef61e5bf7 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:35.026496 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442eddf-13a1-47fe-9a00-22d9df5ab897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:35.027201 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442eddf-13a1-47fe-9a00-22d9df5ab897 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:35.027495 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442eddf-13a1-47fe-9a00-22d9df5ab897 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:35.027779 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442eddf-13a1-47fe-9a00-22d9df5ab897 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:35.028618 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442eddf-13a1-47fe-9a00-22d9df5ab897 None admin] RBAC: Adding query filter params (role.id=5ef3464f4436446b88430cdf7cc1a3d7, scope.project.id=db721c414b9e4fec93c61aef1313fdb0, user.id=08fcb1f35af24620b53142bf98880fe8) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:35.028942 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442eddf-13a1-47fe-9a00-22d9df5ab897 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:35.030394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442eddf-13a1-47fe-9a00-22d9df5ab897 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:35.039073 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 44/88] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:06:34 2022] GET /identity/v3/role_assignments?user.id=08fcb1f35af24620b53142bf98880fe8&scope.project.id=db721c414b9e4fec93c61aef1313fdb0&role.id=5ef3464f4436446b88430cdf7cc1a3d7 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:35.039892 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442eddf-13a1-47fe-9a00-22d9df5ab897 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:35.088012 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd4ccb-65e3-409c-a598-b510baeec9ee None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:35.107774 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:35.115459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:35.132168 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08cbc9-5ad1-411c-9e14-10c20872b95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:35.133081 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08cbc9-5ad1-411c-9e14-10c20872b95c None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:35.133365 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08cbc9-5ad1-411c-9e14-10c20872b95c None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:35.134178 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08cbc9-5ad1-411c-9e14-10c20872b95c None admin] PATH_INFO: `/v3/users/831d3cfb8ffd4317a4ffe611c92f5d05` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:35.136737 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08cbc9-5ad1-411c-9e14-10c20872b95c None admin] RBAC: Authorizing `identity:get_user(user_id=831d3cfb8ffd4317a4ffe611c92f5d05)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:35.138230 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08cbc9-5ad1-411c-9e14-10c20872b95c None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:35.140295 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 45/89] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:06:34 2022] GET /identity/v3/users/831d3cfb8ffd4317a4ffe611c92f5d05 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:35.141092 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08cbc9-5ad1-411c-9e14-10c20872b95c None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:35.172918 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442eddf-13a1-47fe-9a00-22d9df5ab897 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:35.211041 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed13e0-7829-40d6-9e62-439ecc5c07b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:35.211636 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed13e0-7829-40d6-9e62-439ecc5c07b1 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:35.212491 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed13e0-7829-40d6-9e62-439ecc5c07b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:35.212777 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed13e0-7829-40d6-9e62-439ecc5c07b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:35.213616 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed13e0-7829-40d6-9e62-439ecc5c07b1 None admin] RBAC: Adding query filter params (role.id=419e204ede334962ac80ce56c398bd4f, scope.project.id=db721c414b9e4fec93c61aef1313fdb0, user.id=831d3cfb8ffd4317a4ffe611c92f5d05) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:35.213941 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed13e0-7829-40d6-9e62-439ecc5c07b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:35.215435 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed13e0-7829-40d6-9e62-439ecc5c07b1 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:35.221694 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 45/90] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:06:35 2022] GET /identity/v3/role_assignments?user.id=831d3cfb8ffd4317a4ffe611c92f5d05&scope.project.id=db721c414b9e4fec93c61aef1313fdb0&role.id=419e204ede334962ac80ce56c398bd4f => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:35.222494 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed13e0-7829-40d6-9e62-439ecc5c07b1 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:35.284125 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08cbc9-5ad1-411c-9e14-10c20872b95c None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:35.334833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1b2e0-de29-4f41-ac3d-ff086e9804c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:35.336127 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1b2e0-de29-4f41-ac3d-ff086e9804c5 None admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:35.336599 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1b2e0-de29-4f41-ac3d-ff086e9804c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:35.337120 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1b2e0-de29-4f41-ac3d-ff086e9804c5 None admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:35.338796 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1b2e0-de29-4f41-ac3d-ff086e9804c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:35.340354 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1b2e0-de29-4f41-ac3d-ff086e9804c5 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:35.364704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed13e0-7829-40d6-9e62-439ecc5c07b1 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:35.370884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 46/91] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 29 12:06:35 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:06:35.372090 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1b2e0-de29-4f41-ac3d-ff086e9804c5 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:35.394135 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:35.416268 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf0ccc-f3e5-45da-be13-c129fb60b8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:35.417420 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf0ccc-f3e5-45da-be13-c129fb60b8bc None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:35.418014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf0ccc-f3e5-45da-be13-c129fb60b8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:35.418503 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf0ccc-f3e5-45da-be13-c129fb60b8bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:35.437988 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:35.509494 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf0ccc-f3e5-45da-be13-c129fb60b8bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:35.511224 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf0ccc-f3e5-45da-be13-c129fb60b8bc None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:35.518255 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1b2e0-de29-4f41-ac3d-ff086e9804c5 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:35.567892 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447c3b1-a506-4d8d-86c3-65e387811971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:35.569112 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447c3b1-a506-4d8d-86c3-65e387811971 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:35.569860 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447c3b1-a506-4d8d-86c3-65e387811971 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:35.570534 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447c3b1-a506-4d8d-86c3-65e387811971 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:35.632226 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 46/92] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:06:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:06:35.638654 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf0ccc-f3e5-45da-be13-c129fb60b8bc None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:35.662106 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:35.662666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447c3b1-a506-4d8d-86c3-65e387811971 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:35.665816 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447c3b1-a506-4d8d-86c3-65e387811971 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:35.726167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:35.762716 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf0ccc-f3e5-45da-be13-c129fb60b8bc None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:35.806862 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 47/93] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:06:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:06:35.815351 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447c3b1-a506-4d8d-86c3-65e387811971 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:35.824677 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd0db4-e66e-4011-b7ab-fc3b569cbf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:35.826310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd0db4-e66e-4011-b7ab-fc3b569cbf83 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:35.826846 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd0db4-e66e-4011-b7ab-fc3b569cbf83 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:35.827737 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd0db4-e66e-4011-b7ab-fc3b569cbf83 None admin] PATH_INFO: `/v3/projects/db721c414b9e4fec93c61aef1313fdb0` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:35.829475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd0db4-e66e-4011-b7ab-fc3b569cbf83 None admin] RBAC: Authorizing `identity:get_project(project_id=db721c414b9e4fec93c61aef1313fdb0)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:35.831460 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd0db4-e66e-4011-b7ab-fc3b569cbf83 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:35.834706 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 47/94] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:06:35 2022] GET /identity/v3/projects/db721c414b9e4fec93c61aef1313fdb0 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:06:35.841555 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd0db4-e66e-4011-b7ab-fc3b569cbf83 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:35.944765 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447c3b1-a506-4d8d-86c3-65e387811971 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:35.958913 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:35.980223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd0db4-e66e-4011-b7ab-fc3b569cbf83 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:35.992459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054d046-0ac8-45f7-a4e1-72db1bcc3cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:35.993879 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054d046-0ac8-45f7-a4e1-72db1bcc3cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:35.994163 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054d046-0ac8-45f7-a4e1-72db1bcc3cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:35.994440 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054d046-0ac8-45f7-a4e1-72db1bcc3cf4 None admin] PATH_INFO: `/v3/projects/577641f1bb5f410d87f34ac3efcb13f2` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:35.998510 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054d046-0ac8-45f7-a4e1-72db1bcc3cf4 None admin] RBAC: Authorizing `identity:get_project(project_id=577641f1bb5f410d87f34ac3efcb13f2)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:36.000036 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054d046-0ac8-45f7-a4e1-72db1bcc3cf4 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:36.001961 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 48/95] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:06:35 2022] GET /identity/v3/projects/577641f1bb5f410d87f34ac3efcb13f2 => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:36.008078 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054d046-0ac8-45f7-a4e1-72db1bcc3cf4 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:36.026366 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:36.033761 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea2e93-9130-4cc1-985a-662b45249b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:36.034779 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea2e93-9130-4cc1-985a-662b45249b57 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:36.035269 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea2e93-9130-4cc1-985a-662b45249b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:36.035744 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea2e93-9130-4cc1-985a-662b45249b57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:36.037538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea2e93-9130-4cc1-985a-662b45249b57 None admin] RBAC: Adding query filter params (role.id=b0982ad59fae4158ba9249550f6452cd, scope.project.id=db721c414b9e4fec93c61aef1313fdb0, user.id=831d3cfb8ffd4317a4ffe611c92f5d05) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:36.038064 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea2e93-9130-4cc1-985a-662b45249b57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:36.041025 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea2e93-9130-4cc1-985a-662b45249b57 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:36.047728 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 48/96] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:06:35 2022] GET /identity/v3/role_assignments?user.id=831d3cfb8ffd4317a4ffe611c92f5d05&scope.project.id=db721c414b9e4fec93c61aef1313fdb0&role.id=b0982ad59fae4158ba9249550f6452cd => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:36.139324 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054d046-0ac8-45f7-a4e1-72db1bcc3cf4 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:36.183127 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6661da-ecc5-4a45-982a-86b011d869a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:36.183818 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6661da-ecc5-4a45-982a-86b011d869a5 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:36.184110 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6661da-ecc5-4a45-982a-86b011d869a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:36.184397 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6661da-ecc5-4a45-982a-86b011d869a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:36.185241 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6661da-ecc5-4a45-982a-86b011d869a5 None admin] RBAC: Adding query filter params (role.id=419e204ede334962ac80ce56c398bd4f, scope.project.id=577641f1bb5f410d87f34ac3efcb13f2, user.id=831d3cfb8ffd4317a4ffe611c92f5d05) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:36.185555 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6661da-ecc5-4a45-982a-86b011d869a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:36.187098 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6661da-ecc5-4a45-982a-86b011d869a5 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:36.193931 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 49/97] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:06:36 2022] GET /identity/v3/role_assignments?user.id=831d3cfb8ffd4317a4ffe611c92f5d05&scope.project.id=577641f1bb5f410d87f34ac3efcb13f2&role.id=419e204ede334962ac80ce56c398bd4f => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:37.577399 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e45ad0-5a04-4fae-8f4c-b6086b281b07 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:37.577919 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e45ad0-5a04-4fae-8f4c-b6086b281b07 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:37.577991 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e45ad0-5a04-4fae-8f4c-b6086b281b07 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:37.579635 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 49/98] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:37.592358 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774952c-4abb-432f-8502-8ceeef8b7957 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:37.592837 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774952c-4abb-432f-8502-8ceeef8b7957 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:37.592912 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774952c-4abb-432f-8502-8ceeef8b7957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:37.615625 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-b774952c-4abb-432f-8502-8ceeef8b7957 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:37.617053 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-b774952c-4abb-432f-8502-8ceeef8b7957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:37.702202 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 50/99] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:06:37.737798 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e45ad0-5a04-4fae-8f4c-b6086b281b07 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:37.878408 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e45ad0-5a04-4fae-8f4c-b6086b281b07 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:37.936897 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486eb95f-f0c9-4817-8834-b6f3a8f5f714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:37.937702 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486eb95f-f0c9-4817-8834-b6f3a8f5f714 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:37.937988 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486eb95f-f0c9-4817-8834-b6f3a8f5f714 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:37.938267 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486eb95f-f0c9-4817-8834-b6f3a8f5f714 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:37.957000 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486eb95f-f0c9-4817-8834-b6f3a8f5f714 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:06:37.965410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-486eb95f-f0c9-4817-8834-b6f3a8f5f714 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:06:37.965410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:06:37.965410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:06:37.965410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:06:37.965410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:06:37.965410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:06:37.965410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:06:37.965410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:06:37.965410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:06:37.965410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:06:37.965410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:06:37.965410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:06:37.965410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:06:37.965410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:06:37.965410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:06:37.965410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:06:37.966264 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:06:37.966264 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:06:37.966264 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:06:37.966264 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:06:37.966264 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:06:37.966264 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:06:37.966264 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:06:37.966264 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:06:37.966264 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:06:37.966264 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:06:37.966264 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:06:37.966264 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:06:37.966264 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:06:37.966264 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:06:37.966264 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:06:37.966264 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:06:37.967106 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:06:37.967106 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:06:37.967106 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:06:37.967106 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:06:37.967106 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:06:37.967106 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:06:37.967106 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:06:37.967106 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:06:37.967106 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:06:37.967106 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:06:37.967106 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:06:37.967106 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:06:37.967106 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 50/100] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:06:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:06:37.975764 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774952c-4abb-432f-8502-8ceeef8b7957 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:37.993109 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:38.114874 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774952c-4abb-432f-8502-8ceeef8b7957 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:38.161996 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e7a5d-7992-490c-be79-1e9d5d644f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:38.162600 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e7a5d-7992-490c-be79-1e9d5d644f09 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:38.162927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e7a5d-7992-490c-be79-1e9d5d644f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:38.163480 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e7a5d-7992-490c-be79-1e9d5d644f09 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:38.164233 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e7a5d-7992-490c-be79-1e9d5d644f09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:38.164545 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e7a5d-7992-490c-be79-1e9d5d644f09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:38.165999 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e7a5d-7992-490c-be79-1e9d5d644f09 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:38.184053 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 51/101] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:06:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:38.189719 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486eb95f-f0c9-4817-8834-b6f3a8f5f714 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:38.208817 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:38.248197 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c35d66-6666-4259-9073-39d1125365cf None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:38.248504 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c35d66-6666-4259-9073-39d1125365cf None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:38.248766 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c35d66-6666-4259-9073-39d1125365cf None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:38.250163 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 52/102] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:38.255776 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833ed81-72c0-405f-98f2-33c8c197b021 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:38.256066 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833ed81-72c0-405f-98f2-33c8c197b021 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:38.256348 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833ed81-72c0-405f-98f2-33c8c197b021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:38.280153 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-c833ed81-72c0-405f-98f2-33c8c197b021 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:38.281411 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-c833ed81-72c0-405f-98f2-33c8c197b021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:38.314310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486eb95f-f0c9-4817-8834-b6f3a8f5f714 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:38.354405 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1fad45-3ae9-4ba6-8a54-8b3d420ba60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:38.355423 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fad45-3ae9-4ba6-8a54-8b3d420ba60b None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:38.355714 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fad45-3ae9-4ba6-8a54-8b3d420ba60b None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:38.356001 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fad45-3ae9-4ba6-8a54-8b3d420ba60b None admin] PATH_INFO: `/v3/users/08fcb1f35af24620b53142bf98880fe8` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:38.357238 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1fad45-3ae9-4ba6-8a54-8b3d420ba60b None admin] RBAC: Authorizing `identity:get_user(user_id=08fcb1f35af24620b53142bf98880fe8)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:38.358759 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1fad45-3ae9-4ba6-8a54-8b3d420ba60b None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:38.360410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 51/103] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:06:38 2022] GET /identity/v3/users/08fcb1f35af24620b53142bf98880fe8 => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:38.365853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1fad45-3ae9-4ba6-8a54-8b3d420ba60b None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:38.401073 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:38.411648 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 53/104] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:06:38.468281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:38.498930 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1fad45-3ae9-4ba6-8a54-8b3d420ba60b None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:38.499620 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833ed81-72c0-405f-98f2-33c8c197b021 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:38.537275 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20b344-977d-406d-bd72-4a14d70faa49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:38.538417 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20b344-977d-406d-bd72-4a14d70faa49 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:38.538733 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20b344-977d-406d-bd72-4a14d70faa49 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:38.539015 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20b344-977d-406d-bd72-4a14d70faa49 None admin] PATH_INFO: `/v3/projects/db721c414b9e4fec93c61aef1313fdb0` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:38.540369 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20b344-977d-406d-bd72-4a14d70faa49 None admin] RBAC: Authorizing `identity:get_project(project_id=db721c414b9e4fec93c61aef1313fdb0)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:38.541960 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20b344-977d-406d-bd72-4a14d70faa49 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:38.543864 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 52/105] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:06:38 2022] GET /identity/v3/projects/db721c414b9e4fec93c61aef1313fdb0 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:38.549719 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20b344-977d-406d-bd72-4a14d70faa49 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:38.698147 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20b344-977d-406d-bd72-4a14d70faa49 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:38.730016 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833ed81-72c0-405f-98f2-33c8c197b021 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:38.767919 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed14706-d5ce-4a88-be60-8648339a56e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:38.768821 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed14706-d5ce-4a88-be60-8648339a56e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:38.769112 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed14706-d5ce-4a88-be60-8648339a56e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:38.769397 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed14706-d5ce-4a88-be60-8648339a56e9 None admin] PATH_INFO: `/v3/projects/db721c414b9e4fec93c61aef1313fdb0/users/08fcb1f35af24620b53142bf98880fe8/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:38.774991 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed14706-d5ce-4a88-be60-8648339a56e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=db721c414b9e4fec93c61aef1313fdb0, user_id=08fcb1f35af24620b53142bf98880fe8, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:38.776485 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed14706-d5ce-4a88-be60-8648339a56e9 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:38.802790 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 53/106] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 29 12:06:38 2022] PUT /identity/v3/projects/db721c414b9e4fec93c61aef1313fdb0/users/08fcb1f35af24620b53142bf98880fe8/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:06:38.803978 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f17b3-1dee-4861-812d-d2134653b93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:38.804925 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f17b3-1dee-4861-812d-d2134653b93d None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:38.805216 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f17b3-1dee-4861-812d-d2134653b93d None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:38.806059 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f17b3-1dee-4861-812d-d2134653b93d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:38.826277 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f17b3-1dee-4861-812d-d2134653b93d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:06:38.835183 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423deedb-277c-4341-85d7-440ef5ea3de7 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:38.835468 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423deedb-277c-4341-85d7-440ef5ea3de7 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:38.835758 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423deedb-277c-4341-85d7-440ef5ea3de7 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:38.837522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 54/107] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:06:38.838118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-b35f17b3-1dee-4861-812d-d2134653b93d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:06:38.838118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:06:38.838118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:06:38.838118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:06:38.838118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:06:38.838118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:06:38.838118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:06:38.838118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:06:38.838118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:06:38.838118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:06:38.838118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:06:38.838118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:06:38.838118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:06:38.838118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:06:38.838118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:06:38.838118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:06:38.838991 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:06:38.838991 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:06:38.838991 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:06:38.838991 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:06:38.838991 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:06:38.838991 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:06:38.838991 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:06:38.838991 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:06:38.838991 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:06:38.838991 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:06:38.838991 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:06:38.838991 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:06:38.838991 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:06:38.838991 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:06:38.838991 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:06:38.838991 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:06:38.839736 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:06:38.839736 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:06:38.839736 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:06:38.839736 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:06:38.839736 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:06:38.839736 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:06:38.839736 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:06:38.839736 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:06:38.839736 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:06:38.839736 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:06:38.839736 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:06:38.839736 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:06:38.839736 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 54/108] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:06:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:06:38.843151 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09504b-9216-4136-bbb1-48d4d9ce825f None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:38.843533 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09504b-9216-4136-bbb1-48d4d9ce825f None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:38.843865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09504b-9216-4136-bbb1-48d4d9ce825f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:38.849187 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f17b3-1dee-4861-812d-d2134653b93d None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:38.873833 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-dd09504b-9216-4136-bbb1-48d4d9ce825f None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:38.875094 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-dd09504b-9216-4136-bbb1-48d4d9ce825f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:38.879421 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:38.979337 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:39.028052 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 55/109] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:06:39.045361 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f17b3-1dee-4861-812d-d2134653b93d None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:39.059939 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09504b-9216-4136-bbb1-48d4d9ce825f None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:39.091451 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83cede-ec62-42f3-b007-2b52d1f7fcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:39.092143 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83cede-ec62-42f3-b007-2b52d1f7fcf8 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:39.092433 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83cede-ec62-42f3-b007-2b52d1f7fcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:39.092715 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83cede-ec62-42f3-b007-2b52d1f7fcf8 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:39.093642 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83cede-ec62-42f3-b007-2b52d1f7fcf8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:39.094297 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83cede-ec62-42f3-b007-2b52d1f7fcf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:39.096183 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83cede-ec62-42f3-b007-2b52d1f7fcf8 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:39.108295 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 55/110] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 29 12:06:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:39.109521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c27838-111f-4e92-a349-cdac511af84e None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:39.109821 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c27838-111f-4e92-a349-cdac511af84e None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:39.110104 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c27838-111f-4e92-a349-cdac511af84e None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:39.112063 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 56/111] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:39.116175 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c27838-111f-4e92-a349-cdac511af84e None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:39.191867 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09504b-9216-4136-bbb1-48d4d9ce825f None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:39.236897 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c27838-111f-4e92-a349-cdac511af84e None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:39.241788 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f5ce1-3662-4337-9006-04101a6800da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:39.242822 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f5ce1-3662-4337-9006-04101a6800da None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:39.243126 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f5ce1-3662-4337-9006-04101a6800da None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:39.243411 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f5ce1-3662-4337-9006-04101a6800da None admin] PATH_INFO: `/v3/domains/default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:39.244739 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f5ce1-3662-4337-9006-04101a6800da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:39.247234 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f5ce1-3662-4337-9006-04101a6800da None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:39.249061 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 56/112] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:06:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:06:39.255716 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4634d64-bb77-41b3-874f-0f31df278021 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:39.256045 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4634d64-bb77-41b3-874f-0f31df278021 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:39.256568 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4634d64-bb77-41b3-874f-0f31df278021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:39.268625 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:39.270013 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:39.279631 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-b4634d64-bb77-41b3-874f-0f31df278021 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:39.281547 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-b4634d64-bb77-41b3-874f-0f31df278021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:39.284456 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83baf5f1-3351-4929-abfc-242f664d4e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:39.285610 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baf5f1-3351-4929-abfc-242f664d4e84 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:39.286114 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baf5f1-3351-4929-abfc-242f664d4e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:39.286614 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baf5f1-3351-4929-abfc-242f664d4e84 None admin] PATH_INFO: `/v3/users/831d3cfb8ffd4317a4ffe611c92f5d05` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:39.288419 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83baf5f1-3351-4929-abfc-242f664d4e84 None admin] RBAC: Authorizing `identity:get_user(user_id=831d3cfb8ffd4317a4ffe611c92f5d05)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:39.290870 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83baf5f1-3351-4929-abfc-242f664d4e84 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:39.297355 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 57/113] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:06:39 2022] GET /identity/v3/users/831d3cfb8ffd4317a4ffe611c92f5d05 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:06:39.299037 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea53c7-72e9-4b88-b2c4-3d04449d696b None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:39.299586 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea53c7-72e9-4b88-b2c4-3d04449d696b None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:39.300149 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea53c7-72e9-4b88-b2c4-3d04449d696b None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:39.301905 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 58/114] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:39.302884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea53c7-72e9-4b88-b2c4-3d04449d696b None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:39.365161 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 57/115] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:06:39.366714 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4634d64-bb77-41b3-874f-0f31df278021 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:39.440003 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea53c7-72e9-4b88-b2c4-3d04449d696b None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:39.478604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b551deb-153a-4738-8425-c0594c9b7ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:39.479377 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b551deb-153a-4738-8425-c0594c9b7ae8 None admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:39.479677 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b551deb-153a-4738-8425-c0594c9b7ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:39.479959 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b551deb-153a-4738-8425-c0594c9b7ae8 None admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:39.480680 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b551deb-153a-4738-8425-c0594c9b7ae8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:39.482196 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b551deb-153a-4738-8425-c0594c9b7ae8 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:39.482361 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4634d64-bb77-41b3-874f-0f31df278021 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:39.511189 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 59/116] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Jun 29 12:06:39 2022] POST /identity/v3/projects => generated 302 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:06:39.513096 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31d714-6566-419a-96a4-49cf6ddc4130 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:39.513476 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31d714-6566-419a-96a4-49cf6ddc4130 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:39.513834 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31d714-6566-419a-96a4-49cf6ddc4130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:39.536326 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-3d31d714-6566-419a-96a4-49cf6ddc4130 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:39.537817 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-3d31d714-6566-419a-96a4-49cf6ddc4130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:39.539594 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b476e-306f-4a99-b298-e66d513cdd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:39.540923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b476e-306f-4a99-b298-e66d513cdd60 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:39.541416 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b476e-306f-4a99-b298-e66d513cdd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:39.541925 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b476e-306f-4a99-b298-e66d513cdd60 None admin] PATH_INFO: `/v3/projects/db721c414b9e4fec93c61aef1313fdb0` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:39.547620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b476e-306f-4a99-b298-e66d513cdd60 None admin] RBAC: Authorizing `identity:get_project(project_id=db721c414b9e4fec93c61aef1313fdb0)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:39.549680 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b476e-306f-4a99-b298-e66d513cdd60 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:39.552296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 58/117] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:06:39 2022] GET /identity/v3/projects/db721c414b9e4fec93c61aef1313fdb0 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:39.553442 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b476e-306f-4a99-b298-e66d513cdd60 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:39.568062 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:39.592040 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:39.636452 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 60/118] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:06:39.642666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31d714-6566-419a-96a4-49cf6ddc4130 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:39.718712 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b476e-306f-4a99-b298-e66d513cdd60 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:39.778356 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e9ded-a043-4891-9ac8-5bf3e3525a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:39.780126 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e9ded-a043-4891-9ac8-5bf3e3525a6c None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:39.780126 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e9ded-a043-4891-9ac8-5bf3e3525a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:39.780126 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e9ded-a043-4891-9ac8-5bf3e3525a6c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:39.791503 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31d714-6566-419a-96a4-49cf6ddc4130 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:39.795612 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e9ded-a043-4891-9ac8-5bf3e3525a6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:06:39.803321 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-e83e9ded-a043-4891-9ac8-5bf3e3525a6c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:06:39.803321 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:06:39.803321 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:06:39.803321 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:06:39.803321 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:06:39.803321 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:06:39.803321 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:06:39.803321 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:06:39.803321 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:06:39.803321 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:06:39.803321 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:06:39.803321 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:06:39.803321 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:06:39.803321 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:06:39.803321 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:06:39.803321 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:06:39.804353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:06:39.804353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:06:39.804353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:06:39.804353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:06:39.804353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:06:39.804353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:06:39.804353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:06:39.804353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:06:39.804353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:06:39.804353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:06:39.804353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:06:39.804353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:06:39.804353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:06:39.804353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:06:39.804353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:06:39.804353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:06:39.806007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:06:39.806007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:06:39.806007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:06:39.806007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:06:39.806007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:06:39.806007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:06:39.806007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:06:39.806007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:06:39.806007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:06:39.806007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:06:39.806007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:06:39.806007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:06:39.806007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 59/119] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:06:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:06:39.806908 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd3152-fbda-40aa-9f7d-4de90e21603e None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:39.806908 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd3152-fbda-40aa-9f7d-4de90e21603e None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:39.807070 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd3152-fbda-40aa-9f7d-4de90e21603e None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:39.808380 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 60/120] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:39.809076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd3152-fbda-40aa-9f7d-4de90e21603e None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:39.836935 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afda44-2056-4df3-91f8-00d568f6634f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:39.838395 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afda44-2056-4df3-91f8-00d568f6634f None admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:39.839153 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afda44-2056-4df3-91f8-00d568f6634f None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:39.839676 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afda44-2056-4df3-91f8-00d568f6634f None admin] PATH_INFO: `/v3/projects/db721c414b9e4fec93c61aef1313fdb0/users/831d3cfb8ffd4317a4ffe611c92f5d05/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:39.842860 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afda44-2056-4df3-91f8-00d568f6634f None admin] RBAC: Authorizing `identity:create_grant(project_id=db721c414b9e4fec93c61aef1313fdb0, user_id=831d3cfb8ffd4317a4ffe611c92f5d05, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:39.845258 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afda44-2056-4df3-91f8-00d568f6634f None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:39.865022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 61/121] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 29 12:06:39 2022] PUT /identity/v3/projects/db721c414b9e4fec93c61aef1313fdb0/users/831d3cfb8ffd4317a4ffe611c92f5d05/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:06:39.865624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afda44-2056-4df3-91f8-00d568f6634f None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:39.901101 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:39.947044 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:39.967039 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd3152-fbda-40aa-9f7d-4de90e21603e None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:40.034587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be1d86-07d6-4c87-80cd-1f645b39f976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:40.035450 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be1d86-07d6-4c87-80cd-1f645b39f976 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:40.035717 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be1d86-07d6-4c87-80cd-1f645b39f976 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:40.035992 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be1d86-07d6-4c87-80cd-1f645b39f976 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:40.067474 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be1d86-07d6-4c87-80cd-1f645b39f976 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:06:40.076172 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-00be1d86-07d6-4c87-80cd-1f645b39f976 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:06:40.076172 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:06:40.076172 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:06:40.076172 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:06:40.076172 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:06:40.076172 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:06:40.076172 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:06:40.076172 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:06:40.076172 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:06:40.076172 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:06:40.076172 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:06:40.076172 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:06:40.076172 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:06:40.076172 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:06:40.076172 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:06:40.076172 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:06:40.077033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:06:40.077033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:06:40.077033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:06:40.077033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:06:40.077033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:06:40.077033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:06:40.077033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:06:40.077033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:06:40.077033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:06:40.077033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:06:40.077033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:06:40.077033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:06:40.077033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:06:40.077033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:06:40.077033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:06:40.077033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:06:40.082968 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:06:40.082968 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:06:40.082968 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:06:40.082968 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:06:40.082968 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:06:40.082968 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:06:40.082968 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:06:40.082968 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:06:40.082968 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:06:40.082968 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:06:40.082968 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:06:40.082968 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:06:40.082968 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 61/122] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 29 12:06:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:06:40.084957 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afda44-2056-4df3-91f8-00d568f6634f None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:40.086770 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783080b5-5c0a-4138-9b97-c0b15407c1ab None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:40.087144 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783080b5-5c0a-4138-9b97-c0b15407c1ab None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:40.087501 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783080b5-5c0a-4138-9b97-c0b15407c1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:40.106075 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-783080b5-5c0a-4138-9b97-c0b15407c1ab None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:40.107743 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-783080b5-5c0a-4138-9b97-c0b15407c1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:40.134864 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee95dce-139e-4606-8ad5-666debd9b784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:40.135911 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee95dce-139e-4606-8ad5-666debd9b784 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:40.136416 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee95dce-139e-4606-8ad5-666debd9b784 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:40.137464 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee95dce-139e-4606-8ad5-666debd9b784 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:40.140843 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee95dce-139e-4606-8ad5-666debd9b784 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:40.141393 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee95dce-139e-4606-8ad5-666debd9b784 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:40.143765 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee95dce-139e-4606-8ad5-666debd9b784 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:40.155451 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 62/123] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 29 12:06:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:40.156308 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee95dce-139e-4606-8ad5-666debd9b784 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:40.197099 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 62/124] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:06:40.198408 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783080b5-5c0a-4138-9b97-c0b15407c1ab None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:40.261928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:40.274990 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:40.292355 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee95dce-139e-4606-8ad5-666debd9b784 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:40.336180 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783080b5-5c0a-4138-9b97-c0b15407c1ab None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:40.362411 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd81e9-7270-4327-bee6-bdc188aca897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:40.363987 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd81e9-7270-4327-bee6-bdc188aca897 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:40.366088 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd81e9-7270-4327-bee6-bdc188aca897 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:40.366626 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd81e9-7270-4327-bee6-bdc188aca897 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:40.368453 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd81e9-7270-4327-bee6-bdc188aca897 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:40.370695 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd81e9-7270-4327-bee6-bdc188aca897 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:40.373148 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd81e9-7270-4327-bee6-bdc188aca897 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:40.390291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 63/125] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:06:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:40.395023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd81e9-7270-4327-bee6-bdc188aca897 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:40.407876 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846285ce-06d5-4647-ab04-990bf2e30953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:40.409138 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846285ce-06d5-4647-ab04-990bf2e30953 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:40.410867 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846285ce-06d5-4647-ab04-990bf2e30953 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:40.411375 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846285ce-06d5-4647-ab04-990bf2e30953 None admin] PATH_INFO: `/v3/users/b5b142915920428c862f375473e6c52e` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:40.440851 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846285ce-06d5-4647-ab04-990bf2e30953 None admin] RBAC: Authorizing `identity:get_user(user_id=b5b142915920428c862f375473e6c52e)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:40.442709 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846285ce-06d5-4647-ab04-990bf2e30953 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:40.445685 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 63/126] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:06:40 2022] GET /identity/v3/users/b5b142915920428c862f375473e6c52e => generated 289 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:40.448271 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846285ce-06d5-4647-ab04-990bf2e30953 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:40.594213 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846285ce-06d5-4647-ab04-990bf2e30953 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:40.610962 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:40.628853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd81e9-7270-4327-bee6-bdc188aca897 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:40.636507 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61200c91-48f8-4826-b0b8-a0b1813c7f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:40.637686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61200c91-48f8-4826-b0b8-a0b1813c7f3a None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:40.638173 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61200c91-48f8-4826-b0b8-a0b1813c7f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:40.638690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61200c91-48f8-4826-b0b8-a0b1813c7f3a None admin] PATH_INFO: `/v3/users/831d3cfb8ffd4317a4ffe611c92f5d05` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:40.640149 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61200c91-48f8-4826-b0b8-a0b1813c7f3a None admin] RBAC: Authorizing `identity:get_user(user_id=831d3cfb8ffd4317a4ffe611c92f5d05)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:40.641830 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61200c91-48f8-4826-b0b8-a0b1813c7f3a None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:40.643745 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 64/127] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:06:40 2022] GET /identity/v3/users/831d3cfb8ffd4317a4ffe611c92f5d05 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:40.644833 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61200c91-48f8-4826-b0b8-a0b1813c7f3a None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:40.706776 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d830ea8-fcc6-4b6c-963c-4fd04868cd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:40.707590 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d830ea8-fcc6-4b6c-963c-4fd04868cd93 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:40.707874 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d830ea8-fcc6-4b6c-963c-4fd04868cd93 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:40.708150 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d830ea8-fcc6-4b6c-963c-4fd04868cd93 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:40.725053 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d830ea8-fcc6-4b6c-963c-4fd04868cd93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:06:40.733530 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-7d830ea8-fcc6-4b6c-963c-4fd04868cd93 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:06:40.733530 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:06:40.733530 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:06:40.733530 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:06:40.733530 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:06:40.733530 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:06:40.733530 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:06:40.733530 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:06:40.733530 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:06:40.733530 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:06:40.733530 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:06:40.733530 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:06:40.733530 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:06:40.733530 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:06:40.733530 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:06:40.733530 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:06:40.734394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:06:40.734394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:06:40.734394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:06:40.734394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:06:40.734394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:06:40.734394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:06:40.734394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:06:40.734394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:06:40.734394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:06:40.734394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:06:40.734394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:06:40.734394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:06:40.734394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:06:40.734394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:06:40.734394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:06:40.734394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:06:40.735241 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:06:40.735241 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:06:40.735241 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:06:40.735241 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:06:40.735241 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:06:40.735241 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:06:40.735241 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:06:40.735241 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:06:40.735241 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:06:40.735241 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:06:40.735241 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:06:40.735241 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:06:40.742217 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 64/128] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:06:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:06:40.747082 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d830ea8-fcc6-4b6c-963c-4fd04868cd93 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:40.785394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:40.829191 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61200c91-48f8-4826-b0b8-a0b1813c7f3a None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:40.894282 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33175e-ae5f-4ed7-82fb-c855c14469b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:40.894884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33175e-ae5f-4ed7-82fb-c855c14469b4 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:40.895174 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33175e-ae5f-4ed7-82fb-c855c14469b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:40.895451 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33175e-ae5f-4ed7-82fb-c855c14469b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:40.929185 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d830ea8-fcc6-4b6c-963c-4fd04868cd93 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:40.983001 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:40.992385 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c507b5-af21-4048-9f94-1c1679def5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:40.993286 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c507b5-af21-4048-9f94-1c1679def5f3 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:40.993575 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c507b5-af21-4048-9f94-1c1679def5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:40.993857 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c507b5-af21-4048-9f94-1c1679def5f3 None admin] PATH_INFO: `/v3/projects/db721c414b9e4fec93c61aef1313fdb0` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:40.996073 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c507b5-af21-4048-9f94-1c1679def5f3 None admin] RBAC: Authorizing `identity:get_project(project_id=db721c414b9e4fec93c61aef1313fdb0)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:40.997542 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c507b5-af21-4048-9f94-1c1679def5f3 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:40.999276 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 65/129] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:06:40 2022] GET /identity/v3/projects/db721c414b9e4fec93c61aef1313fdb0 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:41.000036 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c507b5-af21-4048-9f94-1c1679def5f3 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:41.015240 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd33175e-ae5f-4ed7-82fb-c855c14469b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:41.016744 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd33175e-ae5f-4ed7-82fb-c855c14469b4 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:41.159085 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:41.177821 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c507b5-af21-4048-9f94-1c1679def5f3 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:41.189456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 65/130] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:06:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:06:41.190307 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33175e-ae5f-4ed7-82fb-c855c14469b4 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:41.246701 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0109836-eb9c-4e4c-8d3f-6329a433ec6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:41.247386 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0109836-eb9c-4e4c-8d3f-6329a433ec6e None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:41.247674 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0109836-eb9c-4e4c-8d3f-6329a433ec6e None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:41.247955 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0109836-eb9c-4e4c-8d3f-6329a433ec6e None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:41.248709 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0109836-eb9c-4e4c-8d3f-6329a433ec6e None admin] RBAC: Adding query filter params (name=member) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:41.249019 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0109836-eb9c-4e4c-8d3f-6329a433ec6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:41.250429 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0109836-eb9c-4e4c-8d3f-6329a433ec6e None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:41.268186 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 66/131] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 29 12:06:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:41.269049 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0109836-eb9c-4e4c-8d3f-6329a433ec6e None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:41.324484 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:41.348416 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33175e-ae5f-4ed7-82fb-c855c14469b4 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:41.394998 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d524deb-7b6c-4626-882b-07a12f64e1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:41.396441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d524deb-7b6c-4626-882b-07a12f64e1ec None admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:41.397112 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d524deb-7b6c-4626-882b-07a12f64e1ec None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:41.397565 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d524deb-7b6c-4626-882b-07a12f64e1ec None admin] PATH_INFO: `/v3/projects/db721c414b9e4fec93c61aef1313fdb0/users/831d3cfb8ffd4317a4ffe611c92f5d05/roles/b0982ad59fae4158ba9249550f6452cd` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:41.401410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d524deb-7b6c-4626-882b-07a12f64e1ec None admin] RBAC: Authorizing `identity:create_grant(project_id=db721c414b9e4fec93c61aef1313fdb0, user_id=831d3cfb8ffd4317a4ffe611c92f5d05, role_id=b0982ad59fae4158ba9249550f6452cd)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:41.403696 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d524deb-7b6c-4626-882b-07a12f64e1ec None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:41.407473 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0109836-eb9c-4e4c-8d3f-6329a433ec6e None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:41.425701 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 66/132] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 29 12:06:41 2022] PUT /identity/v3/projects/db721c414b9e4fec93c61aef1313fdb0/users/831d3cfb8ffd4317a4ffe611c92f5d05/roles/b0982ad59fae4158ba9249550f6452cd => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:06:41.427210 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d524deb-7b6c-4626-882b-07a12f64e1ec None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:41.450286 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b43662-b1dc-478b-adaf-16160785d06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:41.451507 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b43662-b1dc-478b-adaf-16160785d06b None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:41.451933 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b43662-b1dc-478b-adaf-16160785d06b None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:41.452313 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b43662-b1dc-478b-adaf-16160785d06b None admin] PATH_INFO: `/v3/projects/db721c414b9e4fec93c61aef1313fdb0` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:41.453985 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b43662-b1dc-478b-adaf-16160785d06b None admin] RBAC: Authorizing `identity:get_project(project_id=db721c414b9e4fec93c61aef1313fdb0)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:41.455994 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b43662-b1dc-478b-adaf-16160785d06b None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:41.458051 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 67/133] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:06:41 2022] GET /identity/v3/projects/db721c414b9e4fec93c61aef1313fdb0 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:41.464062 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1edbd1-3639-4ebe-83f3-3a43796de516 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:41.464465 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1edbd1-3639-4ebe-83f3-3a43796de516 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:41.464944 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1edbd1-3639-4ebe-83f3-3a43796de516 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:41.466533 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 68/134] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:41.470547 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1edbd1-3639-4ebe-83f3-3a43796de516 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:41.491292 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:41.575600 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d524deb-7b6c-4626-882b-07a12f64e1ec None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:41.601392 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1edbd1-3639-4ebe-83f3-3a43796de516 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:41.649300 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c83868-b7b2-4865-a19d-fefa8d6cee06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:41.650313 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c83868-b7b2-4865-a19d-fefa8d6cee06 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:41.650602 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c83868-b7b2-4865-a19d-fefa8d6cee06 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:41.650913 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c83868-b7b2-4865-a19d-fefa8d6cee06 None admin] PATH_INFO: `/v3/users/831d3cfb8ffd4317a4ffe611c92f5d05` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:41.652827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c83868-b7b2-4865-a19d-fefa8d6cee06 None admin] RBAC: Authorizing `identity:get_user(user_id=831d3cfb8ffd4317a4ffe611c92f5d05)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:41.653582 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c83868-b7b2-4865-a19d-fefa8d6cee06 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:41.655871 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 67/135] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:06:41 2022] GET /identity/v3/users/831d3cfb8ffd4317a4ffe611c92f5d05 => generated 275 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:41.657140 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45c4ca-4f2d-4770-8da5-842f3dcb6ea7 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:41.657422 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45c4ca-4f2d-4770-8da5-842f3dcb6ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:41.657697 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45c4ca-4f2d-4770-8da5-842f3dcb6ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:41.660313 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adda175-ac1b-41aa-a5dd-9caef0b22dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:41.661145 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adda175-ac1b-41aa-a5dd-9caef0b22dce None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:41.661599 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adda175-ac1b-41aa-a5dd-9caef0b22dce None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:41.662022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adda175-ac1b-41aa-a5dd-9caef0b22dce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:41.663530 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adda175-ac1b-41aa-a5dd-9caef0b22dce None admin] RBAC: Adding query filter params (role.id=08fb0ec8050c40ea8efd40e54fde52aa, scope.project.id=db721c414b9e4fec93c61aef1313fdb0, user.id=b5b142915920428c862f375473e6c52e) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:41.663998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adda175-ac1b-41aa-a5dd-9caef0b22dce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:41.667115 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adda175-ac1b-41aa-a5dd-9caef0b22dce None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:41.673672 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 69/136] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:06:41 2022] GET /identity/v3/role_assignments?user.id=b5b142915920428c862f375473e6c52e&scope.project.id=db721c414b9e4fec93c61aef1313fdb0&role.id=08fb0ec8050c40ea8efd40e54fde52aa => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:41.675111 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adda175-ac1b-41aa-a5dd-9caef0b22dce None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:41.678355 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-8f45c4ca-4f2d-4770-8da5-842f3dcb6ea7 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:41.679845 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-8f45c4ca-4f2d-4770-8da5-842f3dcb6ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:41.684280 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:41.807033 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:41.809825 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 68/137] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:06:41.836947 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45c4ca-4f2d-4770-8da5-842f3dcb6ea7 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:41.838849 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adda175-ac1b-41aa-a5dd-9caef0b22dce None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:41.899209 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385271b-e100-49f8-9c98-8f0a910e0cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:41.900092 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385271b-e100-49f8-9c98-8f0a910e0cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:41.900432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385271b-e100-49f8-9c98-8f0a910e0cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:41.900718 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385271b-e100-49f8-9c98-8f0a910e0cd9 None admin] PATH_INFO: `/v3/projects/577641f1bb5f410d87f34ac3efcb13f2` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:41.903114 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385271b-e100-49f8-9c98-8f0a910e0cd9 None admin] RBAC: Authorizing `identity:get_project(project_id=577641f1bb5f410d87f34ac3efcb13f2)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:41.905264 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385271b-e100-49f8-9c98-8f0a910e0cd9 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:41.907953 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 70/138] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:06:41 2022] GET /identity/v3/projects/577641f1bb5f410d87f34ac3efcb13f2 => generated 312 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:41.916881 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385271b-e100-49f8-9c98-8f0a910e0cd9 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:42.057491 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45c4ca-4f2d-4770-8da5-842f3dcb6ea7 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:42.092166 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385271b-e100-49f8-9c98-8f0a910e0cd9 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:42.135169 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e9d11-8f72-449a-bd5c-cc259f2097e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:42.136090 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e9d11-8f72-449a-bd5c-cc259f2097e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:42.136380 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e9d11-8f72-449a-bd5c-cc259f2097e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:42.136659 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e9d11-8f72-449a-bd5c-cc259f2097e3 None admin] PATH_INFO: `/v3/projects/577641f1bb5f410d87f34ac3efcb13f2/users/831d3cfb8ffd4317a4ffe611c92f5d05/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:42.138734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e9d11-8f72-449a-bd5c-cc259f2097e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=577641f1bb5f410d87f34ac3efcb13f2, user_id=831d3cfb8ffd4317a4ffe611c92f5d05, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:42.140209 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e9d11-8f72-449a-bd5c-cc259f2097e3 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:42.144352 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d41072-cd2b-4fbf-b20d-1d02ca5bdb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:42.145665 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d41072-cd2b-4fbf-b20d-1d02ca5bdb6b None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:42.145954 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d41072-cd2b-4fbf-b20d-1d02ca5bdb6b None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:42.146238 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d41072-cd2b-4fbf-b20d-1d02ca5bdb6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:42.158541 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 71/139] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 29 12:06:41 2022] PUT /identity/v3/projects/577641f1bb5f410d87f34ac3efcb13f2/users/831d3cfb8ffd4317a4ffe611c92f5d05/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:06:42.159930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333deaf-38d2-460d-8f8c-e52caf9362d8 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:42.160222 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333deaf-38d2-460d-8f8c-e52caf9362d8 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:42.160506 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333deaf-38d2-460d-8f8c-e52caf9362d8 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:42.168658 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 72/140] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:42.170114 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:42.174592 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d41072-cd2b-4fbf-b20d-1d02ca5bdb6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:06:42.191564 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-35d41072-cd2b-4fbf-b20d-1d02ca5bdb6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:06:42.191564 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:06:42.191564 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:06:42.191564 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:06:42.191564 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:06:42.191564 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:06:42.191564 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:06:42.191564 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:06:42.191564 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:06:42.191564 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:06:42.191564 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:06:42.191564 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:06:42.191564 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:06:42.191564 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:06:42.191564 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:06:42.191564 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:06:42.192534 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:06:42.192534 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:06:42.192534 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:06:42.192534 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:06:42.192534 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:06:42.192534 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:06:42.192534 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:06:42.192534 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:06:42.192534 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:06:42.192534 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:06:42.192534 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:06:42.192534 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:06:42.192534 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:06:42.192534 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:06:42.192534 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:06:42.192534 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:06:42.193296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:06:42.193296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:06:42.193296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:06:42.193296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:06:42.193296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:06:42.193296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:06:42.193296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:06:42.193296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:06:42.193296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:06:42.193296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:06:42.193296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:06:42.193296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:06:42.193296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 69/141] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:06:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:06:42.199863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3333deaf-38d2-460d-8f8c-e52caf9362d8 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:42.210056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cb0d6-0df0-470c-b89a-c42ccfa644d1 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:42.212156 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cb0d6-0df0-470c-b89a-c42ccfa644d1 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:42.212432 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cb0d6-0df0-470c-b89a-c42ccfa644d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:42.215147 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:42.256217 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-d79cb0d6-0df0-470c-b89a-c42ccfa644d1 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:42.257730 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-d79cb0d6-0df0-470c-b89a-c42ccfa644d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:42.352466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 70/142] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:06:42.396303 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79cb0d6-0df0-470c-b89a-c42ccfa644d1 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:42.424524 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3333deaf-38d2-460d-8f8c-e52caf9362d8 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:42.518506 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a0157-761b-417e-a5a7-0ff4e226a5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:42.519232 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a0157-761b-417e-a5a7-0ff4e226a5cf None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:42.519516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a0157-761b-417e-a5a7-0ff4e226a5cf None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:42.519850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a0157-761b-417e-a5a7-0ff4e226a5cf None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:42.520552 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a0157-761b-417e-a5a7-0ff4e226a5cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:42.520865 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a0157-761b-417e-a5a7-0ff4e226a5cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:42.522351 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a0157-761b-417e-a5a7-0ff4e226a5cf None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:42.523681 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79cb0d6-0df0-470c-b89a-c42ccfa644d1 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:42.541198 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 73/143] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:06:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:42.546778 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a0157-761b-417e-a5a7-0ff4e226a5cf None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:42.564129 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:42.566095 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8b085-4043-4988-ae03-dd68e625d452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:42.567052 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8b085-4043-4988-ae03-dd68e625d452 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:42.570494 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8b085-4043-4988-ae03-dd68e625d452 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:42.570494 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8b085-4043-4988-ae03-dd68e625d452 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:42.570494 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd8b085-4043-4988-ae03-dd68e625d452 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:42.571659 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd8b085-4043-4988-ae03-dd68e625d452 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:42.574069 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 71/144] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:06:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:06:42.580072 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8b085-4043-4988-ae03-dd68e625d452 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:42.679037 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:42.750658 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a0157-761b-417e-a5a7-0ff4e226a5cf None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:42.760154 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8b085-4043-4988-ae03-dd68e625d452 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:42.781266 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34940779-c3f7-43c6-b40a-728fceecc58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:42.782350 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34940779-c3f7-43c6-b40a-728fceecc58f None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:42.782726 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34940779-c3f7-43c6-b40a-728fceecc58f None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:42.783091 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34940779-c3f7-43c6-b40a-728fceecc58f None admin] PATH_INFO: `/v3/users/08fcb1f35af24620b53142bf98880fe8` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:42.784359 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34940779-c3f7-43c6-b40a-728fceecc58f None admin] RBAC: Authorizing `identity:get_user(user_id=08fcb1f35af24620b53142bf98880fe8)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:42.786017 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34940779-c3f7-43c6-b40a-728fceecc58f None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:42.787751 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 74/145] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:06:42 2022] GET /identity/v3/users/08fcb1f35af24620b53142bf98880fe8 => generated 247 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:06:42.789384 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50037d1-9a36-4138-8b57-3c1fbf0712b4 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:42.790455 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50037d1-9a36-4138-8b57-3c1fbf0712b4 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:42.790818 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50037d1-9a36-4138-8b57-3c1fbf0712b4 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:42.792133 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 75/146] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:42.797280 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50037d1-9a36-4138-8b57-3c1fbf0712b4 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:42.803085 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21e9ba-b312-435b-9ce0-4d31390cbe69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:42.803990 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21e9ba-b312-435b-9ce0-4d31390cbe69 None admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:42.804472 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21e9ba-b312-435b-9ce0-4d31390cbe69 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:42.804939 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21e9ba-b312-435b-9ce0-4d31390cbe69 None admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:42.806394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21e9ba-b312-435b-9ce0-4d31390cbe69 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:42.808647 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21e9ba-b312-435b-9ce0-4d31390cbe69 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:42.845704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 72/147] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 29 12:06:42 2022] POST /identity/v3/users => generated 283 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:06:42.847252 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0125b9d-f637-4b27-8d49-18085587e1fc None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:42.847618 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0125b9d-f637-4b27-8d49-18085587e1fc None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:42.847972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0125b9d-f637-4b27-8d49-18085587e1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:42.868519 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-f0125b9d-f637-4b27-8d49-18085587e1fc None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:42.870031 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-f0125b9d-f637-4b27-8d49-18085587e1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:42.946048 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:42.983914 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 73/148] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:06:42.985397 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50037d1-9a36-4138-8b57-3c1fbf0712b4 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:43.022470 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0125b9d-f637-4b27-8d49-18085587e1fc None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:43.043707 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d06ccd-5b1b-4f99-af3b-b0fcee6ae264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:43.044388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d06ccd-5b1b-4f99-af3b-b0fcee6ae264 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:43.044672 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d06ccd-5b1b-4f99-af3b-b0fcee6ae264 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:43.044952 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d06ccd-5b1b-4f99-af3b-b0fcee6ae264 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:43.052128 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:43.135342 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d06ccd-5b1b-4f99-af3b-b0fcee6ae264 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:43.136821 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d06ccd-5b1b-4f99-af3b-b0fcee6ae264 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:43.211475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0125b9d-f637-4b27-8d49-18085587e1fc None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:43.251175 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c085193-e3f3-4acc-a203-e8ba361df7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:43.253128 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c085193-e3f3-4acc-a203-e8ba361df7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:43.253636 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c085193-e3f3-4acc-a203-e8ba361df7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:43.254098 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c085193-e3f3-4acc-a203-e8ba361df7c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:43.263443 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 76/149] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:06:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:06:43.266231 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c085193-e3f3-4acc-a203-e8ba361df7c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:06:43.271870 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d06ccd-5b1b-4f99-af3b-b0fcee6ae264 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:43.275088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-8c085193-e3f3-4acc-a203-e8ba361df7c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:06:43.275088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:06:43.275088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:06:43.275088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:06:43.275088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:06:43.275088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:06:43.275088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:06:43.275088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:06:43.275088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:06:43.275088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:06:43.275088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:06:43.275088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:06:43.275088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:06:43.275088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:06:43.275088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:06:43.275088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:06:43.275984 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:06:43.275984 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:06:43.275984 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:06:43.275984 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:06:43.275984 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:06:43.275984 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:06:43.275984 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:06:43.275984 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:06:43.275984 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:06:43.275984 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:06:43.275984 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:06:43.275984 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:06:43.275984 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:06:43.275984 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:06:43.275984 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:06:43.275984 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:06:43.276778 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:06:43.276778 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:06:43.276778 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:06:43.276778 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:06:43.276778 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:06:43.276778 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:06:43.276778 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:06:43.276778 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:06:43.276778 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:06:43.276778 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:06:43.276778 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:06:43.276778 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:06:43.276778 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 74/150] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:06:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:06:43.282052 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c085193-e3f3-4acc-a203-e8ba361df7c1 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:43.317273 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:43.370317 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:43.402972 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d06ccd-5b1b-4f99-af3b-b0fcee6ae264 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:43.443104 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc37c41-2937-49b5-afbc-88010dc76dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:43.444287 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc37c41-2937-49b5-afbc-88010dc76dde None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:43.444747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc37c41-2937-49b5-afbc-88010dc76dde None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:43.445226 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc37c41-2937-49b5-afbc-88010dc76dde None admin] PATH_INFO: `/v3/projects/db721c414b9e4fec93c61aef1313fdb0` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:43.447367 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc37c41-2937-49b5-afbc-88010dc76dde None admin] RBAC: Authorizing `identity:get_project(project_id=db721c414b9e4fec93c61aef1313fdb0)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:43.449115 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc37c41-2937-49b5-afbc-88010dc76dde None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:43.452066 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 77/151] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:06:43 2022] GET /identity/v3/projects/db721c414b9e4fec93c61aef1313fdb0 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:43.457472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc37c41-2937-49b5-afbc-88010dc76dde None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:43.492896 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c085193-e3f3-4acc-a203-e8ba361df7c1 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:43.576025 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc37c41-2937-49b5-afbc-88010dc76dde None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:43.578022 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1545aa3-d154-48a1-b7f9-777c90e6ec85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:43.578726 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1545aa3-d154-48a1-b7f9-777c90e6ec85 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:43.579008 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1545aa3-d154-48a1-b7f9-777c90e6ec85 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:43.579283 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1545aa3-d154-48a1-b7f9-777c90e6ec85 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:43.579524 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:43.580244 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1545aa3-d154-48a1-b7f9-777c90e6ec85 None admin] RBAC: Adding query filter params (name=member) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:43.580349 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1545aa3-d154-48a1-b7f9-777c90e6ec85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:43.581723 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1545aa3-d154-48a1-b7f9-777c90e6ec85 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:43.602283 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 75/152] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 29 12:06:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:06:43.607872 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1545aa3-d154-48a1-b7f9-777c90e6ec85 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:43.619989 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a867b20-8a87-4d27-a345-61bed147c839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:43.620896 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a867b20-8a87-4d27-a345-61bed147c839 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:43.621387 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a867b20-8a87-4d27-a345-61bed147c839 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:43.621819 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a867b20-8a87-4d27-a345-61bed147c839 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:43.623390 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a867b20-8a87-4d27-a345-61bed147c839 None admin] RBAC: Adding query filter params (role.id=5ef3464f4436446b88430cdf7cc1a3d7, scope.project.id=db721c414b9e4fec93c61aef1313fdb0, user.id=08fcb1f35af24620b53142bf98880fe8) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:43.623867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a867b20-8a87-4d27-a345-61bed147c839 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:43.625484 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a867b20-8a87-4d27-a345-61bed147c839 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:43.633155 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 78/153] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:06:43 2022] GET /identity/v3/role_assignments?user.id=08fcb1f35af24620b53142bf98880fe8&scope.project.id=db721c414b9e4fec93c61aef1313fdb0&role.id=5ef3464f4436446b88430cdf7cc1a3d7 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:06:43.740999 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1545aa3-d154-48a1-b7f9-777c90e6ec85 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:43.744371 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:43.787531 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69740ec3-1cc6-475f-af45-faba9e16bd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:43.789019 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69740ec3-1cc6-475f-af45-faba9e16bd25 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:43.789488 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69740ec3-1cc6-475f-af45-faba9e16bd25 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:43.789907 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69740ec3-1cc6-475f-af45-faba9e16bd25 None admin] PATH_INFO: `/v3/users/831d3cfb8ffd4317a4ffe611c92f5d05` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:43.791404 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69740ec3-1cc6-475f-af45-faba9e16bd25 None admin] RBAC: Authorizing `identity:get_user(user_id=831d3cfb8ffd4317a4ffe611c92f5d05)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:43.793077 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69740ec3-1cc6-475f-af45-faba9e16bd25 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:43.795316 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 76/154] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:06:43 2022] GET /identity/v3/users/831d3cfb8ffd4317a4ffe611c92f5d05 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:43.800583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a867b20-8a87-4d27-a345-61bed147c839 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:43.916909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a867b20-8a87-4d27-a345-61bed147c839 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:43.954240 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e41b04-8633-4d34-9f5a-dec9e8290a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:43.954926 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e41b04-8633-4d34-9f5a-dec9e8290a49 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:43.955212 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e41b04-8633-4d34-9f5a-dec9e8290a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:43.955489 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e41b04-8633-4d34-9f5a-dec9e8290a49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:44.001120 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:44.037113 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e41b04-8633-4d34-9f5a-dec9e8290a49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:44.038929 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e41b04-8633-4d34-9f5a-dec9e8290a49 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:44.164047 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 79/155] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:06:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:06:44.169873 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69740ec3-1cc6-475f-af45-faba9e16bd25 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:44.306184 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69740ec3-1cc6-475f-af45-faba9e16bd25 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:44.350232 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3ebff-b9c6-4831-83b8-9c53ec2f03bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:44.351138 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3ebff-b9c6-4831-83b8-9c53ec2f03bf None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:44.351427 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3ebff-b9c6-4831-83b8-9c53ec2f03bf None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:44.351721 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3ebff-b9c6-4831-83b8-9c53ec2f03bf None admin] PATH_INFO: `/v3/projects/db721c414b9e4fec93c61aef1313fdb0` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:44.353518 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3ebff-b9c6-4831-83b8-9c53ec2f03bf None admin] RBAC: Authorizing `identity:get_project(project_id=db721c414b9e4fec93c61aef1313fdb0)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:44.354996 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3ebff-b9c6-4831-83b8-9c53ec2f03bf None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:44.357012 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 77/156] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:06:44 2022] GET /identity/v3/projects/db721c414b9e4fec93c61aef1313fdb0 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:44.362746 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e41b04-8633-4d34-9f5a-dec9e8290a49 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:44.461056 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:44.500673 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e41b04-8633-4d34-9f5a-dec9e8290a49 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:44.543978 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e70b67-7590-40e3-bd48-c3a8ed3ce9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:44.545020 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e70b67-7590-40e3-bd48-c3a8ed3ce9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:44.545681 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e70b67-7590-40e3-bd48-c3a8ed3ce9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:44.546237 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e70b67-7590-40e3-bd48-c3a8ed3ce9f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:44.547326 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e70b67-7590-40e3-bd48-c3a8ed3ce9f4 None admin] RBAC: Adding query filter params (role.id=419e204ede334962ac80ce56c398bd4f, scope.project.id=db721c414b9e4fec93c61aef1313fdb0, user.id=831d3cfb8ffd4317a4ffe611c92f5d05) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:44.547857 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e70b67-7590-40e3-bd48-c3a8ed3ce9f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:44.549519 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e70b67-7590-40e3-bd48-c3a8ed3ce9f4 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:44.556755 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 80/157] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:06:44 2022] GET /identity/v3/role_assignments?user.id=831d3cfb8ffd4317a4ffe611c92f5d05&scope.project.id=db721c414b9e4fec93c61aef1313fdb0&role.id=419e204ede334962ac80ce56c398bd4f => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:44.571717 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236b1a2-7b32-4e50-b97d-b5ae0ca76c88 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:44.572030 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236b1a2-7b32-4e50-b97d-b5ae0ca76c88 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:44.572288 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236b1a2-7b32-4e50-b97d-b5ae0ca76c88 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:44.573825 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 78/158] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:44.580163 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4356ad-d28e-4d6b-9b3a-7e9202e05fe5 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:44.580558 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4356ad-d28e-4d6b-9b3a-7e9202e05fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:44.580752 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4356ad-d28e-4d6b-9b3a-7e9202e05fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:44.603803 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-fc4356ad-d28e-4d6b-9b3a-7e9202e05fe5 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:44.605018 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-fc4356ad-d28e-4d6b-9b3a-7e9202e05fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:44.692066 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fe382-b0be-421f-a27e-fc4dc3495aae None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:44.692449 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fe382-b0be-421f-a27e-fc4dc3495aae None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:44.692635 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fe382-b0be-421f-a27e-fc4dc3495aae None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:44.694399 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 79/160] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:06:44.694513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 81/160] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:06:44.708610 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777de9df-8d81-49da-b294-c6ba571b4084 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:44.708934 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777de9df-8d81-49da-b294-c6ba571b4084 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:44.709174 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777de9df-8d81-49da-b294-c6ba571b4084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:44.729174 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4356ad-d28e-4d6b-9b3a-7e9202e05fe5 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:44.738666 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-777de9df-8d81-49da-b294-c6ba571b4084 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:44.739987 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-777de9df-8d81-49da-b294-c6ba571b4084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:44.819107 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:44.880170 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 80/161] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:06:44.890314 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:44.925766 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777de9df-8d81-49da-b294-c6ba571b4084 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:44.968977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4356ad-d28e-4d6b-9b3a-7e9202e05fe5 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:45.021239 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c45365-85cb-4c33-b0e5-33c2e212ae9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:45.022059 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c45365-85cb-4c33-b0e5-33c2e212ae9a None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:45.022342 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c45365-85cb-4c33-b0e5-33c2e212ae9a None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:45.022614 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c45365-85cb-4c33-b0e5-33c2e212ae9a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:45.048100 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c45365-85cb-4c33-b0e5-33c2e212ae9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:06:45.056431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-f2c45365-85cb-4c33-b0e5-33c2e212ae9a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:06:45.056431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:06:45.056431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:06:45.056431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:06:45.056431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:06:45.056431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:06:45.056431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:06:45.056431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:06:45.056431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:06:45.056431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:06:45.056431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:06:45.056431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:06:45.056431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:06:45.056431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:06:45.056431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:06:45.056431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:06:45.057304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:06:45.057304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:06:45.057304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:06:45.057304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:06:45.057304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:06:45.057304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:06:45.057304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:06:45.057304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:06:45.057304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:06:45.057304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:06:45.057304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:06:45.057304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:06:45.057304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:06:45.057304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:06:45.057304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:06:45.057304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:06:45.058083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:06:45.058083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:06:45.058083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:06:45.058083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:06:45.058083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:06:45.058083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:06:45.058083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:06:45.058083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:06:45.058083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:06:45.058083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:06:45.058083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:06:45.058083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:06:45.058083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 82/162] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:06:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:06:45.072352 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c45365-85cb-4c33-b0e5-33c2e212ae9a None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:45.083537 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777de9df-8d81-49da-b294-c6ba571b4084 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:45.202956 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c45365-85cb-4c33-b0e5-33c2e212ae9a None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:45.211393 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b82202-cff4-4dcf-be6c-760490946c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:45.212235 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b82202-cff4-4dcf-be6c-760490946c73 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:45.212521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b82202-cff4-4dcf-be6c-760490946c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:45.212799 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b82202-cff4-4dcf-be6c-760490946c73 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:45.228636 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b82202-cff4-4dcf-be6c-760490946c73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:06:45.228969 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:45.245637 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-29b82202-cff4-4dcf-be6c-760490946c73 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:06:45.245637 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:06:45.245637 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:06:45.245637 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:06:45.245637 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:06:45.245637 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:06:45.245637 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:06:45.245637 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:06:45.245637 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:06:45.245637 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:06:45.245637 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:06:45.245637 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:06:45.245637 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:06:45.245637 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:06:45.245637 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:06:45.245637 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:06:45.248724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:06:45.248724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:06:45.248724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:06:45.248724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:06:45.248724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:06:45.248724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:06:45.248724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:06:45.248724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:06:45.248724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:06:45.248724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:06:45.248724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:06:45.248724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:06:45.248724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:06:45.248724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:06:45.248724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:06:45.248724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:06:45.250657 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:06:45.250657 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:06:45.250657 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:06:45.250657 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:06:45.250657 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:06:45.250657 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:06:45.250657 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:06:45.250657 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:06:45.250657 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:06:45.250657 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:06:45.250657 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:06:45.250657 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:06:45.250657 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 81/163] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 29 12:06:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:06:45.252224 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ba70c-c29c-403f-8d8f-0fa0e48f8af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:45.252224 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ba70c-c29c-403f-8d8f-0fa0e48f8af1 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:45.252224 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ba70c-c29c-403f-8d8f-0fa0e48f8af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:45.252224 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ba70c-c29c-403f-8d8f-0fa0e48f8af1 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:45.252785 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ba70c-c29c-403f-8d8f-0fa0e48f8af1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:45.252785 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ba70c-c29c-403f-8d8f-0fa0e48f8af1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:45.252785 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ba70c-c29c-403f-8d8f-0fa0e48f8af1 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:45.261450 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 83/164] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 29 12:06:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:45.262480 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b82202-cff4-4dcf-be6c-760490946c73 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:45.267744 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ba70c-c29c-403f-8d8f-0fa0e48f8af1 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:45.317393 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:45.393708 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ba70c-c29c-403f-8d8f-0fa0e48f8af1 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:45.433157 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b82202-cff4-4dcf-be6c-760490946c73 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:45.437183 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc898f2-f93d-4cd9-a59d-d325e37834a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:45.438079 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc898f2-f93d-4cd9-a59d-d325e37834a8 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:45.438363 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc898f2-f93d-4cd9-a59d-d325e37834a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:45.438649 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc898f2-f93d-4cd9-a59d-d325e37834a8 None admin] PATH_INFO: `/v3/users/b5b142915920428c862f375473e6c52e` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:45.441257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc898f2-f93d-4cd9-a59d-d325e37834a8 None admin] RBAC: Authorizing `identity:get_user(user_id=b5b142915920428c862f375473e6c52e)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:45.442967 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc898f2-f93d-4cd9-a59d-d325e37834a8 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:45.445051 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 84/165] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:06:45 2022] GET /identity/v3/users/b5b142915920428c862f375473e6c52e => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:45.446294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0f5db-26b3-4169-97d5-bed8a9b86e61 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:45.446566 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0f5db-26b3-4169-97d5-bed8a9b86e61 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:45.446869 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0f5db-26b3-4169-97d5-bed8a9b86e61 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:45.448467 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 85/166] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:45.454155 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0f5db-26b3-4169-97d5-bed8a9b86e61 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:45.483359 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff939e-2533-45b8-a2da-684d85bca615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:45.484047 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff939e-2533-45b8-a2da-684d85bca615 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:45.484332 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff939e-2533-45b8-a2da-684d85bca615 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:45.484609 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff939e-2533-45b8-a2da-684d85bca615 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:45.485366 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff939e-2533-45b8-a2da-684d85bca615 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:45.485677 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff939e-2533-45b8-a2da-684d85bca615 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:45.487115 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff939e-2533-45b8-a2da-684d85bca615 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:45.498737 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 82/167] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:06:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:45.499957 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48916e9b-6d37-4535-ba6d-e9363b00bce9 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:45.500438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48916e9b-6d37-4535-ba6d-e9363b00bce9 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:45.500720 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48916e9b-6d37-4535-ba6d-e9363b00bce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:45.522183 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:45.537434 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-48916e9b-6d37-4535-ba6d-e9363b00bce9 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:45.538913 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-48916e9b-6d37-4535-ba6d-e9363b00bce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:45.591935 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0f5db-26b3-4169-97d5-bed8a9b86e61 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:45.644607 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52d103-3977-46c9-a0f6-28a6155e86ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:45.645370 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52d103-3977-46c9-a0f6-28a6155e86ad None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:45.646240 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52d103-3977-46c9-a0f6-28a6155e86ad None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:45.646753 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52d103-3977-46c9-a0f6-28a6155e86ad None admin] PATH_INFO: `/v3/projects/db721c414b9e4fec93c61aef1313fdb0` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:45.648080 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52d103-3977-46c9-a0f6-28a6155e86ad None admin] RBAC: Authorizing `identity:get_project(project_id=db721c414b9e4fec93c61aef1313fdb0)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:45.649861 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52d103-3977-46c9-a0f6-28a6155e86ad None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:45.654771 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 83/168] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:06:45.660374 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48916e9b-6d37-4535-ba6d-e9363b00bce9 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:45.665472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 86/169] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:06:45 2022] GET /identity/v3/projects/db721c414b9e4fec93c61aef1313fdb0 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:45.674028 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52d103-3977-46c9-a0f6-28a6155e86ad None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:45.742270 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:45.830809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52d103-3977-46c9-a0f6-28a6155e86ad None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:45.855518 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:45.879257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32254e26-d905-4985-9b4c-26cc16afaef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:45.880405 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32254e26-d905-4985-9b4c-26cc16afaef1 None admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:45.880842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32254e26-d905-4985-9b4c-26cc16afaef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:45.881254 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32254e26-d905-4985-9b4c-26cc16afaef1 None admin] PATH_INFO: `/v3/projects/db721c414b9e4fec93c61aef1313fdb0/users/b5b142915920428c862f375473e6c52e/roles/08fb0ec8050c40ea8efd40e54fde52aa` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:45.889493 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32254e26-d905-4985-9b4c-26cc16afaef1 None admin] RBAC: Authorizing `identity:create_grant(project_id=db721c414b9e4fec93c61aef1313fdb0, user_id=b5b142915920428c862f375473e6c52e, role_id=08fb0ec8050c40ea8efd40e54fde52aa)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:45.891022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32254e26-d905-4985-9b4c-26cc16afaef1 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:45.913834 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 87/170] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 29 12:06:45 2022] PUT /identity/v3/projects/db721c414b9e4fec93c61aef1313fdb0/users/b5b142915920428c862f375473e6c52e/roles/08fb0ec8050c40ea8efd40e54fde52aa => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:06:45.914709 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32254e26-d905-4985-9b4c-26cc16afaef1 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:45.943794 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48916e9b-6d37-4535-ba6d-e9363b00bce9 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:46.029085 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dbd3cd-defa-42e0-b216-5e9a058ef69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:46.030004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbd3cd-defa-42e0-b216-5e9a058ef69f None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:46.030290 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbd3cd-defa-42e0-b216-5e9a058ef69f None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:46.030568 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbd3cd-defa-42e0-b216-5e9a058ef69f None admin] PATH_INFO: `/v3/users/831d3cfb8ffd4317a4ffe611c92f5d05` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:46.035553 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dbd3cd-defa-42e0-b216-5e9a058ef69f None admin] RBAC: Authorizing `identity:get_user(user_id=831d3cfb8ffd4317a4ffe611c92f5d05)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:46.037077 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dbd3cd-defa-42e0-b216-5e9a058ef69f None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:46.039150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 84/171] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:06:45 2022] GET /identity/v3/users/831d3cfb8ffd4317a4ffe611c92f5d05 => generated 275 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:46.044754 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dbd3cd-defa-42e0-b216-5e9a058ef69f None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:46.165105 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32254e26-d905-4985-9b4c-26cc16afaef1 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:46.166351 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:46.178434 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dbd3cd-defa-42e0-b216-5e9a058ef69f None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:46.224168 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8b6a7-325e-4c9a-8432-e7f8956d6069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:46.224691 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bd2cf-a0f6-40a5-9425-bf0a63edf98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:46.225085 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bd2cf-a0f6-40a5-9425-bf0a63edf98f None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:46.225167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8b6a7-325e-4c9a-8432-e7f8956d6069 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:46.225236 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bd2cf-a0f6-40a5-9425-bf0a63edf98f None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:46.225317 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8b6a7-325e-4c9a-8432-e7f8956d6069 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:46.225603 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bd2cf-a0f6-40a5-9425-bf0a63edf98f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:46.225697 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8b6a7-325e-4c9a-8432-e7f8956d6069 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:46.241852 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee8b6a7-325e-4c9a-8432-e7f8956d6069 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:06:46.249728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-7ee8b6a7-325e-4c9a-8432-e7f8956d6069 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:06:46.249728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:06:46.249728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:06:46.249728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:06:46.249728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:06:46.249728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:06:46.249728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:06:46.249728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:06:46.249728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:06:46.249728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:06:46.249728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:06:46.249728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:06:46.249728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:06:46.249728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:06:46.249728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:06:46.249728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:06:46.250723 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:06:46.250723 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:06:46.250723 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:06:46.250723 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:06:46.250723 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:06:46.250723 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:06:46.250723 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:06:46.250723 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:06:46.250723 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:06:46.250723 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:06:46.250723 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:06:46.250723 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:06:46.250723 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:06:46.250723 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:06:46.250723 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:06:46.250723 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:06:46.251506 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:06:46.251506 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:06:46.251506 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:06:46.251506 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:06:46.251506 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:06:46.251506 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:06:46.251506 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:06:46.251506 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:06:46.251506 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:06:46.251506 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:06:46.251506 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:06:46.251506 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:06:46.256413 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 88/172] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:06:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:06:46.263106 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8b6a7-325e-4c9a-8432-e7f8956d6069 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:46.332246 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:46.375823 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5bd2cf-a0f6-40a5-9425-bf0a63edf98f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:46.377353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5bd2cf-a0f6-40a5-9425-bf0a63edf98f None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:46.418205 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8b6a7-325e-4c9a-8432-e7f8956d6069 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:46.484264 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701ac11-24d9-429d-9d4c-dc9ad73d0b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:46.484954 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701ac11-24d9-429d-9d4c-dc9ad73d0b4b None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:46.485242 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701ac11-24d9-429d-9d4c-dc9ad73d0b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:46.485522 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701ac11-24d9-429d-9d4c-dc9ad73d0b4b None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:46.486285 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a701ac11-24d9-429d-9d4c-dc9ad73d0b4b None admin] RBAC: Adding query filter params (name=member) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:46.486596 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a701ac11-24d9-429d-9d4c-dc9ad73d0b4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:46.488035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a701ac11-24d9-429d-9d4c-dc9ad73d0b4b None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:46.502287 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 89/173] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 29 12:06:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:06:46.508624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701ac11-24d9-429d-9d4c-dc9ad73d0b4b None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:46.587631 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:46.600896 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 85/174] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:06:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 12:06:46.608065 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bd2cf-a0f6-40a5-9425-bf0a63edf98f None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:46.697180 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701ac11-24d9-429d-9d4c-dc9ad73d0b4b None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:46.702605 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:46.763731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d1df3-5330-40c6-8278-228baeafe1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:46.764619 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d1df3-5330-40c6-8278-228baeafe1bc None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:46.764908 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d1df3-5330-40c6-8278-228baeafe1bc None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:46.765181 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d1df3-5330-40c6-8278-228baeafe1bc None admin] PATH_INFO: `/v3/users/831d3cfb8ffd4317a4ffe611c92f5d05` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:46.767473 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d1df3-5330-40c6-8278-228baeafe1bc None admin] RBAC: Authorizing `identity:get_user(user_id=831d3cfb8ffd4317a4ffe611c92f5d05)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:46.768945 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d1df3-5330-40c6-8278-228baeafe1bc None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:46.770608 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 90/175] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:06:46 2022] GET /identity/v3/users/831d3cfb8ffd4317a4ffe611c92f5d05 => generated 275 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:06:46.771830 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881d31d-1e98-4af6-ad90-6172628345e5 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:46.772115 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881d31d-1e98-4af6-ad90-6172628345e5 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:46.772398 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881d31d-1e98-4af6-ad90-6172628345e5 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:46.773649 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 91/176] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:46.778976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ca40d-2d4f-4429-a177-2e0c1bd10de4 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:46.779286 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ca40d-2d4f-4429-a177-2e0c1bd10de4 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:46.779545 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ca40d-2d4f-4429-a177-2e0c1bd10de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:46.795946 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bd2cf-a0f6-40a5-9425-bf0a63edf98f None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:46.797575 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-749ca40d-2d4f-4429-a177-2e0c1bd10de4 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:46.800480 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-749ca40d-2d4f-4429-a177-2e0c1bd10de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:46.863376 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84f9dc-8b21-4a67-94f2-899373597dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:46.864686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84f9dc-8b21-4a67-94f2-899373597dfb None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:46.865271 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84f9dc-8b21-4a67-94f2-899373597dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:46.865832 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84f9dc-8b21-4a67-94f2-899373597dfb None admin] PATH_INFO: `/v3/projects/db721c414b9e4fec93c61aef1313fdb0` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:46.867296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84f9dc-8b21-4a67-94f2-899373597dfb None admin] RBAC: Authorizing `identity:get_project(project_id=db721c414b9e4fec93c61aef1313fdb0)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:46.868264 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 92/177] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:06:46.874659 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ca40d-2d4f-4429-a177-2e0c1bd10de4 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:46.874809 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84f9dc-8b21-4a67-94f2-899373597dfb None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:46.877964 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 86/178] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:06:46 2022] GET /identity/v3/projects/db721c414b9e4fec93c61aef1313fdb0 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:06:46.898339 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84f9dc-8b21-4a67-94f2-899373597dfb None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:47.013051 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:47.040969 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:47.044845 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ca40d-2d4f-4429-a177-2e0c1bd10de4 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:47.089180 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84f9dc-8b21-4a67-94f2-899373597dfb None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:47.107077 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073549c-d27f-4aa8-8579-7540f234ab28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:47.107740 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073549c-d27f-4aa8-8579-7540f234ab28 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:47.108022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073549c-d27f-4aa8-8579-7540f234ab28 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:47.108299 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073549c-d27f-4aa8-8579-7540f234ab28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:47.151929 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a28d16-2106-46d3-bf68-5eaf9efb7be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:47.152600 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a28d16-2106-46d3-bf68-5eaf9efb7be7 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:47.152888 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a28d16-2106-46d3-bf68-5eaf9efb7be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:47.153170 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a28d16-2106-46d3-bf68-5eaf9efb7be7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:47.154008 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a28d16-2106-46d3-bf68-5eaf9efb7be7 None admin] RBAC: Adding query filter params (role.id=b0982ad59fae4158ba9249550f6452cd, scope.project.id=db721c414b9e4fec93c61aef1313fdb0, user.id=831d3cfb8ffd4317a4ffe611c92f5d05) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:47.154325 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a28d16-2106-46d3-bf68-5eaf9efb7be7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:47.155928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a28d16-2106-46d3-bf68-5eaf9efb7be7 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:47.163461 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 87/179] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:06:46 2022] GET /identity/v3/role_assignments?user.id=831d3cfb8ffd4317a4ffe611c92f5d05&scope.project.id=db721c414b9e4fec93c61aef1313fdb0&role.id=b0982ad59fae4158ba9249550f6452cd => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:47.164809 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a28d16-2106-46d3-bf68-5eaf9efb7be7 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:47.295275 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7073549c-d27f-4aa8-8579-7540f234ab28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:47.297489 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7073549c-d27f-4aa8-8579-7540f234ab28 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:47.431462 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a28d16-2106-46d3-bf68-5eaf9efb7be7 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:47.440420 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:47.447323 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 93/180] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:06:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:06:47.453696 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073549c-d27f-4aa8-8579-7540f234ab28 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:47.475006 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:47.502261 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e37aa0-9001-4359-9a13-bf5a3dfcc03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:47.503110 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e37aa0-9001-4359-9a13-bf5a3dfcc03f None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:47.503397 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e37aa0-9001-4359-9a13-bf5a3dfcc03f None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:47.503672 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e37aa0-9001-4359-9a13-bf5a3dfcc03f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:47.514965 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e37aa0-9001-4359-9a13-bf5a3dfcc03f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:06:47.522869 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-60e37aa0-9001-4359-9a13-bf5a3dfcc03f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:06:47.522869 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:06:47.522869 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:06:47.522869 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:06:47.522869 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:06:47.522869 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:06:47.522869 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:06:47.522869 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:06:47.522869 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:06:47.522869 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:06:47.522869 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:06:47.522869 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:06:47.522869 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:06:47.522869 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:06:47.522869 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:06:47.522869 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:06:47.524301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:06:47.524301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:06:47.524301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:06:47.524301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:06:47.524301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:06:47.524301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:06:47.524301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:06:47.524301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:06:47.524301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:06:47.524301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:06:47.524301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:06:47.524301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:06:47.524301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:06:47.524301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:06:47.524301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:06:47.524301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:06:47.525190 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:06:47.525190 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:06:47.525190 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:06:47.525190 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:06:47.525190 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:06:47.525190 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:06:47.525190 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:06:47.525190 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:06:47.525190 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:06:47.525190 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:06:47.525190 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:06:47.525190 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:06:47.525190 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 88/181] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:06:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:06:47.531565 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9aa78-12ee-42b1-861b-8eda337a9a38 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:47.531859 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9aa78-12ee-42b1-861b-8eda337a9a38 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:47.532148 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9aa78-12ee-42b1-861b-8eda337a9a38 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:47.537193 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 89/182] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:47.537193 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9aa78-12ee-42b1-861b-8eda337a9a38 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:47.591279 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073549c-d27f-4aa8-8579-7540f234ab28 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:47.631003 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b1f13-d3ce-44ce-b84d-7ed8808685ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:47.631874 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b1f13-d3ce-44ce-b84d-7ed8808685ce None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:47.632161 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b1f13-d3ce-44ce-b84d-7ed8808685ce None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:47.632438 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b1f13-d3ce-44ce-b84d-7ed8808685ce None admin] PATH_INFO: `/v3/projects/577641f1bb5f410d87f34ac3efcb13f2` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:47.634167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b1f13-d3ce-44ce-b84d-7ed8808685ce None admin] RBAC: Authorizing `identity:get_project(project_id=577641f1bb5f410d87f34ac3efcb13f2)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:47.636140 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b1f13-d3ce-44ce-b84d-7ed8808685ce None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:47.637564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 94/183] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:06:47 2022] GET /identity/v3/projects/577641f1bb5f410d87f34ac3efcb13f2 => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:47.638566 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caaf537-788e-41a9-a606-fd26ba8af30d None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:47.638881 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caaf537-788e-41a9-a606-fd26ba8af30d None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:47.639165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caaf537-788e-41a9-a606-fd26ba8af30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:47.656472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-4caaf537-788e-41a9-a606-fd26ba8af30d None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:47.657656 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-4caaf537-788e-41a9-a606-fd26ba8af30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:47.661099 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9aa78-12ee-42b1-861b-8eda337a9a38 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:47.696736 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba435ca-caf0-4b5e-a5a5-4bdb7e1dd6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:47.697405 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba435ca-caf0-4b5e-a5a5-4bdb7e1dd6bb None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:47.697688 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba435ca-caf0-4b5e-a5a5-4bdb7e1dd6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:47.697960 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba435ca-caf0-4b5e-a5a5-4bdb7e1dd6bb None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:47.698721 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba435ca-caf0-4b5e-a5a5-4bdb7e1dd6bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:47.699030 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba435ca-caf0-4b5e-a5a5-4bdb7e1dd6bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:47.700427 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba435ca-caf0-4b5e-a5a5-4bdb7e1dd6bb None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:47.714150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 90/184] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:06:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:47.714150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb77b2-cb23-43f9-a4e9-cb7db3cf46aa None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:47.714150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb77b2-cb23-43f9-a4e9-cb7db3cf46aa None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:47.714150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb77b2-cb23-43f9-a4e9-cb7db3cf46aa None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:47.714150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 91/185] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:47.714150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb77b2-cb23-43f9-a4e9-cb7db3cf46aa None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:47.733596 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:47.739486 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 95/186] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:06:47.751951 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ddcd4-8ce8-4ced-968f-04238d985f3c None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:47.752241 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ddcd4-8ce8-4ced-968f-04238d985f3c None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:47.752525 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ddcd4-8ce8-4ced-968f-04238d985f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:47.763033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:47.772960 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-731ddcd4-8ce8-4ced-968f-04238d985f3c None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:47.774729 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-731ddcd4-8ce8-4ced-968f-04238d985f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:47.821389 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb77b2-cb23-43f9-a4e9-cb7db3cf46aa None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:47.854742 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 96/187] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:06:47.862656 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ddcd4-8ce8-4ced-968f-04238d985f3c None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:47.862798 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffc4fa-00ac-4f90-b320-2f6e2067ea61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:47.862798 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffc4fa-00ac-4f90-b320-2f6e2067ea61 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:47.862798 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffc4fa-00ac-4f90-b320-2f6e2067ea61 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:47.862798 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffc4fa-00ac-4f90-b320-2f6e2067ea61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:47.863088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ffc4fa-00ac-4f90-b320-2f6e2067ea61 None admin] RBAC: Adding query filter params (role.id=419e204ede334962ac80ce56c398bd4f, scope.project.id=577641f1bb5f410d87f34ac3efcb13f2, user.id=831d3cfb8ffd4317a4ffe611c92f5d05) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:47.863088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ffc4fa-00ac-4f90-b320-2f6e2067ea61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:47.863088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ffc4fa-00ac-4f90-b320-2f6e2067ea61 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:47.868181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 92/188] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:06:47 2022] GET /identity/v3/role_assignments?user.id=831d3cfb8ffd4317a4ffe611c92f5d05&scope.project.id=577641f1bb5f410d87f34ac3efcb13f2&role.id=419e204ede334962ac80ce56c398bd4f => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:47.868791 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffc4fa-00ac-4f90-b320-2f6e2067ea61 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:47.990966 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffc4fa-00ac-4f90-b320-2f6e2067ea61 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:47.998666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ddcd4-8ce8-4ced-968f-04238d985f3c None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:48.001833 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:48.032161 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a5f85-50f4-46ff-9d71-26911895a646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:48.033238 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a5f85-50f4-46ff-9d71-26911895a646 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:48.033523 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a5f85-50f4-46ff-9d71-26911895a646 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:48.033809 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a5f85-50f4-46ff-9d71-26911895a646 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:48.039926 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:48.045173 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a1e6a-708a-4f5c-9a35-e5499254a8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:48.045629 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a5f85-50f4-46ff-9d71-26911895a646 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:06:48.046052 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a1e6a-708a-4f5c-9a35-e5499254a8d3 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:48.046334 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a1e6a-708a-4f5c-9a35-e5499254a8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:48.046603 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a1e6a-708a-4f5c-9a35-e5499254a8d3 None admin] PATH_INFO: `/v3/users/e544a558d3774c4784a48f0762e9a58f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:48.053920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-9d8a5f85-50f4-46ff-9d71-26911895a646 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:06:48.053920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:06:48.053920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:06:48.053920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:06:48.053920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:06:48.053920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:06:48.053920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:06:48.053920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:06:48.053920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:06:48.053920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:06:48.053920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:06:48.053920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:06:48.053920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:06:48.053920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:06:48.053920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:06:48.053920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:06:48.055686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:06:48.055686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:06:48.055686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:06:48.055686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:06:48.055686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:06:48.055686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:06:48.055686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:06:48.055686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:06:48.055686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:06:48.055686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:06:48.055686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:06:48.055686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:06:48.055686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:06:48.055686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:06:48.055686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:06:48.055686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:06:48.056465 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:06:48.056465 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:06:48.056465 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:06:48.056465 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:06:48.056465 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:06:48.056465 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:06:48.056465 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:06:48.056465 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:06:48.056465 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:06:48.056465 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:06:48.056465 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:06:48.056465 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:06:48.057057 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 93/189] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 29 12:06:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:06:48.058241 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a5f85-50f4-46ff-9d71-26911895a646 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:48.066133 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a1e6a-708a-4f5c-9a35-e5499254a8d3 None admin] RBAC: Authorizing `identity:get_user(user_id=e544a558d3774c4784a48f0762e9a58f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:48.068114 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a1e6a-708a-4f5c-9a35-e5499254a8d3 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:48.070396 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 97/190] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:06:47 2022] GET /identity/v3/users/e544a558d3774c4784a48f0762e9a58f => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:48.071749 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a1e6a-708a-4f5c-9a35-e5499254a8d3 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:48.185381 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a5f85-50f4-46ff-9d71-26911895a646 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:48.205090 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a1e6a-708a-4f5c-9a35-e5499254a8d3 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:48.220859 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb5f7e-d676-4bdf-b332-b668aa800272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:48.221654 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb5f7e-d676-4bdf-b332-b668aa800272 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:48.221938 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb5f7e-d676-4bdf-b332-b668aa800272 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:48.222213 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb5f7e-d676-4bdf-b332-b668aa800272 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:48.223402 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb5f7e-d676-4bdf-b332-b668aa800272 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:48.224860 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb5f7e-d676-4bdf-b332-b668aa800272 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:48.226673 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 94/191] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:06:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:48.231703 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb5f7e-d676-4bdf-b332-b668aa800272 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:48.241394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d9fa2-0a92-4c3f-b5fe-5eafc97b9200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:48.242065 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d9fa2-0a92-4c3f-b5fe-5eafc97b9200 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:48.242354 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d9fa2-0a92-4c3f-b5fe-5eafc97b9200 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:48.243180 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d9fa2-0a92-4c3f-b5fe-5eafc97b9200 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:48.243921 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d9fa2-0a92-4c3f-b5fe-5eafc97b9200 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:48.244225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d9fa2-0a92-4c3f-b5fe-5eafc97b9200 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:48.245609 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d9fa2-0a92-4c3f-b5fe-5eafc97b9200 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:48.258695 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 98/192] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:06:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:48.258695 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d9fa2-0a92-4c3f-b5fe-5eafc97b9200 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:48.272880 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:48.314077 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:48.345689 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb5f7e-d676-4bdf-b332-b668aa800272 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:48.368340 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d9fa2-0a92-4c3f-b5fe-5eafc97b9200 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:48.384195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670ab1b-bbd9-458a-98b6-309825b51270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:48.384861 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670ab1b-bbd9-458a-98b6-309825b51270 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:48.385148 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670ab1b-bbd9-458a-98b6-309825b51270 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:48.385422 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670ab1b-bbd9-458a-98b6-309825b51270 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:48.404025 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae58169-f472-4bb7-be29-9301e87b108d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:48.404711 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae58169-f472-4bb7-be29-9301e87b108d None admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:48.404999 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae58169-f472-4bb7-be29-9301e87b108d None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:48.405278 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae58169-f472-4bb7-be29-9301e87b108d None admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:48.406003 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae58169-f472-4bb7-be29-9301e87b108d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:48.407484 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae58169-f472-4bb7-be29-9301e87b108d None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:48.426823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 99/193] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 29 12:06:48 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:06:48.427642 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae58169-f472-4bb7-be29-9301e87b108d None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:48.472104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670ab1b-bbd9-458a-98b6-309825b51270 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:48.473764 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670ab1b-bbd9-458a-98b6-309825b51270 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:48.516708 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:48.548546 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae58169-f472-4bb7-be29-9301e87b108d None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:48.551135 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:48.590545 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1210f6f-d7a2-4f4e-a77b-e81e7cca5136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:48.592589 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1210f6f-d7a2-4f4e-a77b-e81e7cca5136 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:48.592589 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1210f6f-d7a2-4f4e-a77b-e81e7cca5136 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:48.592766 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 95/194] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:06:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:06:48.592838 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1210f6f-d7a2-4f4e-a77b-e81e7cca5136 None admin] PATH_INFO: `/v3/users/e544a558d3774c4784a48f0762e9a58f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:48.593354 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa037a3-2686-4d07-b66e-b7625f9c8993 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:48.593639 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa037a3-2686-4d07-b66e-b7625f9c8993 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:48.593915 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa037a3-2686-4d07-b66e-b7625f9c8993 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:48.598742 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 96/195] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:48.598874 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1210f6f-d7a2-4f4e-a77b-e81e7cca5136 None admin] RBAC: Authorizing `identity:get_user(user_id=e544a558d3774c4784a48f0762e9a58f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:48.598952 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa037a3-2686-4d07-b66e-b7625f9c8993 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:48.599020 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1210f6f-d7a2-4f4e-a77b-e81e7cca5136 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:48.599849 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 100/196] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:06:48 2022] GET /identity/v3/users/e544a558d3774c4784a48f0762e9a58f => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:48.605064 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68574a5-4a4c-4772-a010-c0eb3a2ba1b9 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:48.605360 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68574a5-4a4c-4772-a010-c0eb3a2ba1b9 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:48.605642 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68574a5-4a4c-4772-a010-c0eb3a2ba1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:48.627060 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-e68574a5-4a4c-4772-a010-c0eb3a2ba1b9 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:48.628344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-e68574a5-4a4c-4772-a010-c0eb3a2ba1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:48.724008 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 101/197] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:06:48.724008 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68574a5-4a4c-4772-a010-c0eb3a2ba1b9 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:48.743707 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa037a3-2686-4d07-b66e-b7625f9c8993 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:48.783391 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3696f-3503-4c04-917b-628d301a6796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:48.784508 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3696f-3503-4c04-917b-628d301a6796 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:48.784935 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3696f-3503-4c04-917b-628d301a6796 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:48.785408 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3696f-3503-4c04-917b-628d301a6796 None admin] PATH_INFO: `/v3/projects/5fd79607efc84957a3c849d0d14a8f76` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:48.786931 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3696f-3503-4c04-917b-628d301a6796 None admin] RBAC: Authorizing `identity:get_project(project_id=5fd79607efc84957a3c849d0d14a8f76)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:48.789978 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3696f-3503-4c04-917b-628d301a6796 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:48.792684 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 97/198] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:06:48 2022] GET /identity/v3/projects/5fd79607efc84957a3c849d0d14a8f76 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:48.793914 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3696f-3503-4c04-917b-628d301a6796 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:48.803481 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:48.855740 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68574a5-4a4c-4772-a010-c0eb3a2ba1b9 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:48.857634 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:48.894744 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f70a5-37c5-4519-a381-664fbf53d184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:48.895681 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f70a5-37c5-4519-a381-664fbf53d184 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:48.896106 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f70a5-37c5-4519-a381-664fbf53d184 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:48.896628 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f70a5-37c5-4519-a381-664fbf53d184 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:48.906410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3696f-3503-4c04-917b-628d301a6796 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:48.941471 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e39d8-55d7-4bb6-9a77-3b66cd7cb1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:48.942258 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e39d8-55d7-4bb6-9a77-3b66cd7cb1ce None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:48.942538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e39d8-55d7-4bb6-9a77-3b66cd7cb1ce None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:48.942840 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e39d8-55d7-4bb6-9a77-3b66cd7cb1ce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:48.954181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e39d8-55d7-4bb6-9a77-3b66cd7cb1ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:06:48.962101 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-8d3e39d8-55d7-4bb6-9a77-3b66cd7cb1ce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:06:48.962101 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:06:48.962101 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:06:48.962101 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:06:48.962101 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:06:48.962101 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:06:48.962101 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:06:48.962101 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:06:48.962101 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:06:48.962101 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:06:48.962101 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:06:48.962101 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:06:48.962101 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:06:48.962101 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:06:48.962101 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:06:48.962101 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:06:48.963179 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:06:48.963179 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:06:48.963179 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:06:48.963179 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:06:48.963179 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:06:48.963179 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:06:48.963179 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:06:48.963179 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:06:48.963179 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:06:48.963179 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:06:48.963179 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:06:48.963179 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:06:48.963179 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:06:48.963179 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:06:48.963179 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:06:48.963179 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:06:48.964078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:06:48.964078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:06:48.964078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:06:48.964078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:06:48.964078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:06:48.964078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:06:48.964078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:06:48.964078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:06:48.964078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:06:48.964078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:06:48.964078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:06:48.964078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:06:48.964078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 98/199] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:06:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:06:48.964725 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e39d8-55d7-4bb6-9a77-3b66cd7cb1ce None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:48.974310 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f70a5-37c5-4519-a381-664fbf53d184 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:48.976200 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f70a5-37c5-4519-a381-664fbf53d184 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:49.027418 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:49.066938 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e39d8-55d7-4bb6-9a77-3b66cd7cb1ce None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:49.096378 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 102/200] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:06:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:06:49.097229 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f70a5-37c5-4519-a381-664fbf53d184 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:49.099860 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:49.111356 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4245066-477d-4a71-9985-94a1e435805c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:49.112076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4245066-477d-4a71-9985-94a1e435805c None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:49.112774 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4245066-477d-4a71-9985-94a1e435805c None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:49.113056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4245066-477d-4a71-9985-94a1e435805c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:49.114173 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4245066-477d-4a71-9985-94a1e435805c None admin] RBAC: Adding query filter params (role.id=5ef3464f4436446b88430cdf7cc1a3d7, scope.project.id=5fd79607efc84957a3c849d0d14a8f76, user.id=e544a558d3774c4784a48f0762e9a58f) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:49.114490 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4245066-477d-4a71-9985-94a1e435805c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:49.116660 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4245066-477d-4a71-9985-94a1e435805c None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:49.124762 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 99/201] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:06:48 2022] GET /identity/v3/role_assignments?user.id=e544a558d3774c4784a48f0762e9a58f&scope.project.id=5fd79607efc84957a3c849d0d14a8f76&role.id=5ef3464f4436446b88430cdf7cc1a3d7 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:49.125630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4245066-477d-4a71-9985-94a1e435805c None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:49.254470 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4245066-477d-4a71-9985-94a1e435805c None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:49.291401 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:49.293274 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f70a5-37c5-4519-a381-664fbf53d184 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:49.302015 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923b2f0-41b0-4e46-93a8-dc8453b37481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:49.303033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923b2f0-41b0-4e46-93a8-dc8453b37481 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:49.303371 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923b2f0-41b0-4e46-93a8-dc8453b37481 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:49.303660 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923b2f0-41b0-4e46-93a8-dc8453b37481 None admin] PATH_INFO: `/v3/projects/5fd79607efc84957a3c849d0d14a8f76` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:49.304969 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a923b2f0-41b0-4e46-93a8-dc8453b37481 None admin] RBAC: Authorizing `identity:get_project(project_id=5fd79607efc84957a3c849d0d14a8f76)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:49.307663 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a923b2f0-41b0-4e46-93a8-dc8453b37481 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:49.309774 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 100/202] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:06:49 2022] GET /identity/v3/projects/5fd79607efc84957a3c849d0d14a8f76 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:49.315484 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923b2f0-41b0-4e46-93a8-dc8453b37481 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:49.374028 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd6158-7632-4479-b09a-66e228bccf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:49.374779 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd6158-7632-4479-b09a-66e228bccf21 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:49.375328 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd6158-7632-4479-b09a-66e228bccf21 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:49.375700 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd6158-7632-4479-b09a-66e228bccf21 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:49.376532 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd6158-7632-4479-b09a-66e228bccf21 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:49.376934 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd6158-7632-4479-b09a-66e228bccf21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:49.378417 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd6158-7632-4479-b09a-66e228bccf21 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:49.394258 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 103/203] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 29 12:06:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:49.402409 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd6158-7632-4479-b09a-66e228bccf21 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:49.464498 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923b2f0-41b0-4e46-93a8-dc8453b37481 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:49.506885 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e57cc-75da-4807-8b92-b6ac7fee24b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:49.509033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e57cc-75da-4807-8b92-b6ac7fee24b4 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:49.509539 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e57cc-75da-4807-8b92-b6ac7fee24b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:49.510020 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e57cc-75da-4807-8b92-b6ac7fee24b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:49.511088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e57cc-75da-4807-8b92-b6ac7fee24b4 None admin] RBAC: Adding query filter params (role.id=b0982ad59fae4158ba9249550f6452cd, scope.project.id=5fd79607efc84957a3c849d0d14a8f76, user.id=e544a558d3774c4784a48f0762e9a58f) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:49.511671 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e57cc-75da-4807-8b92-b6ac7fee24b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:49.513400 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e57cc-75da-4807-8b92-b6ac7fee24b4 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:49.519766 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 101/204] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:06:49 2022] GET /identity/v3/role_assignments?user.id=e544a558d3774c4784a48f0762e9a58f&scope.project.id=5fd79607efc84957a3c849d0d14a8f76&role.id=b0982ad59fae4158ba9249550f6452cd => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:49.538485 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:49.582698 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd6158-7632-4479-b09a-66e228bccf21 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:49.632279 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8f9b0-79be-4813-9ccd-0ffb23022aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:49.633267 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8f9b0-79be-4813-9ccd-0ffb23022aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:49.633552 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8f9b0-79be-4813-9ccd-0ffb23022aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:49.633823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8f9b0-79be-4813-9ccd-0ffb23022aa2 None admin] PATH_INFO: `/v3/users/b5b142915920428c862f375473e6c52e` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:49.635425 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c8f9b0-79be-4813-9ccd-0ffb23022aa2 None admin] RBAC: Authorizing `identity:get_user(user_id=b5b142915920428c862f375473e6c52e)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:49.636944 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c8f9b0-79be-4813-9ccd-0ffb23022aa2 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:49.638674 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 104/205] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:06:49 2022] GET /identity/v3/users/b5b142915920428c862f375473e6c52e => generated 289 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:49.644578 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e57cc-75da-4807-8b92-b6ac7fee24b4 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:49.754595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:49.813561 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e57cc-75da-4807-8b92-b6ac7fee24b4 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:49.859030 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72b904-e126-4d74-8bab-ab3ca405913e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:49.860156 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72b904-e126-4d74-8bab-ab3ca405913e None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:49.860709 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72b904-e126-4d74-8bab-ab3ca405913e None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:49.861275 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72b904-e126-4d74-8bab-ab3ca405913e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:49.960111 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72b904-e126-4d74-8bab-ab3ca405913e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:49.962002 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72b904-e126-4d74-8bab-ab3ca405913e None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:50.037399 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:50.094247 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 102/206] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:06:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:06:50.099528 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8f9b0-79be-4813-9ccd-0ffb23022aa2 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:50.237972 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8f9b0-79be-4813-9ccd-0ffb23022aa2 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:50.279890 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:50.284329 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834312f-c1f2-4c8e-9abf-f98e2a11e8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:50.285214 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834312f-c1f2-4c8e-9abf-f98e2a11e8bf None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:50.285494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834312f-c1f2-4c8e-9abf-f98e2a11e8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:50.285804 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834312f-c1f2-4c8e-9abf-f98e2a11e8bf None admin] PATH_INFO: `/v3/projects/db721c414b9e4fec93c61aef1313fdb0` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:50.287020 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834312f-c1f2-4c8e-9abf-f98e2a11e8bf None admin] RBAC: Authorizing `identity:get_project(project_id=db721c414b9e4fec93c61aef1313fdb0)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:50.288848 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834312f-c1f2-4c8e-9abf-f98e2a11e8bf None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:50.291873 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 105/207] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:06:50 2022] GET /identity/v3/projects/db721c414b9e4fec93c61aef1313fdb0 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:50.297798 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72b904-e126-4d74-8bab-ab3ca405913e None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:50.450412 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72b904-e126-4d74-8bab-ab3ca405913e None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:50.488997 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3629e-bbf5-47f2-8e9c-e0b499673f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:50.490056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3629e-bbf5-47f2-8e9c-e0b499673f83 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:50.490538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3629e-bbf5-47f2-8e9c-e0b499673f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:50.491050 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3629e-bbf5-47f2-8e9c-e0b499673f83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:50.492074 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3629e-bbf5-47f2-8e9c-e0b499673f83 None admin] RBAC: Adding query filter params (role.id=08fb0ec8050c40ea8efd40e54fde52aa, scope.project.id=db721c414b9e4fec93c61aef1313fdb0, user.id=b5b142915920428c862f375473e6c52e) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:50.492639 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3629e-bbf5-47f2-8e9c-e0b499673f83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:50.494276 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3629e-bbf5-47f2-8e9c-e0b499673f83 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:50.500629 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 103/208] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:06:50 2022] GET /identity/v3/role_assignments?user.id=b5b142915920428c862f375473e6c52e&scope.project.id=db721c414b9e4fec93c61aef1313fdb0&role.id=08fb0ec8050c40ea8efd40e54fde52aa => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:50.810850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e9851-2e95-4256-a6f3-d12d29c36a08 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:50.811377 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e9851-2e95-4256-a6f3-d12d29c36a08 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:50.811377 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e9851-2e95-4256-a6f3-d12d29c36a08 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:50.812778 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 106/209] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:50.818118 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325320e-c098-4f8a-91eb-0bb779a8ffb9 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:50.818986 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325320e-c098-4f8a-91eb-0bb779a8ffb9 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:50.819486 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325320e-c098-4f8a-91eb-0bb779a8ffb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:50.841544 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-f325320e-c098-4f8a-91eb-0bb779a8ffb9 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:50.843144 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-f325320e-c098-4f8a-91eb-0bb779a8ffb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:50.863723 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:50.928266 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 104/210] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:06:50.955837 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e9851-2e95-4256-a6f3-d12d29c36a08 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:51.083068 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e9851-2e95-4256-a6f3-d12d29c36a08 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:51.116515 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c0f2e-b143-4f41-bbb1-f42df96ce160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:51.117846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c0f2e-b143-4f41-bbb1-f42df96ce160 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:51.118129 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c0f2e-b143-4f41-bbb1-f42df96ce160 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:51.118399 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c0f2e-b143-4f41-bbb1-f42df96ce160 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:51.121730 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f784c-6e9b-4261-a4e2-f76238617f4a None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:51.122019 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f784c-6e9b-4261-a4e2-f76238617f4a None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:51.122413 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f784c-6e9b-4261-a4e2-f76238617f4a None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:51.123996 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 105/211] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:51.128703 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f5547-2514-4cdd-a453-3887b67d5d7a None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:51.128986 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f5547-2514-4cdd-a453-3887b67d5d7a None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:51.129257 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f5547-2514-4cdd-a453-3887b67d5d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:51.140228 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c0f2e-b143-4f41-bbb1-f42df96ce160 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:06:51.148714 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-032c0f2e-b143-4f41-bbb1-f42df96ce160 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:06:51.148714 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:06:51.148714 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:06:51.148714 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:06:51.148714 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:06:51.148714 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:06:51.148714 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:06:51.148714 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:06:51.148714 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:06:51.148714 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:06:51.148714 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:06:51.148714 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:06:51.148714 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:06:51.148714 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:06:51.148714 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:06:51.148714 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:06:51.149679 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:06:51.149679 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:06:51.149679 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:06:51.149679 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:06:51.149679 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:06:51.149679 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:06:51.149679 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:06:51.149679 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:06:51.149679 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:06:51.149679 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:06:51.149679 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:06:51.149679 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:06:51.149679 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:06:51.149679 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:06:51.149679 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:06:51.149679 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:06:51.150461 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:06:51.150461 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:06:51.150461 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:06:51.150461 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:06:51.150461 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:06:51.150461 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:06:51.150461 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:06:51.150461 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:06:51.150461 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:06:51.150461 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:06:51.150461 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:06:51.150461 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:06:51.150461 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 107/212] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:06:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:06:51.155634 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-780f5547-2514-4cdd-a453-3887b67d5d7a None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:51.156137 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c0f2e-b143-4f41-bbb1-f42df96ce160 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:51.157422 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-780f5547-2514-4cdd-a453-3887b67d5d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:51.226558 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:51.258660 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 106/213] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:06:51.275883 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f5547-2514-4cdd-a453-3887b67d5d7a None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:51.276412 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c0f2e-b143-4f41-bbb1-f42df96ce160 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:51.315000 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0548d-4c69-4b50-872e-2c7cfe5acc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:51.316034 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0548d-4c69-4b50-872e-2c7cfe5acc39 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:51.316540 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0548d-4c69-4b50-872e-2c7cfe5acc39 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:51.317024 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0548d-4c69-4b50-872e-2c7cfe5acc39 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:51.317969 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0548d-4c69-4b50-872e-2c7cfe5acc39 None admin] RBAC: Adding query filter params (name=member) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:51.318474 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0548d-4c69-4b50-872e-2c7cfe5acc39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:51.320098 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0548d-4c69-4b50-872e-2c7cfe5acc39 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:51.329832 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 108/214] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 29 12:06:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:06:51.335660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0548d-4c69-4b50-872e-2c7cfe5acc39 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:51.380759 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:51.398700 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f5547-2514-4cdd-a453-3887b67d5d7a None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:51.436221 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397f36b-d40d-45b3-8d50-27451bbe8e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:51.437376 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397f36b-d40d-45b3-8d50-27451bbe8e58 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:51.437891 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397f36b-d40d-45b3-8d50-27451bbe8e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:51.438369 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397f36b-d40d-45b3-8d50-27451bbe8e58 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:51.439911 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397f36b-d40d-45b3-8d50-27451bbe8e58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:51.441619 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397f36b-d40d-45b3-8d50-27451bbe8e58 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:51.443509 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 107/215] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:06:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:06:51.447994 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0548d-4c69-4b50-872e-2c7cfe5acc39 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:51.449118 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397f36b-d40d-45b3-8d50-27451bbe8e58 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:51.471714 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:51.486289 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3dfc31-5f89-4e7d-a4b6-43289de4eac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:51.487642 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3dfc31-5f89-4e7d-a4b6-43289de4eac8 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:51.487642 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3dfc31-5f89-4e7d-a4b6-43289de4eac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:51.487845 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3dfc31-5f89-4e7d-a4b6-43289de4eac8 None admin] PATH_INFO: `/v3/users/0ef8a5d7184c41d8a07185cf7fae9fa6` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:51.502563 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3dfc31-5f89-4e7d-a4b6-43289de4eac8 None admin] RBAC: Authorizing `identity:get_user(user_id=0ef8a5d7184c41d8a07185cf7fae9fa6)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:51.504177 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3dfc31-5f89-4e7d-a4b6-43289de4eac8 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:51.510707 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 109/216] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:06:51 2022] GET /identity/v3/users/0ef8a5d7184c41d8a07185cf7fae9fa6 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:51.511701 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3dfc31-5f89-4e7d-a4b6-43289de4eac8 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:51.558156 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397f36b-d40d-45b3-8d50-27451bbe8e58 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:51.593489 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51dba7-fa7f-45d4-858a-52f8b41e1ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:51.594546 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51dba7-fa7f-45d4-858a-52f8b41e1ef4 None admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:51.595050 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51dba7-fa7f-45d4-858a-52f8b41e1ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:51.595671 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51dba7-fa7f-45d4-858a-52f8b41e1ef4 None admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:51.596584 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a51dba7-fa7f-45d4-858a-52f8b41e1ef4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:51.598247 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a51dba7-fa7f-45d4-858a-52f8b41e1ef4 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:51.621075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3dfc31-5f89-4e7d-a4b6-43289de4eac8 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:51.624768 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 108/217] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 29 12:06:51 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:06:51.663104 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a901659-b98f-440f-be44-d227033143a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:51.664003 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a901659-b98f-440f-be44-d227033143a6 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:51.665031 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a901659-b98f-440f-be44-d227033143a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:51.665464 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a901659-b98f-440f-be44-d227033143a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:51.694448 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06d7eb-51c8-40ea-b2de-7aa0aabe0e4b None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:51.695113 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06d7eb-51c8-40ea-b2de-7aa0aabe0e4b None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:51.695883 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06d7eb-51c8-40ea-b2de-7aa0aabe0e4b None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:51.698762 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 109/218] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:51.709722 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef917256-7f56-4770-a12f-bca075600380 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:51.709722 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef917256-7f56-4770-a12f-bca075600380 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:51.709722 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef917256-7f56-4770-a12f-bca075600380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:51.734048 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-ef917256-7f56-4770-a12f-bca075600380 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:51.734712 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-ef917256-7f56-4770-a12f-bca075600380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:51.737281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:51.743016 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:51.775636 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a901659-b98f-440f-be44-d227033143a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:51.777672 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a901659-b98f-440f-be44-d227033143a6 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:51.823210 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 110/219] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:06:51.846555 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef917256-7f56-4770-a12f-bca075600380 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:51.894403 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 110/220] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:06:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:06:51.900675 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a901659-b98f-440f-be44-d227033143a6 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:51.966017 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef917256-7f56-4770-a12f-bca075600380 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:51.998016 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:52.011254 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c957f1-0c81-4e93-bd1b-717f054c911e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:52.012178 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c957f1-0c81-4e93-bd1b-717f054c911e None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:52.012467 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c957f1-0c81-4e93-bd1b-717f054c911e None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:52.012746 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c957f1-0c81-4e93-bd1b-717f054c911e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:52.022476 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:52.026247 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a901659-b98f-440f-be44-d227033143a6 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:52.027694 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c957f1-0c81-4e93-bd1b-717f054c911e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:06:52.035839 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-90c957f1-0c81-4e93-bd1b-717f054c911e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:06:52.035839 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:06:52.035839 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:06:52.035839 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:06:52.035839 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:06:52.035839 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:06:52.035839 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:06:52.035839 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:06:52.035839 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:06:52.035839 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:06:52.035839 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:06:52.035839 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:06:52.035839 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:06:52.035839 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:06:52.035839 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:06:52.035839 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:06:52.036900 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:06:52.036900 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:06:52.036900 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:06:52.036900 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:06:52.036900 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:06:52.036900 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:06:52.036900 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:06:52.036900 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:06:52.036900 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:06:52.036900 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:06:52.036900 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:06:52.036900 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:06:52.036900 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:06:52.036900 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:06:52.036900 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:06:52.036900 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:06:52.038133 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:06:52.038133 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:06:52.038133 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:06:52.038133 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:06:52.038133 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:06:52.038133 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:06:52.038133 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:06:52.038133 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:06:52.038133 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:06:52.038133 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:06:52.038133 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:06:52.038133 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:06:52.039001 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 111/221] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:06:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:06:52.041962 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf49a1-5d01-4e46-a44b-fe4871c59989 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:52.042252 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf49a1-5d01-4e46-a44b-fe4871c59989 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:52.042529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf49a1-5d01-4e46-a44b-fe4871c59989 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:52.045112 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 112/222] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:52.045811 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf49a1-5d01-4e46-a44b-fe4871c59989 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:52.074700 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84bb69-c83f-414b-9bfc-cb0f824a14f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:52.075850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84bb69-c83f-414b-9bfc-cb0f824a14f2 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:52.076293 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84bb69-c83f-414b-9bfc-cb0f824a14f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:52.076570 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84bb69-c83f-414b-9bfc-cb0f824a14f2 None admin] PATH_INFO: `/v3/projects/5fd79607efc84957a3c849d0d14a8f76` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:52.077828 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84bb69-c83f-414b-9bfc-cb0f824a14f2 None admin] RBAC: Authorizing `identity:get_project(project_id=5fd79607efc84957a3c849d0d14a8f76)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:52.079459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84bb69-c83f-414b-9bfc-cb0f824a14f2 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:52.081653 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 111/223] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:06:51 2022] GET /identity/v3/projects/5fd79607efc84957a3c849d0d14a8f76 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:06:52.082782 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57224b0-11ae-42bb-a022-3485cdafabbf None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:52.083062 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57224b0-11ae-42bb-a022-3485cdafabbf None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:52.083361 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57224b0-11ae-42bb-a022-3485cdafabbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:52.103087 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-e57224b0-11ae-42bb-a022-3485cdafabbf None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:52.104192 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-e57224b0-11ae-42bb-a022-3485cdafabbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:52.177605 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf49a1-5d01-4e46-a44b-fe4871c59989 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:52.188826 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 112/224] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:06:52.191445 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57224b0-11ae-42bb-a022-3485cdafabbf None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:52.240683 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c94289-c311-43f7-a368-57c6a8029dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:52.241771 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c94289-c311-43f7-a368-57c6a8029dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:52.242220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c94289-c311-43f7-a368-57c6a8029dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:52.242626 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c94289-c311-43f7-a368-57c6a8029dc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:52.243430 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c94289-c311-43f7-a368-57c6a8029dc0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:52.243741 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c94289-c311-43f7-a368-57c6a8029dc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:52.246279 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c94289-c311-43f7-a368-57c6a8029dc0 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:52.257655 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 113/225] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:06:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:52.259754 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c94289-c311-43f7-a368-57c6a8029dc0 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:52.296047 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:52.321046 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57224b0-11ae-42bb-a022-3485cdafabbf None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:52.340919 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:52.359830 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f0492-9000-4f75-9d32-c5588deef609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:52.360483 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f0492-9000-4f75-9d32-c5588deef609 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:52.360766 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f0492-9000-4f75-9d32-c5588deef609 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:52.361040 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f0492-9000-4f75-9d32-c5588deef609 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:52.362441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f0492-9000-4f75-9d32-c5588deef609 None admin] RBAC: Adding query filter params (role.id=419e204ede334962ac80ce56c398bd4f, scope.project.id=5fd79607efc84957a3c849d0d14a8f76, user.id=0ef8a5d7184c41d8a07185cf7fae9fa6) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:52.362807 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f0492-9000-4f75-9d32-c5588deef609 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:52.364862 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f0492-9000-4f75-9d32-c5588deef609 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:52.374884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 113/226] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:06:52 2022] GET /identity/v3/role_assignments?user.id=0ef8a5d7184c41d8a07185cf7fae9fa6&scope.project.id=5fd79607efc84957a3c849d0d14a8f76&role.id=419e204ede334962ac80ce56c398bd4f => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:52.375783 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f0492-9000-4f75-9d32-c5588deef609 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:52.412246 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c94289-c311-43f7-a368-57c6a8029dc0 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:52.485594 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f5f7e-e5de-42cd-8413-346a332aa986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:52.486422 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f5f7e-e5de-42cd-8413-346a332aa986 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:52.486729 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f5f7e-e5de-42cd-8413-346a332aa986 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:52.487007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f5f7e-e5de-42cd-8413-346a332aa986 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:52.506578 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f5f7e-e5de-42cd-8413-346a332aa986 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:06:52.521965 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-e07f5f7e-e5de-42cd-8413-346a332aa986 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:06:52.521965 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:06:52.521965 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:06:52.521965 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:06:52.521965 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:06:52.521965 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:06:52.521965 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:06:52.521965 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:06:52.521965 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:06:52.521965 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:06:52.521965 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:06:52.521965 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:06:52.521965 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:06:52.521965 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:06:52.521965 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:06:52.521965 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:06:52.522987 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:06:52.522987 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:06:52.522987 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:06:52.522987 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:06:52.522987 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:06:52.522987 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:06:52.522987 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:06:52.522987 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:06:52.522987 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:06:52.522987 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:06:52.522987 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:06:52.522987 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:06:52.522987 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:06:52.522987 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:06:52.522987 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:06:52.522987 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:06:52.524364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:06:52.524364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:06:52.524364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:06:52.524364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:06:52.524364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:06:52.524364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:06:52.524364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:06:52.524364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:06:52.524364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:06:52.524364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:06:52.524364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:06:52.524364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:06:52.524991 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 114/227] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 29 12:06:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:06:52.537212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f5f7e-e5de-42cd-8413-346a332aa986 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:52.564225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f0492-9000-4f75-9d32-c5588deef609 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:52.600221 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25623c-80dd-4979-ad15-406a8a59e5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:52.601214 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25623c-80dd-4979-ad15-406a8a59e5ba None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:52.601504 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25623c-80dd-4979-ad15-406a8a59e5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:52.601807 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25623c-80dd-4979-ad15-406a8a59e5ba None admin] PATH_INFO: `/v3/users/e544a558d3774c4784a48f0762e9a58f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:52.603049 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25623c-80dd-4979-ad15-406a8a59e5ba None admin] RBAC: Authorizing `identity:get_user(user_id=e544a558d3774c4784a48f0762e9a58f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:52.604511 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25623c-80dd-4979-ad15-406a8a59e5ba None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:52.606161 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 114/228] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:06:52 2022] GET /identity/v3/users/e544a558d3774c4784a48f0762e9a58f => generated 283 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:52.611897 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25623c-80dd-4979-ad15-406a8a59e5ba None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:52.625680 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:52.723620 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25623c-80dd-4979-ad15-406a8a59e5ba None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:52.764689 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33c62d-2376-419b-8118-06cfe6fdd5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:52.765566 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33c62d-2376-419b-8118-06cfe6fdd5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:52.765849 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33c62d-2376-419b-8118-06cfe6fdd5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:52.766124 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33c62d-2376-419b-8118-06cfe6fdd5c8 None admin] PATH_INFO: `/v3/projects/5fd79607efc84957a3c849d0d14a8f76` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:52.767336 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33c62d-2376-419b-8118-06cfe6fdd5c8 None admin] RBAC: Authorizing `identity:get_project(project_id=5fd79607efc84957a3c849d0d14a8f76)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:52.768926 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33c62d-2376-419b-8118-06cfe6fdd5c8 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:52.774980 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 115/229] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:06:52 2022] GET /identity/v3/projects/5fd79607efc84957a3c849d0d14a8f76 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:52.776419 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33c62d-2376-419b-8118-06cfe6fdd5c8 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:52.810573 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f5f7e-e5de-42cd-8413-346a332aa986 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:52.843815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:52.862855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:52.882200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d7cf2-5904-45b9-829a-11cd0bdd4132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:52.883719 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d7cf2-5904-45b9-829a-11cd0bdd4132 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:52.883990 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d7cf2-5904-45b9-829a-11cd0bdd4132 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:52.884341 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d7cf2-5904-45b9-829a-11cd0bdd4132 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:52.885168 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d7cf2-5904-45b9-829a-11cd0bdd4132 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:52.885547 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d7cf2-5904-45b9-829a-11cd0bdd4132 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:52.887105 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d7cf2-5904-45b9-829a-11cd0bdd4132 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:52.888572 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33c62d-2376-419b-8118-06cfe6fdd5c8 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:52.909979 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 115/230] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:06:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:52.916094 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d7cf2-5904-45b9-829a-11cd0bdd4132 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:52.947284 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe96559-248b-48fd-8811-85a20c747d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:52.949007 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe96559-248b-48fd-8811-85a20c747d59 None admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:52.949627 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe96559-248b-48fd-8811-85a20c747d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:52.950934 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe96559-248b-48fd-8811-85a20c747d59 None admin] PATH_INFO: `/v3/projects/5fd79607efc84957a3c849d0d14a8f76/users/e544a558d3774c4784a48f0762e9a58f/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:52.956189 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe96559-248b-48fd-8811-85a20c747d59 None admin] RBAC: Authorizing `identity:create_grant(project_id=5fd79607efc84957a3c849d0d14a8f76, user_id=e544a558d3774c4784a48f0762e9a58f, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:52.959038 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe96559-248b-48fd-8811-85a20c747d59 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:52.983781 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 116/231] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 29 12:06:52 2022] PUT /identity/v3/projects/5fd79607efc84957a3c849d0d14a8f76/users/e544a558d3774c4784a48f0762e9a58f/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:06:53.074307 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d7cf2-5904-45b9-829a-11cd0bdd4132 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:53.122225 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc91c38-1ed7-446a-a2a1-31824bb04f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:53.123498 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc91c38-1ed7-446a-a2a1-31824bb04f64 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:53.123958 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc91c38-1ed7-446a-a2a1-31824bb04f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:53.124465 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc91c38-1ed7-446a-a2a1-31824bb04f64 None admin] PATH_INFO: `/v3/users/e544a558d3774c4784a48f0762e9a58f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:53.127987 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc91c38-1ed7-446a-a2a1-31824bb04f64 None admin] RBAC: Authorizing `identity:get_user(user_id=e544a558d3774c4784a48f0762e9a58f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:53.129709 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc91c38-1ed7-446a-a2a1-31824bb04f64 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:53.131748 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 116/232] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:06:52 2022] GET /identity/v3/users/e544a558d3774c4784a48f0762e9a58f => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:06:53.137487 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe96559-248b-48fd-8811-85a20c747d59 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:53.268189 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe96559-248b-48fd-8811-85a20c747d59 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:53.311850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f21b7-c5e3-44a3-87bb-1f5a265eeaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:53.313009 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f21b7-c5e3-44a3-87bb-1f5a265eeaf8 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:53.313469 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f21b7-c5e3-44a3-87bb-1f5a265eeaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:53.313919 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f21b7-c5e3-44a3-87bb-1f5a265eeaf8 None admin] PATH_INFO: `/v3/projects/5fd79607efc84957a3c849d0d14a8f76` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:53.316101 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f21b7-c5e3-44a3-87bb-1f5a265eeaf8 None admin] RBAC: Authorizing `identity:get_project(project_id=5fd79607efc84957a3c849d0d14a8f76)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:53.317788 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f21b7-c5e3-44a3-87bb-1f5a265eeaf8 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:53.319706 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 117/233] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:06:53 2022] GET /identity/v3/projects/5fd79607efc84957a3c849d0d14a8f76 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:53.326064 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc91c38-1ed7-446a-a2a1-31824bb04f64 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:53.391336 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:53.460316 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc91c38-1ed7-446a-a2a1-31824bb04f64 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:53.499475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb55a1-fb90-4e27-9578-8ff931ebb8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:53.500714 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb55a1-fb90-4e27-9578-8ff931ebb8e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:53.501218 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb55a1-fb90-4e27-9578-8ff931ebb8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:53.501690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb55a1-fb90-4e27-9578-8ff931ebb8e9 None admin] PATH_INFO: `/v3/projects/5fd79607efc84957a3c849d0d14a8f76/users/e544a558d3774c4784a48f0762e9a58f/roles/b0982ad59fae4158ba9249550f6452cd` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:53.508992 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb55a1-fb90-4e27-9578-8ff931ebb8e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=5fd79607efc84957a3c849d0d14a8f76, user_id=e544a558d3774c4784a48f0762e9a58f, role_id=b0982ad59fae4158ba9249550f6452cd)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:53.510680 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb55a1-fb90-4e27-9578-8ff931ebb8e9 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:53.531334 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 117/234] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 29 12:06:53 2022] PUT /identity/v3/projects/5fd79607efc84957a3c849d0d14a8f76/users/e544a558d3774c4784a48f0762e9a58f/roles/b0982ad59fae4158ba9249550f6452cd => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:06:54.186259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45746c6b-edeb-489c-a9ed-4f2b48be8e36 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:54.186819 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45746c6b-edeb-489c-a9ed-4f2b48be8e36 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:54.186819 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45746c6b-edeb-489c-a9ed-4f2b48be8e36 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:54.188202 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 118/235] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:54.193358 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1dbb4-d015-4a7f-878a-bdc02f12f006 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:54.193754 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1dbb4-d015-4a7f-878a-bdc02f12f006 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:54.193935 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1dbb4-d015-4a7f-878a-bdc02f12f006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:54.211773 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-00b1dbb4-d015-4a7f-878a-bdc02f12f006 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:54.212953 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-00b1dbb4-d015-4a7f-878a-bdc02f12f006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:54.308982 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 118/236] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:06:54.332116 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45746c6b-edeb-489c-a9ed-4f2b48be8e36 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:54.342760 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:54.450768 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5352d2-a5f9-41e1-b0c7-82cf4e498d3d None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:54.451006 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5352d2-a5f9-41e1-b0c7-82cf4e498d3d None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:54.451246 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5352d2-a5f9-41e1-b0c7-82cf4e498d3d None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:54.452810 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 119/237] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:06:54.457853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec27ba7-5762-4ba2-96ee-6876cc3da280 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:54.458141 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec27ba7-5762-4ba2-96ee-6876cc3da280 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:54.458420 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec27ba7-5762-4ba2-96ee-6876cc3da280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:54.484692 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-9ec27ba7-5762-4ba2-96ee-6876cc3da280 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:54.485897 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-9ec27ba7-5762-4ba2-96ee-6876cc3da280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:54.490949 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45746c6b-edeb-489c-a9ed-4f2b48be8e36 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:54.541920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a5caf-1e37-4c4c-b66f-d52464fc1203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:54.543114 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a5caf-1e37-4c4c-b66f-d52464fc1203 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:54.543601 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a5caf-1e37-4c4c-b66f-d52464fc1203 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:54.544646 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a5caf-1e37-4c4c-b66f-d52464fc1203 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:54.550913 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:54.566727 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a5caf-1e37-4c4c-b66f-d52464fc1203 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:06:54.575381 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-5a4a5caf-1e37-4c4c-b66f-d52464fc1203 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:06:54.575381 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:06:54.575381 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:06:54.575381 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:06:54.575381 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:06:54.575381 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:06:54.575381 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:06:54.575381 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:06:54.575381 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:06:54.575381 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:06:54.575381 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:06:54.575381 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:06:54.575381 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:06:54.575381 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:06:54.575381 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:06:54.575381 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:06:54.576291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:06:54.576291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:06:54.576291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:06:54.576291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:06:54.576291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:06:54.576291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:06:54.576291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:06:54.576291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:06:54.576291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:06:54.576291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:06:54.576291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:06:54.576291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:06:54.576291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:06:54.576291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:06:54.576291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:06:54.576291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:06:54.577137 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:06:54.577137 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:06:54.577137 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:06:54.577137 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:06:54.577137 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:06:54.577137 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:06:54.577137 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:06:54.577137 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:06:54.577137 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:06:54.577137 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:06:54.577137 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:06:54.577137 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:06:54.577137 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 119/238] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:06:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:06:54.587583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a5caf-1e37-4c4c-b66f-d52464fc1203 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:54.604095 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 120/239] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:06:54.639126 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec27ba7-5762-4ba2-96ee-6876cc3da280 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:54.727156 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:54.766711 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a5caf-1e37-4c4c-b66f-d52464fc1203 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:54.802404 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fe19d-8048-44f2-8d01-dfe02eef5af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:54.803253 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fe19d-8048-44f2-8d01-dfe02eef5af8 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:54.803636 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fe19d-8048-44f2-8d01-dfe02eef5af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:54.804034 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fe19d-8048-44f2-8d01-dfe02eef5af8 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:54.805422 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10fe19d-8048-44f2-8d01-dfe02eef5af8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:54.805827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10fe19d-8048-44f2-8d01-dfe02eef5af8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:54.807335 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10fe19d-8048-44f2-8d01-dfe02eef5af8 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:54.817021 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 120/240] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 29 12:06:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:54.823310 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fe19d-8048-44f2-8d01-dfe02eef5af8 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:54.911559 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec27ba7-5762-4ba2-96ee-6876cc3da280 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:54.939133 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fe19d-8048-44f2-8d01-dfe02eef5af8 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:54.950539 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b27e15-91f1-4592-8367-31c5eff11c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:54.952032 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b27e15-91f1-4592-8367-31c5eff11c88 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:54.952494 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b27e15-91f1-4592-8367-31c5eff11c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:54.952837 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b27e15-91f1-4592-8367-31c5eff11c88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:54.954299 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b27e15-91f1-4592-8367-31c5eff11c88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:54.956486 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b27e15-91f1-4592-8367-31c5eff11c88 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:54.958964 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 121/241] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:06:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:06:54.959926 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e921a5a-13ea-472e-a998-b5617dd15cda None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:54.962820 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e921a5a-13ea-472e-a998-b5617dd15cda None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:54.963244 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e921a5a-13ea-472e-a998-b5617dd15cda None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:54.964948 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 122/242] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:54.965676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e921a5a-13ea-472e-a998-b5617dd15cda None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:54.977027 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:54.986289 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f2756-ff7b-4684-821a-8ce661766bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:54.987427 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f2756-ff7b-4684-821a-8ce661766bbd None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:54.987997 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f2756-ff7b-4684-821a-8ce661766bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:54.988441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f2756-ff7b-4684-821a-8ce661766bbd None admin] PATH_INFO: `/v3/users/111c4a1e64344a79a07e74427b87f85d` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:55.004207 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f2756-ff7b-4684-821a-8ce661766bbd None admin] RBAC: Authorizing `identity:get_user(user_id=111c4a1e64344a79a07e74427b87f85d)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:55.006002 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f2756-ff7b-4684-821a-8ce661766bbd None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:55.008578 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 121/243] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:06:54 2022] GET /identity/v3/users/111c4a1e64344a79a07e74427b87f85d => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:55.010155 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6eddd-5bf8-4337-b444-91d43b2de536 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:55.010764 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6eddd-5bf8-4337-b444-91d43b2de536 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:55.011241 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6eddd-5bf8-4337-b444-91d43b2de536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:55.015900 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:55.029495 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-55d6eddd-5bf8-4337-b444-91d43b2de536 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:55.030933 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-55d6eddd-5bf8-4337-b444-91d43b2de536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:55.100805 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e921a5a-13ea-472e-a998-b5617dd15cda None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:55.109242 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 122/244] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:06:55.115735 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6eddd-5bf8-4337-b444-91d43b2de536 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:55.138310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4618631-0958-438e-a6c4-1a08a154117d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:55.139078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4618631-0958-438e-a6c4-1a08a154117d None admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:55.139410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4618631-0958-438e-a6c4-1a08a154117d None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:55.139685 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4618631-0958-438e-a6c4-1a08a154117d None admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:55.140589 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4618631-0958-438e-a6c4-1a08a154117d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:55.148961 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4618631-0958-438e-a6c4-1a08a154117d None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:55.166910 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 123/245] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 29 12:06:54 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:06:55.176708 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4618631-0958-438e-a6c4-1a08a154117d None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:55.277138 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6eddd-5bf8-4337-b444-91d43b2de536 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:55.311646 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:55.350929 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f00ec-da33-4dcb-b182-2b7a45992013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:55.352135 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f00ec-da33-4dcb-b182-2b7a45992013 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:55.352514 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f00ec-da33-4dcb-b182-2b7a45992013 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:55.352789 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f00ec-da33-4dcb-b182-2b7a45992013 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:55.378994 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:55.390895 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4618631-0958-438e-a6c4-1a08a154117d None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:55.435879 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f00ec-da33-4dcb-b182-2b7a45992013 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:55.437449 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2c2e9-9f78-4672-8310-68f52a3417fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:55.437873 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f00ec-da33-4dcb-b182-2b7a45992013 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:55.438476 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2c2e9-9f78-4672-8310-68f52a3417fc None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:55.438894 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2c2e9-9f78-4672-8310-68f52a3417fc None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:55.439261 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2c2e9-9f78-4672-8310-68f52a3417fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:55.452609 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2c2e9-9f78-4672-8310-68f52a3417fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:06:55.462123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-96d2c2e9-9f78-4672-8310-68f52a3417fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:06:55.462123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:06:55.462123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:06:55.462123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:06:55.462123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:06:55.462123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:06:55.462123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:06:55.462123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:06:55.462123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:06:55.462123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:06:55.462123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:06:55.462123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:06:55.462123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:06:55.462123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:06:55.462123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:06:55.462123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:06:55.463063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:06:55.463063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:06:55.463063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:06:55.463063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:06:55.463063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:06:55.463063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:06:55.463063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:06:55.463063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:06:55.463063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:06:55.463063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:06:55.463063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:06:55.463063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:06:55.463063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:06:55.463063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:06:55.463063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:06:55.463063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:06:55.463974 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:06:55.463974 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:06:55.463974 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:06:55.463974 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:06:55.463974 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:06:55.463974 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:06:55.463974 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:06:55.463974 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:06:55.463974 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:06:55.463974 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:06:55.463974 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:06:55.463974 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:06:55.463974 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 124/246] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:06:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:06:55.471182 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2c2e9-9f78-4672-8310-68f52a3417fc None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:55.558716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 123/247] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:06:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:06:55.559987 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4312ef-6a4c-479e-8e24-1c7d631c0082 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:55.560276 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4312ef-6a4c-479e-8e24-1c7d631c0082 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:55.560558 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4312ef-6a4c-479e-8e24-1c7d631c0082 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:55.561951 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 124/248] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:55.565678 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4312ef-6a4c-479e-8e24-1c7d631c0082 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:55.588915 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:55.609750 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2c2e9-9f78-4672-8310-68f52a3417fc None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:55.653634 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c477ca-0ad1-4239-a216-77da6b8d52b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:55.654420 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c477ca-0ad1-4239-a216-77da6b8d52b0 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:55.654904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c477ca-0ad1-4239-a216-77da6b8d52b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:55.655255 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c477ca-0ad1-4239-a216-77da6b8d52b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:55.656015 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c477ca-0ad1-4239-a216-77da6b8d52b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:55.656325 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c477ca-0ad1-4239-a216-77da6b8d52b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:55.657719 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c477ca-0ad1-4239-a216-77da6b8d52b0 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:55.669475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 125/249] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 29 12:06:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:55.670841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b72a9-3222-4919-99f7-1eff7b9e6776 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:55.671136 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b72a9-3222-4919-99f7-1eff7b9e6776 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:55.671415 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b72a9-3222-4919-99f7-1eff7b9e6776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:55.689128 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-163b72a9-3222-4919-99f7-1eff7b9e6776 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:55.690437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-163b72a9-3222-4919-99f7-1eff7b9e6776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:55.697978 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4312ef-6a4c-479e-8e24-1c7d631c0082 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:55.704071 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:55.736011 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55976545-35ae-4664-92c2-9eaf0c20206e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:55.736891 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55976545-35ae-4664-92c2-9eaf0c20206e None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:55.737176 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55976545-35ae-4664-92c2-9eaf0c20206e None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:55.737460 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55976545-35ae-4664-92c2-9eaf0c20206e None admin] PATH_INFO: `/v3/projects/5fd79607efc84957a3c849d0d14a8f76` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:55.739461 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55976545-35ae-4664-92c2-9eaf0c20206e None admin] RBAC: Authorizing `identity:get_project(project_id=5fd79607efc84957a3c849d0d14a8f76)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:55.740928 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55976545-35ae-4664-92c2-9eaf0c20206e None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:55.742727 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 125/250] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:06:55 2022] GET /identity/v3/projects/5fd79607efc84957a3c849d0d14a8f76 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:55.743572 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55976545-35ae-4664-92c2-9eaf0c20206e None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:55.785519 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 126/251] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:06:55.785519 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b72a9-3222-4919-99f7-1eff7b9e6776 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:55.864308 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:55.893690 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55976545-35ae-4664-92c2-9eaf0c20206e None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:55.910338 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b72a9-3222-4919-99f7-1eff7b9e6776 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:55.930538 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e9c3a-237e-4534-aa53-bb506e7d977a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:55.931276 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e9c3a-237e-4534-aa53-bb506e7d977a None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:55.931685 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e9c3a-237e-4534-aa53-bb506e7d977a None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:55.932112 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e9c3a-237e-4534-aa53-bb506e7d977a None admin] PATH_INFO: `/v3/users/0ef8a5d7184c41d8a07185cf7fae9fa6` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:55.933367 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e9c3a-237e-4534-aa53-bb506e7d977a None admin] RBAC: Authorizing `identity:get_user(user_id=0ef8a5d7184c41d8a07185cf7fae9fa6)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:55.934977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e9c3a-237e-4534-aa53-bb506e7d977a None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:55.937032 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 126/252] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:06:55 2022] GET /identity/v3/users/0ef8a5d7184c41d8a07185cf7fae9fa6 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:55.938288 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e9c3a-237e-4534-aa53-bb506e7d977a None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:55.966026 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0048d-f688-49eb-a5f3-d00bc035e90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:55.966765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0048d-f688-49eb-a5f3-d00bc035e90f None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:55.967049 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0048d-f688-49eb-a5f3-d00bc035e90f None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:55.967547 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0048d-f688-49eb-a5f3-d00bc035e90f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:55.968387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0048d-f688-49eb-a5f3-d00bc035e90f None admin] RBAC: Adding query filter params (role.id=08fb0ec8050c40ea8efd40e54fde52aa, scope.project.id=5fd79607efc84957a3c849d0d14a8f76, user.id=111c4a1e64344a79a07e74427b87f85d) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:55.968702 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0048d-f688-49eb-a5f3-d00bc035e90f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:55.971899 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0048d-f688-49eb-a5f3-d00bc035e90f None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:55.980975 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 127/253] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:06:55 2022] GET /identity/v3/role_assignments?user.id=111c4a1e64344a79a07e74427b87f85d&scope.project.id=5fd79607efc84957a3c849d0d14a8f76&role.id=08fb0ec8050c40ea8efd40e54fde52aa => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:55.981784 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0048d-f688-49eb-a5f3-d00bc035e90f None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:56.005807 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:56.168876 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e9c3a-237e-4534-aa53-bb506e7d977a None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:56.238900 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0048d-f688-49eb-a5f3-d00bc035e90f None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:56.243526 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a028063-4eb5-402a-ab10-c8d30e3700aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:56.244337 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a028063-4eb5-402a-ab10-c8d30e3700aa None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:56.244618 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a028063-4eb5-402a-ab10-c8d30e3700aa None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:56.244890 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a028063-4eb5-402a-ab10-c8d30e3700aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:56.265048 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a028063-4eb5-402a-ab10-c8d30e3700aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:06:56.272717 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-5a028063-4eb5-402a-ab10-c8d30e3700aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:06:56.272717 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:06:56.272717 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:06:56.272717 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:06:56.272717 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:06:56.272717 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:06:56.272717 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:06:56.272717 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:06:56.272717 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:06:56.272717 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:06:56.272717 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:06:56.272717 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:06:56.272717 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:06:56.272717 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:06:56.272717 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:06:56.272717 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:06:56.274243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:06:56.274243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:06:56.274243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:06:56.274243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:06:56.274243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:06:56.274243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:06:56.274243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:06:56.274243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:06:56.274243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:06:56.274243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:06:56.274243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:06:56.274243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:06:56.274243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:06:56.274243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:06:56.274243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:06:56.274243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:06:56.275070 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:06:56.275070 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:06:56.275070 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:06:56.275070 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:06:56.275070 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:06:56.275070 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:06:56.275070 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:06:56.275070 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:06:56.275070 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:06:56.275070 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:06:56.275070 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:06:56.275070 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:06:56.275070 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 127/254] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:06:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:06:56.276184 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96b4e9-a0ae-44af-b39a-156dfa9f411f None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:56.276184 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96b4e9-a0ae-44af-b39a-156dfa9f411f None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:56.276404 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96b4e9-a0ae-44af-b39a-156dfa9f411f None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:56.277733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 128/255] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:56.282364 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96b4e9-a0ae-44af-b39a-156dfa9f411f None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:56.298540 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:56.307431 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99dad0-1384-4bf8-acec-b802f7de804c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:56.308362 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99dad0-1384-4bf8-acec-b802f7de804c None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:56.308640 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99dad0-1384-4bf8-acec-b802f7de804c None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:56.308913 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99dad0-1384-4bf8-acec-b802f7de804c None admin] PATH_INFO: `/v3/projects/5fd79607efc84957a3c849d0d14a8f76` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:56.310178 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99dad0-1384-4bf8-acec-b802f7de804c None admin] RBAC: Authorizing `identity:get_project(project_id=5fd79607efc84957a3c849d0d14a8f76)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:56.311701 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99dad0-1384-4bf8-acec-b802f7de804c None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:56.313762 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 128/256] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:06:55 2022] GET /identity/v3/projects/5fd79607efc84957a3c849d0d14a8f76 => generated 302 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:56.315051 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391195e7-f781-4887-b0b8-37dc790c29a2 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:56.315283 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391195e7-f781-4887-b0b8-37dc790c29a2 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:56.315604 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391195e7-f781-4887-b0b8-37dc790c29a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:56.347515 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-391195e7-f781-4887-b0b8-37dc790c29a2 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:56.348793 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-391195e7-f781-4887-b0b8-37dc790c29a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:56.397745 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96b4e9-a0ae-44af-b39a-156dfa9f411f None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:56.467284 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 129/257] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:06:56.475001 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391195e7-f781-4887-b0b8-37dc790c29a2 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:56.489106 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:56.495970 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c174d30-38fa-4b24-9823-5022c061ef5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:56.496665 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c174d30-38fa-4b24-9823-5022c061ef5a None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:56.496948 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c174d30-38fa-4b24-9823-5022c061ef5a None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:56.497226 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c174d30-38fa-4b24-9823-5022c061ef5a None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:56.498114 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c174d30-38fa-4b24-9823-5022c061ef5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:56.498559 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c174d30-38fa-4b24-9823-5022c061ef5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:56.501315 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c174d30-38fa-4b24-9823-5022c061ef5a None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:56.531191 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 129/258] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:06:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:56.534368 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c174d30-38fa-4b24-9823-5022c061ef5a None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:56.605609 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391195e7-f781-4887-b0b8-37dc790c29a2 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:56.646498 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03622739-a19e-4865-8bf5-2145d9716709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:56.647766 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03622739-a19e-4865-8bf5-2145d9716709 None admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:56.648302 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03622739-a19e-4865-8bf5-2145d9716709 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:56.648776 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03622739-a19e-4865-8bf5-2145d9716709 None admin] PATH_INFO: `/v3/projects/5fd79607efc84957a3c849d0d14a8f76/users/0ef8a5d7184c41d8a07185cf7fae9fa6/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:56.650989 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03622739-a19e-4865-8bf5-2145d9716709 None admin] RBAC: Authorizing `identity:create_grant(project_id=5fd79607efc84957a3c849d0d14a8f76, user_id=0ef8a5d7184c41d8a07185cf7fae9fa6, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:56.653184 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03622739-a19e-4865-8bf5-2145d9716709 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:56.671371 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 130/259] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 29 12:06:56 2022] PUT /identity/v3/projects/5fd79607efc84957a3c849d0d14a8f76/users/0ef8a5d7184c41d8a07185cf7fae9fa6/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:06:56.673120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03622739-a19e-4865-8bf5-2145d9716709 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:56.724739 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:56.799607 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c174d30-38fa-4b24-9823-5022c061ef5a None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:56.807941 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:56.863976 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03622739-a19e-4865-8bf5-2145d9716709 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:56.886480 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec53be-b1df-43c3-b83b-9536b088453a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:56.887335 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec53be-b1df-43c3-b83b-9536b088453a None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:56.887619 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec53be-b1df-43c3-b83b-9536b088453a None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:56.887894 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec53be-b1df-43c3-b83b-9536b088453a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:56.924845 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec53be-b1df-43c3-b83b-9536b088453a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:06:56.927315 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d6cd1-f0b5-4149-a05f-b79703cfbd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:56.928438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d6cd1-f0b5-4149-a05f-b79703cfbd16 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:56.928925 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d6cd1-f0b5-4149-a05f-b79703cfbd16 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:56.929403 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d6cd1-f0b5-4149-a05f-b79703cfbd16 None admin] PATH_INFO: `/v3/users/e544a558d3774c4784a48f0762e9a58f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:56.933631 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-3dec53be-b1df-43c3-b83b-9536b088453a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:06:56.933631 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:06:56.933631 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:06:56.933631 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:06:56.933631 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:06:56.933631 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:06:56.933631 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:06:56.933631 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:06:56.933631 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:06:56.933631 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:06:56.933631 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:06:56.933631 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:06:56.933631 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:06:56.933631 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:06:56.933631 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:06:56.933631 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:06:56.934782 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:06:56.934782 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:06:56.934782 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:06:56.934782 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:06:56.934782 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:06:56.934782 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:06:56.934782 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:06:56.934782 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:06:56.934782 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:06:56.934782 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:06:56.934782 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:06:56.934782 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:06:56.934782 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:06:56.934782 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:06:56.934782 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:06:56.934782 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:06:56.935863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:06:56.935863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:06:56.935863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:06:56.935863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:06:56.935863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:06:56.935863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:06:56.935863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:06:56.935863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:06:56.935863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:06:56.935863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:06:56.935863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:06:56.935863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:06:56.935863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 130/260] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 29 12:06:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:06:56.937552 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3d6cd1-f0b5-4149-a05f-b79703cfbd16 None admin] RBAC: Authorizing `identity:get_user(user_id=e544a558d3774c4784a48f0762e9a58f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:56.941505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3d6cd1-f0b5-4149-a05f-b79703cfbd16 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:56.941505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 131/261] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:06:56 2022] GET /identity/v3/users/e544a558d3774c4784a48f0762e9a58f => generated 283 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:56.942857 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec53be-b1df-43c3-b83b-9536b088453a None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:56.947083 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d6cd1-f0b5-4149-a05f-b79703cfbd16 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:57.123632 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec53be-b1df-43c3-b83b-9536b088453a None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:57.142857 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d6cd1-f0b5-4149-a05f-b79703cfbd16 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:57.186259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bc63b-331b-42a3-9332-d0808a09ab69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:57.187090 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bc63b-331b-42a3-9332-d0808a09ab69 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:57.187380 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bc63b-331b-42a3-9332-d0808a09ab69 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:57.187658 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bc63b-331b-42a3-9332-d0808a09ab69 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:57.188413 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945bc63b-331b-42a3-9332-d0808a09ab69 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:57.188724 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945bc63b-331b-42a3-9332-d0808a09ab69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:57.190126 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945bc63b-331b-42a3-9332-d0808a09ab69 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:57.192225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:57.206628 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 131/262] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:06:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:57.209568 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ccff2f-8af6-4946-a220-bcce69c3cce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:57.210226 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccff2f-8af6-4946-a220-bcce69c3cce4 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:57.210509 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccff2f-8af6-4946-a220-bcce69c3cce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:57.210841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccff2f-8af6-4946-a220-bcce69c3cce4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:57.212483 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bc63b-331b-42a3-9332-d0808a09ab69 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:57.218679 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:57.297696 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ccff2f-8af6-4946-a220-bcce69c3cce4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:57.299203 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ccff2f-8af6-4946-a220-bcce69c3cce4 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:57.373565 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bc63b-331b-42a3-9332-d0808a09ab69 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:57.441319 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed57294-e9b9-4038-bac2-b774dab86390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:57.442619 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed57294-e9b9-4038-bac2-b774dab86390 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:57.446667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed57294-e9b9-4038-bac2-b774dab86390 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:57.446667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed57294-e9b9-4038-bac2-b774dab86390 None admin] PATH_INFO: `/v3/users/e544a558d3774c4784a48f0762e9a58f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:57.447681 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed57294-e9b9-4038-bac2-b774dab86390 None admin] RBAC: Authorizing `identity:get_user(user_id=e544a558d3774c4784a48f0762e9a58f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:57.449168 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed57294-e9b9-4038-bac2-b774dab86390 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:57.451257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 132/263] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:06:57 2022] GET /identity/v3/users/e544a558d3774c4784a48f0762e9a58f => generated 283 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:57.456773 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed57294-e9b9-4038-bac2-b774dab86390 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:57.535429 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:57.566082 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 132/264] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:06:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 12:06:57.574086 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ccff2f-8af6-4946-a220-bcce69c3cce4 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:57.602901 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed57294-e9b9-4038-bac2-b774dab86390 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:57.653783 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:57.696268 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bcf26-b0e7-4bb2-a3e5-f3f1d9743238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:57.697286 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bcf26-b0e7-4bb2-a3e5-f3f1d9743238 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:57.697765 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bcf26-b0e7-4bb2-a3e5-f3f1d9743238 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:57.698235 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bcf26-b0e7-4bb2-a3e5-f3f1d9743238 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:57.803408 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ccff2f-8af6-4946-a220-bcce69c3cce4 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:57.876788 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154bcf26-b0e7-4bb2-a3e5-f3f1d9743238 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:57.878276 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154bcf26-b0e7-4bb2-a3e5-f3f1d9743238 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:57.891831 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09954666-f903-4266-97c1-5a4c3803710a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:57.892708 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09954666-f903-4266-97c1-5a4c3803710a None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:57.892991 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09954666-f903-4266-97c1-5a4c3803710a None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:57.893261 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09954666-f903-4266-97c1-5a4c3803710a None admin] PATH_INFO: `/v3/projects/5fd79607efc84957a3c849d0d14a8f76` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:57.894493 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09954666-f903-4266-97c1-5a4c3803710a None admin] RBAC: Authorizing `identity:get_project(project_id=5fd79607efc84957a3c849d0d14a8f76)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:57.896002 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09954666-f903-4266-97c1-5a4c3803710a None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:57.898028 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 133/265] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:06:57 2022] GET /identity/v3/projects/5fd79607efc84957a3c849d0d14a8f76 => generated 302 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:06:57.903968 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09954666-f903-4266-97c1-5a4c3803710a None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:58.015088 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:58.095889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 133/266] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:06:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:06:58.102918 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bcf26-b0e7-4bb2-a3e5-f3f1d9743238 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:58.105996 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09954666-f903-4266-97c1-5a4c3803710a None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:58.109580 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:58.196283 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a685e5-66c3-4c02-99d0-fa63db0b621e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:58.196955 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a685e5-66c3-4c02-99d0-fa63db0b621e None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:58.197236 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a685e5-66c3-4c02-99d0-fa63db0b621e None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:58.197509 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a685e5-66c3-4c02-99d0-fa63db0b621e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:58.198351 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a685e5-66c3-4c02-99d0-fa63db0b621e None admin] RBAC: Adding query filter params (role.id=5ef3464f4436446b88430cdf7cc1a3d7, scope.project.id=5fd79607efc84957a3c849d0d14a8f76, user.id=e544a558d3774c4784a48f0762e9a58f) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:58.198690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a685e5-66c3-4c02-99d0-fa63db0b621e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:58.200155 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a685e5-66c3-4c02-99d0-fa63db0b621e None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:58.210178 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 134/267] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:06:57 2022] GET /identity/v3/role_assignments?user.id=e544a558d3774c4784a48f0762e9a58f&scope.project.id=5fd79607efc84957a3c849d0d14a8f76&role.id=5ef3464f4436446b88430cdf7cc1a3d7 => generated 608 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:06:58.288585 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15baeec-73c5-4375-9636-b538ac700bd0 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:58.290474 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15baeec-73c5-4375-9636-b538ac700bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:58.290474 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15baeec-73c5-4375-9636-b538ac700bd0 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:58.290905 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 135/268] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:06:58.310843 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bcf26-b0e7-4bb2-a3e5-f3f1d9743238 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:58.316627 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecb6e7-e653-488d-baf6-b5d780971bb2 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:58.316918 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecb6e7-e653-488d-baf6-b5d780971bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:58.317201 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecb6e7-e653-488d-baf6-b5d780971bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:58.354180 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-8aecb6e7-e653-488d-baf6-b5d780971bb2 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:58.355526 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-8aecb6e7-e653-488d-baf6-b5d780971bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:58.380226 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ac5dd-ab21-4f16-bc6c-8a8d789e6b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:58.381872 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ac5dd-ab21-4f16-bc6c-8a8d789e6b59 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:58.382390 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ac5dd-ab21-4f16-bc6c-8a8d789e6b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:58.383424 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ac5dd-ab21-4f16-bc6c-8a8d789e6b59 None admin] PATH_INFO: `/v3/projects/5fd79607efc84957a3c849d0d14a8f76` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:58.388225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ac5dd-ab21-4f16-bc6c-8a8d789e6b59 None admin] RBAC: Authorizing `identity:get_project(project_id=5fd79607efc84957a3c849d0d14a8f76)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:58.390554 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ac5dd-ab21-4f16-bc6c-8a8d789e6b59 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:58.396822 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 134/269] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:06:58 2022] GET /identity/v3/projects/5fd79607efc84957a3c849d0d14a8f76 => generated 302 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:06:58.402238 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ac5dd-ab21-4f16-bc6c-8a8d789e6b59 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:58.458630 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:58.477133 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 136/270] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:06:58.483031 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ef77e-9698-44d8-b397-f6a05f894d3b None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:58.483344 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ef77e-9698-44d8-b397-f6a05f894d3b None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:58.483623 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ef77e-9698-44d8-b397-f6a05f894d3b None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:58.485460 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 137/271] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:58.492925 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25396191-eadd-48ea-b9f9-622910c459c4 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:58.493211 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25396191-eadd-48ea-b9f9-622910c459c4 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:58.493489 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25396191-eadd-48ea-b9f9-622910c459c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:58.517787 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-25396191-eadd-48ea-b9f9-622910c459c4 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:58.518744 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-25396191-eadd-48ea-b9f9-622910c459c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:58.565643 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ac5dd-ab21-4f16-bc6c-8a8d789e6b59 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:58.602109 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 138/272] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:06:58.604228 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25396191-eadd-48ea-b9f9-622910c459c4 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:58.629194 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de98a3-b9de-4ca3-b384-8c81b651b37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:58.630249 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de98a3-b9de-4ca3-b384-8c81b651b37b None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:58.632093 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de98a3-b9de-4ca3-b384-8c81b651b37b None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:58.633279 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de98a3-b9de-4ca3-b384-8c81b651b37b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:58.635013 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de98a3-b9de-4ca3-b384-8c81b651b37b None admin] RBAC: Adding query filter params (role.id=b0982ad59fae4158ba9249550f6452cd, scope.project.id=5fd79607efc84957a3c849d0d14a8f76, user.id=e544a558d3774c4784a48f0762e9a58f) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:58.635336 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de98a3-b9de-4ca3-b384-8c81b651b37b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:58.636879 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de98a3-b9de-4ca3-b384-8c81b651b37b None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:58.643983 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 135/273] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:06:58 2022] GET /identity/v3/role_assignments?user.id=e544a558d3774c4784a48f0762e9a58f&scope.project.id=5fd79607efc84957a3c849d0d14a8f76&role.id=b0982ad59fae4158ba9249550f6452cd => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:06:58.644796 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de98a3-b9de-4ca3-b384-8c81b651b37b None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:58.654624 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:58.751980 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25396191-eadd-48ea-b9f9-622910c459c4 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:58.754894 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:58.764245 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de98a3-b9de-4ca3-b384-8c81b651b37b None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:58.794391 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3cc8d-7fdb-4ee6-ae7e-96f5b5c6b773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:58.795626 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3cc8d-7fdb-4ee6-ae7e-96f5b5c6b773 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:58.796209 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3cc8d-7fdb-4ee6-ae7e-96f5b5c6b773 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:58.796591 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3cc8d-7fdb-4ee6-ae7e-96f5b5c6b773 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:58.808650 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13237da1-5be1-41f5-91f2-989487cf963c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:58.809687 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13237da1-5be1-41f5-91f2-989487cf963c None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:58.810114 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13237da1-5be1-41f5-91f2-989487cf963c None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:58.810525 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13237da1-5be1-41f5-91f2-989487cf963c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:58.813346 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13237da1-5be1-41f5-91f2-989487cf963c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:58.814158 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3cc8d-7fdb-4ee6-ae7e-96f5b5c6b773 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:06:58.815298 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13237da1-5be1-41f5-91f2-989487cf963c None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:58.817827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 136/274] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:06:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:58.825285 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13237da1-5be1-41f5-91f2-989487cf963c None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:58.825940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-1de3cc8d-7fdb-4ee6-ae7e-96f5b5c6b773 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:06:58.825940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:06:58.825940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:06:58.825940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:06:58.825940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:06:58.825940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:06:58.825940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:06:58.825940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:06:58.825940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:06:58.825940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:06:58.825940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:06:58.825940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:06:58.825940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:06:58.825940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:06:58.825940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:06:58.825940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:06:58.826843 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:06:58.826843 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:06:58.826843 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:06:58.826843 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:06:58.826843 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:06:58.826843 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:06:58.826843 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:06:58.826843 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:06:58.826843 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:06:58.826843 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:06:58.826843 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:06:58.826843 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:06:58.826843 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:06:58.826843 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:06:58.826843 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:06:58.826843 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:06:58.827646 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:06:58.827646 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:06:58.827646 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:06:58.827646 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:06:58.827646 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:06:58.827646 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:06:58.827646 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:06:58.827646 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:06:58.827646 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:06:58.827646 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:06:58.827646 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:06:58.827646 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:06:58.833082 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 139/275] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:06:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:06:58.834517 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3cc8d-7fdb-4ee6-ae7e-96f5b5c6b773 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:58.941079 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13237da1-5be1-41f5-91f2-989487cf963c None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:58.944726 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:58.951840 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3cc8d-7fdb-4ee6-ae7e-96f5b5c6b773 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:58.981288 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9469c-a440-4068-a5c3-834e2f07713b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:58.981970 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9469c-a440-4068-a5c3-834e2f07713b None admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:58.982255 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9469c-a440-4068-a5c3-834e2f07713b None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:58.982534 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9469c-a440-4068-a5c3-834e2f07713b None admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:58.983281 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9469c-a440-4068-a5c3-834e2f07713b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:58.984761 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9469c-a440-4068-a5c3-834e2f07713b None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:58.991643 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca20eeb-4fb2-4c24-8e0c-ded27b287cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:58.992981 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca20eeb-4fb2-4c24-8e0c-ded27b287cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:58.993262 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca20eeb-4fb2-4c24-8e0c-ded27b287cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:58.993961 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca20eeb-4fb2-4c24-8e0c-ded27b287cd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:58.995129 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca20eeb-4fb2-4c24-8e0c-ded27b287cd9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:58.995439 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca20eeb-4fb2-4c24-8e0c-ded27b287cd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:58.997300 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca20eeb-4fb2-4c24-8e0c-ded27b287cd9 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:59.009799 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 137/276] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 29 12:06:58 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:06:59.009799 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f025df-2e2d-4ba1-8838-5b3450553068 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:59.009799 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f025df-2e2d-4ba1-8838-5b3450553068 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:59.010113 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f025df-2e2d-4ba1-8838-5b3450553068 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:59.011236 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 140/277] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 29 12:06:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:59.015514 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca20eeb-4fb2-4c24-8e0c-ded27b287cd9 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:59.016870 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 138/278] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:59.024579 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9601a52-be6d-4eda-ad12-c66833b7c0d3 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:59.025190 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9601a52-be6d-4eda-ad12-c66833b7c0d3 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:59.026299 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9601a52-be6d-4eda-ad12-c66833b7c0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:59.051236 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-a9601a52-be6d-4eda-ad12-c66833b7c0d3 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:59.053483 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-a9601a52-be6d-4eda-ad12-c66833b7c0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:59.077438 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:59.157874 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 139/279] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:06:59.163178 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca20eeb-4fb2-4c24-8e0c-ded27b287cd9 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:59.183436 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9601a52-be6d-4eda-ad12-c66833b7c0d3 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:59.207702 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67b2dd-b678-437b-b8eb-32f7404edc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:59.208973 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67b2dd-b678-437b-b8eb-32f7404edc3f None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:59.209735 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67b2dd-b678-437b-b8eb-32f7404edc3f None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:59.210230 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67b2dd-b678-437b-b8eb-32f7404edc3f None admin] PATH_INFO: `/v3/users/c8628ceaefbb4408a88bef358d13f2bc` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:59.229993 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67b2dd-b678-437b-b8eb-32f7404edc3f None admin] RBAC: Authorizing `identity:get_user(user_id=c8628ceaefbb4408a88bef358d13f2bc)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:59.232392 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67b2dd-b678-437b-b8eb-32f7404edc3f None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:59.234942 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 141/280] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:06:59 2022] GET /identity/v3/users/c8628ceaefbb4408a88bef358d13f2bc => generated 293 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:06:59.240762 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67b2dd-b678-437b-b8eb-32f7404edc3f None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:59.262394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:59.306278 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9601a52-be6d-4eda-ad12-c66833b7c0d3 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:59.353246 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0e3d3-ee24-48e7-bed5-86d5530c137b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:59.354496 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0e3d3-ee24-48e7-bed5-86d5530c137b None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:59.354815 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0e3d3-ee24-48e7-bed5-86d5530c137b None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:59.355159 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0e3d3-ee24-48e7-bed5-86d5530c137b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:59.367367 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0e3d3-ee24-48e7-bed5-86d5530c137b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:06:59.370502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67b2dd-b678-437b-b8eb-32f7404edc3f None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:59.376178 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-c4f0e3d3-ee24-48e7-bed5-86d5530c137b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:06:59.376178 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:06:59.376178 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:06:59.376178 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:06:59.376178 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:06:59.376178 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:06:59.376178 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:06:59.376178 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:06:59.376178 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:06:59.376178 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:06:59.376178 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:06:59.376178 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:06:59.376178 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:06:59.376178 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:06:59.376178 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:06:59.376178 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:06:59.377087 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:06:59.377087 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:06:59.377087 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:06:59.377087 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:06:59.377087 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:06:59.377087 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:06:59.377087 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:06:59.377087 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:06:59.377087 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:06:59.377087 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:06:59.377087 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:06:59.377087 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:06:59.377087 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:06:59.377087 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:06:59.377087 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:06:59.377087 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:06:59.377913 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:06:59.377913 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:06:59.377913 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:06:59.377913 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:06:59.377913 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:06:59.377913 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:06:59.377913 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:06:59.377913 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:06:59.377913 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:06:59.377913 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:06:59.377913 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:06:59.377913 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:06:59.377913 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 140/281] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:06:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:06:59.383520 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0e3d3-ee24-48e7-bed5-86d5530c137b None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:59.396476 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:59.411220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484d6a4-0fd5-4c06-99fc-0ea30f6d843c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:59.412392 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484d6a4-0fd5-4c06-99fc-0ea30f6d843c None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:59.413427 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484d6a4-0fd5-4c06-99fc-0ea30f6d843c None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:59.414559 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484d6a4-0fd5-4c06-99fc-0ea30f6d843c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:59.415928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484d6a4-0fd5-4c06-99fc-0ea30f6d843c None admin] RBAC: Adding query filter params (role.id=419e204ede334962ac80ce56c398bd4f, user.id=c8628ceaefbb4408a88bef358d13f2bc, scope.system=all) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:59.416607 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484d6a4-0fd5-4c06-99fc-0ea30f6d843c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:59.418427 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484d6a4-0fd5-4c06-99fc-0ea30f6d843c None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:59.424597 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 142/282] 10.222.0.13 () {56 vars in 1308 bytes} [Wed Jun 29 12:06:59 2022] GET /identity/v3/role_assignments?user.id=c8628ceaefbb4408a88bef358d13f2bc&scope.system=all&role.id=419e204ede334962ac80ce56c398bd4f => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:06:59.499088 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0e3d3-ee24-48e7-bed5-86d5530c137b None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:59.536526 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4255ef-6a63-4254-9148-6bfa1c84414c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:59.537213 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4255ef-6a63-4254-9148-6bfa1c84414c None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:59.537490 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4255ef-6a63-4254-9148-6bfa1c84414c None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:59.538030 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4255ef-6a63-4254-9148-6bfa1c84414c None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:59.539399 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4255ef-6a63-4254-9148-6bfa1c84414c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:06:59.539711 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4255ef-6a63-4254-9148-6bfa1c84414c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:59.541115 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4255ef-6a63-4254-9148-6bfa1c84414c None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:59.554938 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 141/283] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 29 12:06:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:59.556620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484d6a4-0fd5-4c06-99fc-0ea30f6d843c None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:59.633016 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:59.664522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484d6a4-0fd5-4c06-99fc-0ea30f6d843c None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:59.699481 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e24c5-dc22-4743-8226-54567369909f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:59.700361 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e24c5-dc22-4743-8226-54567369909f None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:59.700642 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e24c5-dc22-4743-8226-54567369909f None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:59.700916 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e24c5-dc22-4743-8226-54567369909f None admin] PATH_INFO: `/v3/users/111c4a1e64344a79a07e74427b87f85d` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:59.702099 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e24c5-dc22-4743-8226-54567369909f None admin] RBAC: Authorizing `identity:get_user(user_id=111c4a1e64344a79a07e74427b87f85d)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:59.703583 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e24c5-dc22-4743-8226-54567369909f None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:59.705217 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 143/284] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:06:59 2022] GET /identity/v3/users/111c4a1e64344a79a07e74427b87f85d => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:59.711423 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4255ef-6a63-4254-9148-6bfa1c84414c None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:59.764255 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5381908-27f8-46c4-b64e-3af95da32d2e None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:59.764597 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5381908-27f8-46c4-b64e-3af95da32d2e None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:59.764810 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5381908-27f8-46c4-b64e-3af95da32d2e None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:59.767634 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 144/285] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:06:59.771679 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042daedd-a2ba-4354-b82f-acb644768ffc None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:59.771966 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042daedd-a2ba-4354-b82f-acb644768ffc None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:59.772243 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042daedd-a2ba-4354-b82f-acb644768ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:59.790811 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:06:59.817502 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4255ef-6a63-4254-9148-6bfa1c84414c None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:06:59.823730 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-042daedd-a2ba-4354-b82f-acb644768ffc None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:06:59.824938 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-042daedd-a2ba-4354-b82f-acb644768ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:06:59.854720 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a5eb3-498a-4ba9-b654-0c2fa85c8f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:06:59.855863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a5eb3-498a-4ba9-b654-0c2fa85c8f4f None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:59.856151 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a5eb3-498a-4ba9-b654-0c2fa85c8f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:59.856426 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a5eb3-498a-4ba9-b654-0c2fa85c8f4f None admin] PATH_INFO: `/v3/projects/5fd79607efc84957a3c849d0d14a8f76` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:59.857618 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a5eb3-498a-4ba9-b654-0c2fa85c8f4f None admin] RBAC: Authorizing `identity:get_project(project_id=5fd79607efc84957a3c849d0d14a8f76)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:06:59.859095 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a5eb3-498a-4ba9-b654-0c2fa85c8f4f None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:06:59.860978 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 142/286] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:06:59 2022] GET /identity/v3/projects/5fd79607efc84957a3c849d0d14a8f76 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:06:59.866951 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a5eb3-498a-4ba9-b654-0c2fa85c8f4f None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:06:59.974305 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a5eb3-498a-4ba9-b654-0c2fa85c8f4f None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:00.011310 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc5050-b424-4aae-807b-f64a075a0993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:00.012229 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc5050-b424-4aae-807b-f64a075a0993 None admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:00.012488 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc5050-b424-4aae-807b-f64a075a0993 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:00.012764 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc5050-b424-4aae-807b-f64a075a0993 None admin] PATH_INFO: `/v3/projects/5fd79607efc84957a3c849d0d14a8f76/users/111c4a1e64344a79a07e74427b87f85d/roles/08fb0ec8050c40ea8efd40e54fde52aa` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:00.014756 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc5050-b424-4aae-807b-f64a075a0993 None admin] RBAC: Authorizing `identity:create_grant(project_id=5fd79607efc84957a3c849d0d14a8f76, user_id=111c4a1e64344a79a07e74427b87f85d, role_id=08fb0ec8050c40ea8efd40e54fde52aa)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:00.016387 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc5050-b424-4aae-807b-f64a075a0993 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:00.031137 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 143/287] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 29 12:06:59 2022] PUT /identity/v3/projects/5fd79607efc84957a3c849d0d14a8f76/users/111c4a1e64344a79a07e74427b87f85d/roles/08fb0ec8050c40ea8efd40e54fde52aa => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:07:00.031781 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:00.061596 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 145/288] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:06:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:07:00.109624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc5050-b424-4aae-807b-f64a075a0993 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:00.222108 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc5050-b424-4aae-807b-f64a075a0993 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:00.256417 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8515e20-a652-42c4-ae1c-d5257b82d76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:00.257246 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8515e20-a652-42c4-ae1c-d5257b82d76c None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:00.258249 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8515e20-a652-42c4-ae1c-d5257b82d76c None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:00.258785 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8515e20-a652-42c4-ae1c-d5257b82d76c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:00.270011 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8515e20-a652-42c4-ae1c-d5257b82d76c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:00.278022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-f8515e20-a652-42c4-ae1c-d5257b82d76c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:00.278022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:00.278022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:00.278022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:00.278022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:00.278022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:00.278022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:00.278022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:00.278022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:00.278022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:00.278022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:00.278022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:00.278022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:00.278022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:00.278022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:00.278022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:00.279142 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:00.279142 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:00.279142 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:00.279142 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:00.279142 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:00.279142 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:00.279142 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:00.279142 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:00.279142 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:00.279142 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:00.279142 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:00.279142 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:00.279142 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:00.279142 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:00.279142 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:00.279142 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:00.280130 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:00.280130 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:00.280130 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:00.280130 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:00.280130 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:00.280130 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:00.280130 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:00.280130 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:00.280130 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:00.280130 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:00.280130 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:00.280130 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:00.286696 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 144/289] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:00.291747 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042daedd-a2ba-4354-b82f-acb644768ffc None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:00.409413 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:00.472818 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042daedd-a2ba-4354-b82f-acb644768ffc None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:00.526540 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f49b2-3e94-4425-9cfb-b8c843ba7d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:00.527163 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f49b2-3e94-4425-9cfb-b8c843ba7d28 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:00.527441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f49b2-3e94-4425-9cfb-b8c843ba7d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:00.527717 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f49b2-3e94-4425-9cfb-b8c843ba7d28 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:00.528466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f49b2-3e94-4425-9cfb-b8c843ba7d28 None admin] RBAC: Adding query filter params (name=member) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:00.528773 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f49b2-3e94-4425-9cfb-b8c843ba7d28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:00.530167 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f49b2-3e94-4425-9cfb-b8c843ba7d28 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:00.543320 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 146/290] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 29 12:07:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:00.548707 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8515e20-a652-42c4-ae1c-d5257b82d76c None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:00.647006 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:00.716743 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8515e20-a652-42c4-ae1c-d5257b82d76c None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:00.763493 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba465d-d02e-4f44-8d9c-bf9ce32c71b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:00.764431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba465d-d02e-4f44-8d9c-bf9ce32c71b0 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:00.764709 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba465d-d02e-4f44-8d9c-bf9ce32c71b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:00.764987 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba465d-d02e-4f44-8d9c-bf9ce32c71b0 None admin] PATH_INFO: `/v3/users/0ef8a5d7184c41d8a07185cf7fae9fa6` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:00.766209 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba465d-d02e-4f44-8d9c-bf9ce32c71b0 None admin] RBAC: Authorizing `identity:get_user(user_id=0ef8a5d7184c41d8a07185cf7fae9fa6)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:00.767688 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba465d-d02e-4f44-8d9c-bf9ce32c71b0 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:00.769623 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 145/291] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:00 2022] GET /identity/v3/users/0ef8a5d7184c41d8a07185cf7fae9fa6 => generated 297 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:00.779816 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f49b2-3e94-4425-9cfb-b8c843ba7d28 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:00.925087 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f49b2-3e94-4425-9cfb-b8c843ba7d28 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:00.954659 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:00.961326 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ece1b-08a7-4a6f-ba59-6a9a48462335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:00.961984 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ece1b-08a7-4a6f-ba59-6a9a48462335 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:00.962275 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ece1b-08a7-4a6f-ba59-6a9a48462335 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:00.962546 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ece1b-08a7-4a6f-ba59-6a9a48462335 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:01.045088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ece1b-08a7-4a6f-ba59-6a9a48462335 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:01.046493 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ece1b-08a7-4a6f-ba59-6a9a48462335 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:01.166197 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 147/292] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:01.173058 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba465d-d02e-4f44-8d9c-bf9ce32c71b0 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:01.334343 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba465d-d02e-4f44-8d9c-bf9ce32c71b0 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:01.369667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:01.383568 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5b6ad-5710-4aed-aa84-2f1e1cb2ddb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:01.385018 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5b6ad-5710-4aed-aa84-2f1e1cb2ddb8 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:01.385302 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5b6ad-5710-4aed-aa84-2f1e1cb2ddb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:01.385582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5b6ad-5710-4aed-aa84-2f1e1cb2ddb8 None admin] PATH_INFO: `/v3/projects/5fd79607efc84957a3c849d0d14a8f76` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:01.386869 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b5b6ad-5710-4aed-aa84-2f1e1cb2ddb8 None admin] RBAC: Authorizing `identity:get_project(project_id=5fd79607efc84957a3c849d0d14a8f76)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:01.388336 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b5b6ad-5710-4aed-aa84-2f1e1cb2ddb8 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:01.390046 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 146/293] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:01 2022] GET /identity/v3/projects/5fd79607efc84957a3c849d0d14a8f76 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:01.396324 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ece1b-08a7-4a6f-ba59-6a9a48462335 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:01.428768 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:01.525380 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ece1b-08a7-4a6f-ba59-6a9a48462335 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:01.574366 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466143f-79f1-4a44-ad71-3a614560d27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:01.575061 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466143f-79f1-4a44-ad71-3a614560d27c None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:01.575347 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466143f-79f1-4a44-ad71-3a614560d27c None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:01.575622 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466143f-79f1-4a44-ad71-3a614560d27c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:01.576460 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7466143f-79f1-4a44-ad71-3a614560d27c None admin] RBAC: Adding query filter params (role.id=419e204ede334962ac80ce56c398bd4f, scope.project.id=5fd79607efc84957a3c849d0d14a8f76, user.id=0ef8a5d7184c41d8a07185cf7fae9fa6) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:01.576775 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7466143f-79f1-4a44-ad71-3a614560d27c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:01.578301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7466143f-79f1-4a44-ad71-3a614560d27c None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:01.585106 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 148/294] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:07:01 2022] GET /identity/v3/role_assignments?user.id=0ef8a5d7184c41d8a07185cf7fae9fa6&scope.project.id=5fd79607efc84957a3c849d0d14a8f76&role.id=419e204ede334962ac80ce56c398bd4f => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:01.850029 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc809c0-8ebd-4aa0-a5ed-939d159c2876 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:01.851125 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc809c0-8ebd-4aa0-a5ed-939d159c2876 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:01.851638 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc809c0-8ebd-4aa0-a5ed-939d159c2876 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:01.853289 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 147/295] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:01.859368 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756c308-1252-4dc3-bd70-c30812f57e36 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:01.860302 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756c308-1252-4dc3-bd70-c30812f57e36 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:01.860805 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756c308-1252-4dc3-bd70-c30812f57e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:01.878219 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-3756c308-1252-4dc3-bd70-c30812f57e36 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:01.879751 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-3756c308-1252-4dc3-bd70-c30812f57e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:01.951744 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 149/296] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:01.968440 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81244f-8671-481e-a50f-291ec7239a59 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:01.968741 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81244f-8671-481e-a50f-291ec7239a59 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:01.969002 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81244f-8671-481e-a50f-291ec7239a59 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:01.970387 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 148/297] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:01.975650 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c992b6-4528-448a-9166-a52bbbcdf500 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:01.975949 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c992b6-4528-448a-9166-a52bbbcdf500 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:01.976737 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c992b6-4528-448a-9166-a52bbbcdf500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:01.981476 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81244f-8671-481e-a50f-291ec7239a59 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:01.999001 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-c5c992b6-4528-448a-9166-a52bbbcdf500 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:02.000325 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-c5c992b6-4528-448a-9166-a52bbbcdf500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:02.023925 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:02.073905 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 150/298] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:02.103712 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c992b6-4528-448a-9166-a52bbbcdf500 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:02.104199 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81244f-8671-481e-a50f-291ec7239a59 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:02.150398 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd9ed2-279a-47d0-a7e7-5f71ddb7f0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:02.150398 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd9ed2-279a-47d0-a7e7-5f71ddb7f0ae None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:02.150819 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd9ed2-279a-47d0-a7e7-5f71ddb7f0ae None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:02.150996 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd9ed2-279a-47d0-a7e7-5f71ddb7f0ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:02.152604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd9ed2-279a-47d0-a7e7-5f71ddb7f0ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:02.154457 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd9ed2-279a-47d0-a7e7-5f71ddb7f0ae None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:02.156308 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 149/299] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:02.157355 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930f76a-013f-4380-a382-d1c77c3e2bc2 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:02.157635 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930f76a-013f-4380-a382-d1c77c3e2bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:02.157909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930f76a-013f-4380-a382-d1c77c3e2bc2 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:02.164662 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 150/300] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:02.165408 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930f76a-013f-4380-a382-d1c77c3e2bc2 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:02.218918 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c992b6-4528-448a-9166-a52bbbcdf500 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:02.232099 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:02.258825 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a18aec-5ddc-43e4-9f0a-8953903c17de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:02.259631 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a18aec-5ddc-43e4-9f0a-8953903c17de None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:02.259913 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a18aec-5ddc-43e4-9f0a-8953903c17de None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:02.260183 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a18aec-5ddc-43e4-9f0a-8953903c17de None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:02.270446 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a18aec-5ddc-43e4-9f0a-8953903c17de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:02.270953 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930f76a-013f-4380-a382-d1c77c3e2bc2 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:02.278650 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-39a18aec-5ddc-43e4-9f0a-8953903c17de None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:07:02.278650 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:02.278650 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:02.278650 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:02.278650 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:02.278650 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:02.278650 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:02.278650 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:02.278650 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:02.278650 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:02.278650 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:02.278650 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:02.278650 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:02.278650 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:02.278650 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:02.278650 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:02.279550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:02.279550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:02.279550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:02.279550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:02.279550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:02.279550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:02.279550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:02.279550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:02.279550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:02.279550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:02.279550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:02.279550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:02.279550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:02.279550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:02.279550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:02.279550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:02.285704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:02.285704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:02.285704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:02.285704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:02.285704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:02.285704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:02.285704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:02.285704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:02.285704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:02.285704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:02.285704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:07:02.285704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:02.285704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 151/301] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:02.285704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cd9f9-9068-4467-a750-61bd0f3d990f None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:02.286399 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cd9f9-9068-4467-a750-61bd0f3d990f None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:02.286399 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cd9f9-9068-4467-a750-61bd0f3d990f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:02.299093 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-8f1cd9f9-9068-4467-a750-61bd0f3d990f None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:02.300269 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-8f1cd9f9-9068-4467-a750-61bd0f3d990f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:02.310998 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:02.316322 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65637c-b19d-4750-bb1a-27482303bfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:02.317068 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65637c-b19d-4750-bb1a-27482303bfae None admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:02.317296 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65637c-b19d-4750-bb1a-27482303bfae None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:02.317575 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65637c-b19d-4750-bb1a-27482303bfae None admin] PATH_INFO: `/v3/groups` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:02.318500 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65637c-b19d-4750-bb1a-27482303bfae None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:02.319783 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65637c-b19d-4750-bb1a-27482303bfae None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:02.334618 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 151/302] 10.222.0.13 () {60 vars in 1134 bytes} [Wed Jun 29 12:07:02 2022] POST /identity/v3/groups => generated 229 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:07:02.335999 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65637c-b19d-4750-bb1a-27482303bfae None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:02.404721 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 152/303] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:02.428168 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cd9f9-9068-4467-a750-61bd0f3d990f None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:02.468592 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65637c-b19d-4750-bb1a-27482303bfae None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:02.495273 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:02.508716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe3f13-d985-4f43-ab2c-c3eb00298daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:02.509672 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe3f13-d985-4f43-ab2c-c3eb00298daf None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:02.509964 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe3f13-d985-4f43-ab2c-c3eb00298daf None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:02.510246 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe3f13-d985-4f43-ab2c-c3eb00298daf None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:02.511040 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe3f13-d985-4f43-ab2c-c3eb00298daf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:02.511345 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe3f13-d985-4f43-ab2c-c3eb00298daf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:02.512732 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe3f13-d985-4f43-ab2c-c3eb00298daf None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:02.521361 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 152/304] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 29 12:07:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:02.522712 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df88f1-a778-46da-bdd8-9978d6d7a896 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:02.523045 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df88f1-a778-46da-bdd8-9978d6d7a896 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:02.523366 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df88f1-a778-46da-bdd8-9978d6d7a896 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:02.524649 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 153/305] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:02.527625 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df88f1-a778-46da-bdd8-9978d6d7a896 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:02.559319 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cd9f9-9068-4467-a750-61bd0f3d990f None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:02.598688 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df281218-ec7c-42c8-8687-77cec808b2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:02.599614 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df281218-ec7c-42c8-8687-77cec808b2cc None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:02.599888 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df281218-ec7c-42c8-8687-77cec808b2cc None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:02.600258 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df281218-ec7c-42c8-8687-77cec808b2cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:02.611314 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df281218-ec7c-42c8-8687-77cec808b2cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:02.620104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-df281218-ec7c-42c8-8687-77cec808b2cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:02.620104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:02.620104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:02.620104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:02.620104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:02.620104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:02.620104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:02.620104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:02.620104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:02.620104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:02.620104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:02.620104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:02.620104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:02.620104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:02.620104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:02.620104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:02.620995 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:02.620995 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:02.620995 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:02.620995 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:02.620995 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:02.620995 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:02.620995 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:02.620995 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:02.620995 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:02.620995 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:02.620995 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:02.620995 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:02.620995 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:02.620995 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:02.620995 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:02.620995 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:02.626842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:02.626842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:02.626842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:02.626842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:02.626842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:02.626842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:02.626842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:02.626842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:02.626842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:02.626842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:02.626842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:02.626842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:02.626842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 153/306] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:07:02.626842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb60cc-5ef3-4c18-ae99-0cdf9d5df15f None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:02.627589 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb60cc-5ef3-4c18-ae99-0cdf9d5df15f None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:02.627589 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb60cc-5ef3-4c18-ae99-0cdf9d5df15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:02.637819 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:02.643214 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-89fb60cc-5ef3-4c18-ae99-0cdf9d5df15f None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:02.643613 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df88f1-a778-46da-bdd8-9978d6d7a896 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:02.644402 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-89fb60cc-5ef3-4c18-ae99-0cdf9d5df15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:02.680593 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41d24e-257f-4a6a-b8f9-54add86d63ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:02.681466 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41d24e-257f-4a6a-b8f9-54add86d63ab None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:02.681745 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41d24e-257f-4a6a-b8f9-54add86d63ab None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:02.682017 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41d24e-257f-4a6a-b8f9-54add86d63ab None admin] PATH_INFO: `/v3/users/fcd4960ef4eb4cab9e55e568a8ebe9c1` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:02.695458 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41d24e-257f-4a6a-b8f9-54add86d63ab None admin] RBAC: Authorizing `identity:get_user(user_id=fcd4960ef4eb4cab9e55e568a8ebe9c1)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:02.696955 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41d24e-257f-4a6a-b8f9-54add86d63ab None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:02.703220 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 154/307] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:02 2022] GET /identity/v3/users/fcd4960ef4eb4cab9e55e568a8ebe9c1 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:02.703220 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41d24e-257f-4a6a-b8f9-54add86d63ab None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:02.718235 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 154/308] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:02.719220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb60cc-5ef3-4c18-ae99-0cdf9d5df15f None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:02.764069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:02.831650 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41d24e-257f-4a6a-b8f9-54add86d63ab None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:02.841028 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb60cc-5ef3-4c18-ae99-0cdf9d5df15f None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:02.868551 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5410e4-1c73-4bbd-86b3-923e3b705a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:02.869419 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5410e4-1c73-4bbd-86b3-923e3b705a2a None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:02.869676 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5410e4-1c73-4bbd-86b3-923e3b705a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:02.870354 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5410e4-1c73-4bbd-86b3-923e3b705a2a None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:02.870975 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5410e4-1c73-4bbd-86b3-923e3b705a2a None admin] RBAC: Adding query filter params (name=member) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:02.871420 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5410e4-1c73-4bbd-86b3-923e3b705a2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:02.872790 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5410e4-1c73-4bbd-86b3-923e3b705a2a None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:02.881460 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 155/309] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 29 12:07:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:02.882264 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5410e4-1c73-4bbd-86b3-923e3b705a2a None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:02.888403 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d18aa-e6a5-4d66-b65c-01476965f2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:02.889873 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d18aa-e6a5-4d66-b65c-01476965f2b8 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:02.889873 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d18aa-e6a5-4d66-b65c-01476965f2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:02.889873 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d18aa-e6a5-4d66-b65c-01476965f2b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:02.890658 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d18aa-e6a5-4d66-b65c-01476965f2b8 None admin] RBAC: Adding query filter params (role.id=08fb0ec8050c40ea8efd40e54fde52aa, user.id=fcd4960ef4eb4cab9e55e568a8ebe9c1, scope.system=all) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:02.891052 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d18aa-e6a5-4d66-b65c-01476965f2b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:02.892565 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d18aa-e6a5-4d66-b65c-01476965f2b8 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:02.896077 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:02.903069 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 155/310] 10.222.0.13 () {56 vars in 1308 bytes} [Wed Jun 29 12:07:02 2022] GET /identity/v3/role_assignments?user.id=fcd4960ef4eb4cab9e55e568a8ebe9c1&scope.system=all&role.id=08fb0ec8050c40ea8efd40e54fde52aa => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:02.904488 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d18aa-e6a5-4d66-b65c-01476965f2b8 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:03.005058 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5410e4-1c73-4bbd-86b3-923e3b705a2a None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:03.013171 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:03.050163 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc4dc9-b863-42ed-9c4a-ea2eca6cd385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:03.051203 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc4dc9-b863-42ed-9c4a-ea2eca6cd385 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:03.051656 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc4dc9-b863-42ed-9c4a-ea2eca6cd385 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:03.051946 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc4dc9-b863-42ed-9c4a-ea2eca6cd385 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:03.059975 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d18aa-e6a5-4d66-b65c-01476965f2b8 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:03.067760 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc4dc9-b863-42ed-9c4a-ea2eca6cd385 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:03.076624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-f1dc4dc9-b863-42ed-9c4a-ea2eca6cd385 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:07:03.076624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:03.076624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:03.076624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:03.076624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:03.076624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:03.076624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:03.076624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:03.076624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:03.076624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:03.076624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:03.076624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:03.076624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:03.076624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:03.076624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:03.076624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:03.077500 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:03.077500 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:03.077500 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:03.077500 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:03.077500 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:03.077500 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:03.077500 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:03.077500 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:03.077500 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:03.077500 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:03.077500 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:03.077500 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:03.077500 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:03.077500 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:03.077500 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:03.077500 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:03.078441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:03.078441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:03.078441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:03.078441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:03.078441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:03.078441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:03.078441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:03.078441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:03.078441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:03.078441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:03.078441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:07:03.078441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:03.078441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 156/311] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:03.087542 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc4dc9-b863-42ed-9c4a-ea2eca6cd385 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:03.102347 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc77e4-2ddb-430c-9f94-c374b0b7f5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:03.103496 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc77e4-2ddb-430c-9f94-c374b0b7f5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:03.103923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc77e4-2ddb-430c-9f94-c374b0b7f5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:03.104290 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc77e4-2ddb-430c-9f94-c374b0b7f5b3 None admin] PATH_INFO: `/v3/users/c8628ceaefbb4408a88bef358d13f2bc` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:03.105755 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc77e4-2ddb-430c-9f94-c374b0b7f5b3 None admin] RBAC: Authorizing `identity:get_user(user_id=c8628ceaefbb4408a88bef358d13f2bc)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:03.107522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc77e4-2ddb-430c-9f94-c374b0b7f5b3 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:03.109781 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 156/312] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:02 2022] GET /identity/v3/users/c8628ceaefbb4408a88bef358d13f2bc => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:03.115149 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc77e4-2ddb-430c-9f94-c374b0b7f5b3 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:03.195353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:03.209860 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc4dc9-b863-42ed-9c4a-ea2eca6cd385 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:03.240173 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc77e4-2ddb-430c-9f94-c374b0b7f5b3 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:03.248603 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb360553-f7bc-4061-8083-14c17bfdc3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:03.249895 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb360553-f7bc-4061-8083-14c17bfdc3b5 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:03.250278 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb360553-f7bc-4061-8083-14c17bfdc3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:03.250667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb360553-f7bc-4061-8083-14c17bfdc3b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:03.252015 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb360553-f7bc-4061-8083-14c17bfdc3b5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:03.252433 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb360553-f7bc-4061-8083-14c17bfdc3b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:03.254822 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb360553-f7bc-4061-8083-14c17bfdc3b5 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:03.266394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 157/313] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 29 12:07:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:03.274685 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb360553-f7bc-4061-8083-14c17bfdc3b5 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:03.287437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559f1d5-7a49-4a2f-959e-4b063b795d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:03.289144 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559f1d5-7a49-4a2f-959e-4b063b795d27 None admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:03.289446 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559f1d5-7a49-4a2f-959e-4b063b795d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:03.289814 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559f1d5-7a49-4a2f-959e-4b063b795d27 None admin] PATH_INFO: `/v3/system/users/c8628ceaefbb4408a88bef358d13f2bc/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:03.291667 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559f1d5-7a49-4a2f-959e-4b063b795d27 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c8628ceaefbb4408a88bef358d13f2bc, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:03.293364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559f1d5-7a49-4a2f-959e-4b063b795d27 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:03.304565 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 157/314] 10.222.0.13 () {58 vars in 1334 bytes} [Wed Jun 29 12:07:03 2022] PUT /identity/v3/system/users/c8628ceaefbb4408a88bef358d13f2bc/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:07:03.305927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:03.400832 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb360553-f7bc-4061-8083-14c17bfdc3b5 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:03.437596 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0448951-1e9a-4498-a075-feb9deb94084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:03.438487 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0448951-1e9a-4498-a075-feb9deb94084 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:03.438798 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0448951-1e9a-4498-a075-feb9deb94084 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:03.439072 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0448951-1e9a-4498-a075-feb9deb94084 None admin] PATH_INFO: `/v3/users/111c4a1e64344a79a07e74427b87f85d` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:03.440332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0448951-1e9a-4498-a075-feb9deb94084 None admin] RBAC: Authorizing `identity:get_user(user_id=111c4a1e64344a79a07e74427b87f85d)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:03.441811 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0448951-1e9a-4498-a075-feb9deb94084 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:03.443791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 158/315] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:03 2022] GET /identity/v3/users/111c4a1e64344a79a07e74427b87f85d => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:07:03.449759 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559f1d5-7a49-4a2f-959e-4b063b795d27 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:03.559533 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559f1d5-7a49-4a2f-959e-4b063b795d27 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:03.590540 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:03.595452 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7938a9-274b-4aaa-99b2-c1c4351e857d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:03.596020 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7938a9-274b-4aaa-99b2-c1c4351e857d None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:03.596305 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7938a9-274b-4aaa-99b2-c1c4351e857d None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:03.596581 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7938a9-274b-4aaa-99b2-c1c4351e857d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:03.672105 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7938a9-274b-4aaa-99b2-c1c4351e857d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:03.673575 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7938a9-274b-4aaa-99b2-c1c4351e857d None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:03.778693 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 158/316] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:03.783945 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0448951-1e9a-4498-a075-feb9deb94084 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:03.883479 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:03.890983 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0448951-1e9a-4498-a075-feb9deb94084 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:03.925128 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47039e-5911-49bf-a2ad-759f00a246b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:03.925990 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47039e-5911-49bf-a2ad-759f00a246b8 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:03.926270 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47039e-5911-49bf-a2ad-759f00a246b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:03.926545 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47039e-5911-49bf-a2ad-759f00a246b8 None admin] PATH_INFO: `/v3/projects/5fd79607efc84957a3c849d0d14a8f76` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:03.927759 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47039e-5911-49bf-a2ad-759f00a246b8 None admin] RBAC: Authorizing `identity:get_project(project_id=5fd79607efc84957a3c849d0d14a8f76)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:03.929752 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47039e-5911-49bf-a2ad-759f00a246b8 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:03.931844 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 159/317] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:03 2022] GET /identity/v3/projects/5fd79607efc84957a3c849d0d14a8f76 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:03.937537 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7938a9-274b-4aaa-99b2-c1c4351e857d None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:03.969721 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:04.044529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7938a9-274b-4aaa-99b2-c1c4351e857d None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:04.081873 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f558f64-4081-4896-992a-6c9ff3cc1006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:04.082601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f558f64-4081-4896-992a-6c9ff3cc1006 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:04.082913 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f558f64-4081-4896-992a-6c9ff3cc1006 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:04.083188 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f558f64-4081-4896-992a-6c9ff3cc1006 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:04.084081 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f558f64-4081-4896-992a-6c9ff3cc1006 None admin] RBAC: Adding query filter params (role.id=08fb0ec8050c40ea8efd40e54fde52aa, scope.project.id=5fd79607efc84957a3c849d0d14a8f76, user.id=111c4a1e64344a79a07e74427b87f85d) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:04.084398 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f558f64-4081-4896-992a-6c9ff3cc1006 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:04.085882 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f558f64-4081-4896-992a-6c9ff3cc1006 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:04.092413 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 159/318] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:07:03 2022] GET /identity/v3/role_assignments?user.id=111c4a1e64344a79a07e74427b87f85d&scope.project.id=5fd79607efc84957a3c849d0d14a8f76&role.id=08fb0ec8050c40ea8efd40e54fde52aa => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:04.544087 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489ee4f-ed5b-4704-b33f-aae92bf253af None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:04.544488 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489ee4f-ed5b-4704-b33f-aae92bf253af None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:04.544663 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489ee4f-ed5b-4704-b33f-aae92bf253af None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:04.546064 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 160/319] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:04.551075 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ea138-1391-41a7-86ff-9b69418cb86f None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:04.551370 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ea138-1391-41a7-86ff-9b69418cb86f None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:04.551654 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ea138-1391-41a7-86ff-9b69418cb86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:04.568570 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-e12ea138-1391-41a7-86ff-9b69418cb86f None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:04.569798 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-e12ea138-1391-41a7-86ff-9b69418cb86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:04.638115 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 160/320] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:04.660894 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489ee4f-ed5b-4704-b33f-aae92bf253af None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:04.771313 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489ee4f-ed5b-4704-b33f-aae92bf253af None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:04.805705 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b9884-48cb-4a0b-a035-5e6f24fcdafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:04.806423 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b9884-48cb-4a0b-a035-5e6f24fcdafe None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:04.806731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b9884-48cb-4a0b-a035-5e6f24fcdafe None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:04.807010 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b9884-48cb-4a0b-a035-5e6f24fcdafe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:04.808153 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b9884-48cb-4a0b-a035-5e6f24fcdafe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:04.809599 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b9884-48cb-4a0b-a035-5e6f24fcdafe None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:04.811403 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 161/321] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:04.816827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ea138-1391-41a7-86ff-9b69418cb86f None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:04.843939 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:04.922311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ea138-1391-41a7-86ff-9b69418cb86f None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:04.958397 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea59009-9f2a-4d9c-b9f6-881459d352a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:04.959079 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea59009-9f2a-4d9c-b9f6-881459d352a5 None admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:04.959361 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea59009-9f2a-4d9c-b9f6-881459d352a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:04.959634 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea59009-9f2a-4d9c-b9f6-881459d352a5 None admin] PATH_INFO: `/v3/groups` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:04.960953 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea59009-9f2a-4d9c-b9f6-881459d352a5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:04.962488 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea59009-9f2a-4d9c-b9f6-881459d352a5 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:04.977258 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 161/322] 10.222.0.13 () {60 vars in 1134 bytes} [Wed Jun 29 12:07:04 2022] POST /identity/v3/groups => generated 226 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:07:04.984521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba241545-2708-48d8-9140-c7e7ce0eb5bb None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:04.985069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba241545-2708-48d8-9140-c7e7ce0eb5bb None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:04.985069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba241545-2708-48d8-9140-c7e7ce0eb5bb None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:04.986699 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 162/323] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:04.992644 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157adf23-07d9-4aef-a85e-0de6e235463f None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:04.992963 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157adf23-07d9-4aef-a85e-0de6e235463f None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:04.993208 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157adf23-07d9-4aef-a85e-0de6e235463f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:05.011691 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-157adf23-07d9-4aef-a85e-0de6e235463f None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:05.012901 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-157adf23-07d9-4aef-a85e-0de6e235463f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:05.091856 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 162/324] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:05.114076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba241545-2708-48d8-9140-c7e7ce0eb5bb None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:05.149350 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:05.226566 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba241545-2708-48d8-9140-c7e7ce0eb5bb None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:05.265401 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63142a23-b2ce-4f83-83e5-509cd5e63334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:05.266212 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63142a23-b2ce-4f83-83e5-509cd5e63334 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:05.266470 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63142a23-b2ce-4f83-83e5-509cd5e63334 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:05.266914 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63142a23-b2ce-4f83-83e5-509cd5e63334 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:05.277887 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63142a23-b2ce-4f83-83e5-509cd5e63334 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:05.285667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-63142a23-b2ce-4f83-83e5-509cd5e63334 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:07:05.285667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:05.285667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:05.285667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:05.285667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:05.285667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:05.285667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:05.285667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:05.285667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:05.285667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:05.285667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:05.285667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:05.285667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:05.285667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:05.285667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:05.285667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:05.286550 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:05.286550 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:05.286550 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:05.286550 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:05.286550 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:05.286550 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:05.286550 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:05.286550 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:05.286550 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:05.286550 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:05.286550 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:05.286550 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:05.286550 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:05.286550 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:05.286550 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:05.286550 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:05.287522 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:05.287522 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:05.287522 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:05.287522 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:05.287522 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:05.287522 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:05.287522 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:05.287522 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:05.287522 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:05.287522 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:05.287522 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:07:05.287522 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:05.287522 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 163/325] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:05.293167 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157adf23-07d9-4aef-a85e-0de6e235463f None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:05.315903 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:05.389031 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6ab00-3b8a-46e2-8e4d-aa779c8c8bd7 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:05.389268 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6ab00-3b8a-46e2-8e4d-aa779c8c8bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:05.389523 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6ab00-3b8a-46e2-8e4d-aa779c8c8bd7 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:05.391205 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 164/326] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:05.396363 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734e781-c098-4052-b00e-155e395f1ff4 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:05.396655 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734e781-c098-4052-b00e-155e395f1ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:05.396939 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734e781-c098-4052-b00e-155e395f1ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:05.409679 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157adf23-07d9-4aef-a85e-0de6e235463f None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:05.421913 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-4734e781-c098-4052-b00e-155e395f1ff4 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:05.423374 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-4734e781-c098-4052-b00e-155e395f1ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:05.453536 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21502b9-fe52-41d5-b968-f3ceab1b3dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:05.454214 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21502b9-fe52-41d5-b968-f3ceab1b3dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:05.454501 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21502b9-fe52-41d5-b968-f3ceab1b3dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:05.454812 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21502b9-fe52-41d5-b968-f3ceab1b3dd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:05.455568 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21502b9-fe52-41d5-b968-f3ceab1b3dd6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:05.455880 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21502b9-fe52-41d5-b968-f3ceab1b3dd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:05.457285 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21502b9-fe52-41d5-b968-f3ceab1b3dd6 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:05.469809 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 163/327] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 29 12:07:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:05.474869 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21502b9-fe52-41d5-b968-f3ceab1b3dd6 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:05.513871 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 165/328] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:07:05.539262 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734e781-c098-4052-b00e-155e395f1ff4 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:05.567909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:05.591367 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:05.623076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21502b9-fe52-41d5-b968-f3ceab1b3dd6 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:05.666599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3aee2b-5b3e-41c9-ac3a-d6de40f8921d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:05.667312 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734e781-c098-4052-b00e-155e395f1ff4 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:05.667435 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3aee2b-5b3e-41c9-ac3a-d6de40f8921d None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:05.667725 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3aee2b-5b3e-41c9-ac3a-d6de40f8921d None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:05.668003 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3aee2b-5b3e-41c9-ac3a-d6de40f8921d None admin] PATH_INFO: `/v3/users/fcd4960ef4eb4cab9e55e568a8ebe9c1` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:05.669494 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3aee2b-5b3e-41c9-ac3a-d6de40f8921d None admin] RBAC: Authorizing `identity:get_user(user_id=fcd4960ef4eb4cab9e55e568a8ebe9c1)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:05.671906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3aee2b-5b3e-41c9-ac3a-d6de40f8921d None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:05.673871 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 164/329] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:05 2022] GET /identity/v3/users/fcd4960ef4eb4cab9e55e568a8ebe9c1 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:05.680236 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3aee2b-5b3e-41c9-ac3a-d6de40f8921d None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:05.711186 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d5578-de8d-404d-91d4-04ad748f2a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:05.712131 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d5578-de8d-404d-91d4-04ad748f2a57 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:05.712477 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d5578-de8d-404d-91d4-04ad748f2a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:05.712824 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d5578-de8d-404d-91d4-04ad748f2a57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:05.728703 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d5578-de8d-404d-91d4-04ad748f2a57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:05.738888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-165d5578-de8d-404d-91d4-04ad748f2a57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:05.738888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:05.738888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:05.738888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:05.738888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:05.738888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:05.738888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:05.738888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:05.738888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:05.738888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:05.738888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:05.738888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:05.738888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:05.738888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:05.738888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:05.738888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:05.739791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:05.739791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:05.739791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:05.739791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:05.739791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:05.739791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:05.739791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:05.739791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:05.739791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:05.739791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:05.739791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:05.739791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:05.739791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:05.739791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:05.739791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:05.739791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:05.740584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:05.740584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:05.740584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:05.740584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:05.740584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:05.740584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:05.740584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:05.740584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:05.740584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:05.740584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:05.740584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:05.740584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:05.745214 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 166/330] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:07:05.752367 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d5578-de8d-404d-91d4-04ad748f2a57 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:05.809069 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3aee2b-5b3e-41c9-ac3a-d6de40f8921d None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:05.854209 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796e50e-8c23-44b3-8c65-2933306ded39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:05.855121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796e50e-8c23-44b3-8c65-2933306ded39 None admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:05.855410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796e50e-8c23-44b3-8c65-2933306ded39 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:05.855979 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796e50e-8c23-44b3-8c65-2933306ded39 None admin] PATH_INFO: `/v3/system/users/fcd4960ef4eb4cab9e55e568a8ebe9c1/roles/08fb0ec8050c40ea8efd40e54fde52aa` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:05.857775 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796e50e-8c23-44b3-8c65-2933306ded39 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fcd4960ef4eb4cab9e55e568a8ebe9c1, role_id=08fb0ec8050c40ea8efd40e54fde52aa)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:05.858924 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:05.860720 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796e50e-8c23-44b3-8c65-2933306ded39 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:05.872700 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 165/331] 10.222.0.13 () {58 vars in 1334 bytes} [Wed Jun 29 12:07:05 2022] PUT /identity/v3/system/users/fcd4960ef4eb4cab9e55e568a8ebe9c1/roles/08fb0ec8050c40ea8efd40e54fde52aa => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:07:05.884973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d5578-de8d-404d-91d4-04ad748f2a57 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:05.936659 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f5d66-3d73-4618-8147-97f3e45abe19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:05.937342 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f5d66-3d73-4618-8147-97f3e45abe19 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:05.937626 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f5d66-3d73-4618-8147-97f3e45abe19 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:05.937908 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f5d66-3d73-4618-8147-97f3e45abe19 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:05.938756 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f5d66-3d73-4618-8147-97f3e45abe19 None admin] RBAC: Adding query filter params (name=member) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:05.939069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f5d66-3d73-4618-8147-97f3e45abe19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:05.940479 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f5d66-3d73-4618-8147-97f3e45abe19 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:05.950893 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 167/332] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 29 12:07:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:05.957011 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796e50e-8c23-44b3-8c65-2933306ded39 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:05.972016 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:06.071855 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796e50e-8c23-44b3-8c65-2933306ded39 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:06.108288 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4891ef-ca88-46dc-b1e9-1ba2887c7a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:06.109176 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4891ef-ca88-46dc-b1e9-1ba2887c7a62 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:06.109461 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4891ef-ca88-46dc-b1e9-1ba2887c7a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:06.109740 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4891ef-ca88-46dc-b1e9-1ba2887c7a62 None admin] PATH_INFO: `/v3/users/c8628ceaefbb4408a88bef358d13f2bc` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:06.111014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4891ef-ca88-46dc-b1e9-1ba2887c7a62 None admin] RBAC: Authorizing `identity:get_user(user_id=c8628ceaefbb4408a88bef358d13f2bc)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:06.112528 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4891ef-ca88-46dc-b1e9-1ba2887c7a62 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:06.114353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 166/333] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:05 2022] GET /identity/v3/users/c8628ceaefbb4408a88bef358d13f2bc => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:06.120158 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f5d66-3d73-4618-8147-97f3e45abe19 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:06.225595 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f5d66-3d73-4618-8147-97f3e45abe19 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:06.261030 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b89cb-1486-41b7-9f2e-856e4b9a8c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:06.261706 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b89cb-1486-41b7-9f2e-856e4b9a8c05 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:06.262106 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b89cb-1486-41b7-9f2e-856e4b9a8c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:06.262380 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b89cb-1486-41b7-9f2e-856e4b9a8c05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:06.263253 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b89cb-1486-41b7-9f2e-856e4b9a8c05 None admin] RBAC: Adding query filter params (role.id=419e204ede334962ac80ce56c398bd4f, user.id=c8628ceaefbb4408a88bef358d13f2bc, scope.system=all) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:06.263569 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b89cb-1486-41b7-9f2e-856e4b9a8c05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:06.265093 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b89cb-1486-41b7-9f2e-856e4b9a8c05 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:06.278490 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 168/334] 10.222.0.13 () {56 vars in 1308 bytes} [Wed Jun 29 12:07:06 2022] GET /identity/v3/role_assignments?user.id=c8628ceaefbb4408a88bef358d13f2bc&scope.system=all&role.id=419e204ede334962ac80ce56c398bd4f => generated 510 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:07.636121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de049993-d927-45a3-b265-f582633d7a1f None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:07.636814 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de049993-d927-45a3-b265-f582633d7a1f None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:07.636814 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de049993-d927-45a3-b265-f582633d7a1f None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:07.639147 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 167/335] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:07.644767 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e161b-fbbb-4628-ab4a-5618291e444a None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:07.645350 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e161b-fbbb-4628-ab4a-5618291e444a None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:07.645504 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e161b-fbbb-4628-ab4a-5618291e444a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:07.656496 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:07.676848 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-ba7e161b-fbbb-4628-ab4a-5618291e444a None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:07.678045 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-ba7e161b-fbbb-4628-ab4a-5618291e444a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:07.786139 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 169/336] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:07.820231 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de049993-d927-45a3-b265-f582633d7a1f None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:07.926409 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:07.955364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de049993-d927-45a3-b265-f582633d7a1f None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:07.995949 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deca345-6f13-4d6a-b1c7-187958e8e5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:07.996832 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deca345-6f13-4d6a-b1c7-187958e8e5e9 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:07.997118 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deca345-6f13-4d6a-b1c7-187958e8e5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:07.997451 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deca345-6f13-4d6a-b1c7-187958e8e5e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:08.013115 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deca345-6f13-4d6a-b1c7-187958e8e5e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:08.021121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-7deca345-6f13-4d6a-b1c7-187958e8e5e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:08.021121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:08.021121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:08.021121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:08.021121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:08.021121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:08.021121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:08.021121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:08.021121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:08.021121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:08.021121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:08.021121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:08.021121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:08.021121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:08.021121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:08.021121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:08.021991 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:08.021991 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:08.021991 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:08.021991 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:08.021991 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:08.021991 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:08.021991 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:08.021991 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:08.021991 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:08.021991 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:08.021991 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:08.021991 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:08.021991 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:08.021991 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:08.021991 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:08.021991 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:08.023538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:08.023538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:08.023538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:08.023538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:08.023538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:08.023538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:08.023538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:08.023538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:08.023538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:08.023538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:08.023538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:08.023538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:08.023538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 168/337] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:08.030908 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e161b-fbbb-4628-ab4a-5618291e444a None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:08.068669 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24cb5d-4897-4051-bfa1-767648068edf None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:08.069016 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24cb5d-4897-4051-bfa1-767648068edf None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:08.069231 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24cb5d-4897-4051-bfa1-767648068edf None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:08.071254 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 169/338] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:07:08.076672 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c829a4-4c10-43f9-a1dd-854742f7e021 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:08.076960 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c829a4-4c10-43f9-a1dd-854742f7e021 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:08.077391 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c829a4-4c10-43f9-a1dd-854742f7e021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:08.104726 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-c7c829a4-4c10-43f9-a1dd-854742f7e021 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:08.105948 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-c7c829a4-4c10-43f9-a1dd-854742f7e021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:08.218581 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e161b-fbbb-4628-ab4a-5618291e444a None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:08.270809 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 170/339] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:07:08.281870 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:08.290329 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb01239-9e6c-4db9-a5e1-263f444bbda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:08.291076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb01239-9e6c-4db9-a5e1-263f444bbda0 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:08.291357 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb01239-9e6c-4db9-a5e1-263f444bbda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:08.291633 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb01239-9e6c-4db9-a5e1-263f444bbda0 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:08.292380 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb01239-9e6c-4db9-a5e1-263f444bbda0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:08.292686 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb01239-9e6c-4db9-a5e1-263f444bbda0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:08.294122 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb01239-9e6c-4db9-a5e1-263f444bbda0 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:08.306625 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 170/340] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 29 12:07:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:08.312672 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c829a4-4c10-43f9-a1dd-854742f7e021 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:08.345067 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb01239-9e6c-4db9-a5e1-263f444bbda0 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:08.461022 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:08.527080 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c829a4-4c10-43f9-a1dd-854742f7e021 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:08.536440 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb01239-9e6c-4db9-a5e1-263f444bbda0 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:08.584696 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd5c48-d711-4688-bb31-1c3f2857bf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:08.585395 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd5c48-d711-4688-bb31-1c3f2857bf5c None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:08.585679 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd5c48-d711-4688-bb31-1c3f2857bf5c None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:08.585960 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd5c48-d711-4688-bb31-1c3f2857bf5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:08.599529 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19912ef9-7aca-4522-933b-0de8dfe7c695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:08.600362 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19912ef9-7aca-4522-933b-0de8dfe7c695 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:08.600641 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19912ef9-7aca-4522-933b-0de8dfe7c695 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:08.600948 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19912ef9-7aca-4522-933b-0de8dfe7c695 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:08.618959 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19912ef9-7aca-4522-933b-0de8dfe7c695 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:08.629005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-19912ef9-7aca-4522-933b-0de8dfe7c695 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:07:08.629005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:08.629005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:08.629005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:08.629005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:08.629005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:08.629005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:08.629005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:08.629005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:08.629005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:08.629005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:08.629005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:08.629005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:08.629005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:08.629005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:08.629005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:08.629917 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:08.629917 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:08.629917 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:08.629917 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:08.629917 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:08.629917 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:08.629917 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:08.629917 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:08.629917 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:08.629917 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:08.629917 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:08.629917 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:08.629917 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:08.629917 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:08.629917 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:08.629917 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:08.630733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:08.630733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:08.630733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:08.630733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:08.630733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:08.630733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:08.630733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:08.630733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:08.630733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:08.630733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:08.630733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:07:08.630733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:08.634861 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 171/341] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 29 12:07:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:08.637839 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19912ef9-7aca-4522-933b-0de8dfe7c695 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:08.691057 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd5c48-d711-4688-bb31-1c3f2857bf5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:08.692551 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd5c48-d711-4688-bb31-1c3f2857bf5c None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:08.754450 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:08.789561 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:08.827691 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 171/342] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:08.829119 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3edfd-de87-4395-a8d4-b76d80c0e4a7 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:08.829407 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3edfd-de87-4395-a8d4-b76d80c0e4a7 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:08.829690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3edfd-de87-4395-a8d4-b76d80c0e4a7 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:08.830989 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 172/343] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:08.835764 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3edfd-de87-4395-a8d4-b76d80c0e4a7 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:08.850504 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19912ef9-7aca-4522-933b-0de8dfe7c695 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:08.949657 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e878d-cfb3-416b-9841-e3f1fc2e3f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:08.950716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e878d-cfb3-416b-9841-e3f1fc2e3f35 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:08.951193 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e878d-cfb3-416b-9841-e3f1fc2e3f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:08.951837 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e878d-cfb3-416b-9841-e3f1fc2e3f35 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:08.952820 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e878d-cfb3-416b-9841-e3f1fc2e3f35 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:08.953322 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e878d-cfb3-416b-9841-e3f1fc2e3f35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:08.955109 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e878d-cfb3-416b-9841-e3f1fc2e3f35 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:08.956462 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3edfd-de87-4395-a8d4-b76d80c0e4a7 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:08.975064 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 172/344] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:08.977540 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb173201-da7c-4400-afba-cab4e5e3e9da None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:08.978039 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb173201-da7c-4400-afba-cab4e5e3e9da None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:08.978514 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb173201-da7c-4400-afba-cab4e5e3e9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:09.002674 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c5b18-2198-4281-8c2b-bf1e403cb23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:09.002674 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c5b18-2198-4281-8c2b-bf1e403cb23f None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:09.002674 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c5b18-2198-4281-8c2b-bf1e403cb23f None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:09.002674 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c5b18-2198-4281-8c2b-bf1e403cb23f None admin] PATH_INFO: `/v3/projects/db721c414b9e4fec93c61aef1313fdb0` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:09.005023 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c5b18-2198-4281-8c2b-bf1e403cb23f None admin] RBAC: Authorizing `identity:get_project(project_id=db721c414b9e4fec93c61aef1313fdb0)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:09.007891 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c5b18-2198-4281-8c2b-bf1e403cb23f None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:09.013228 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 173/345] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:08 2022] GET /identity/v3/projects/db721c414b9e4fec93c61aef1313fdb0 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:09.014216 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c5b18-2198-4281-8c2b-bf1e403cb23f None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:09.016007 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-bb173201-da7c-4400-afba-cab4e5e3e9da None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:09.018464 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-bb173201-da7c-4400-afba-cab4e5e3e9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:09.096166 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:09.165377 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 173/346] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:09.170908 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb173201-da7c-4400-afba-cab4e5e3e9da None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:09.224936 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c5b18-2198-4281-8c2b-bf1e403cb23f None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:09.282205 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:09.313161 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7e6aa-9810-482d-a72b-2403ba732eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:09.313819 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7e6aa-9810-482d-a72b-2403ba732eba None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:09.314100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7e6aa-9810-482d-a72b-2403ba732eba None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:09.314371 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7e6aa-9810-482d-a72b-2403ba732eba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:09.392553 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb173201-da7c-4400-afba-cab4e5e3e9da None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:09.442293 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7e6aa-9810-482d-a72b-2403ba732eba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:09.443932 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7e6aa-9810-482d-a72b-2403ba732eba None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:09.450787 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f167f-9ff3-4aa3-bec5-3f6964688402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:09.451941 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f167f-9ff3-4aa3-bec5-3f6964688402 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:09.452214 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f167f-9ff3-4aa3-bec5-3f6964688402 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:09.452483 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f167f-9ff3-4aa3-bec5-3f6964688402 None admin] PATH_INFO: `/v3/groups/c330bc4efa064d4b9146d2d257acee85` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:09.462972 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f167f-9ff3-4aa3-bec5-3f6964688402 None admin] RBAC: Authorizing `identity:get_group(group_id=c330bc4efa064d4b9146d2d257acee85)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:09.465052 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f167f-9ff3-4aa3-bec5-3f6964688402 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:09.467013 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 174/347] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Jun 29 12:07:09 2022] GET /identity/v3/groups/c330bc4efa064d4b9146d2d257acee85 => generated 226 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:09.467685 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f167f-9ff3-4aa3-bec5-3f6964688402 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:09.486544 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:09.576714 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 174/348] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:09.577732 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eed050-b246-4356-b0c6-1ed5d99cd9d1 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:09.578048 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eed050-b246-4356-b0c6-1ed5d99cd9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:09.578311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eed050-b246-4356-b0c6-1ed5d99cd9d1 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:09.579755 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 175/349] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:09.581391 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6208507-d98e-4d69-bac9-fde4af9eb72b None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:09.581674 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6208507-d98e-4d69-bac9-fde4af9eb72b None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:09.581946 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6208507-d98e-4d69-bac9-fde4af9eb72b None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:09.584213 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 176/350] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:09.586503 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6208507-d98e-4d69-bac9-fde4af9eb72b None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:09.610510 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f167f-9ff3-4aa3-bec5-3f6964688402 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:09.623496 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:09.662427 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d180c8a-55ca-401b-8a9d-e9616f38f07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:09.663659 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d180c8a-55ca-401b-8a9d-e9616f38f07f None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:09.663831 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d180c8a-55ca-401b-8a9d-e9616f38f07f None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:09.664067 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d180c8a-55ca-401b-8a9d-e9616f38f07f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:09.684370 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d180c8a-55ca-401b-8a9d-e9616f38f07f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:09.693235 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-6d180c8a-55ca-401b-8a9d-e9616f38f07f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:09.693235 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:09.693235 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:09.693235 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:09.693235 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:09.693235 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:09.693235 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:09.693235 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:09.693235 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:09.693235 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:09.693235 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:09.693235 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:09.693235 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:09.693235 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:09.693235 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:09.693235 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:09.694930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:09.694930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:09.694930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:09.694930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:09.694930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:09.694930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:09.694930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:09.694930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:09.694930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:09.694930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:09.694930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:09.694930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:09.694930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:09.694930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:09.694930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:09.694930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:09.695859 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:09.695859 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:09.695859 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:09.695859 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:09.695859 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:09.695859 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:09.695859 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:09.695859 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:09.695859 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:09.695859 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:09.695859 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:09.695859 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:09.696486 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 175/351] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:09.698012 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d180c8a-55ca-401b-8a9d-e9616f38f07f None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:09.744320 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6208507-d98e-4d69-bac9-fde4af9eb72b None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:09.793768 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b923c-7738-4317-99c8-406bc8360b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:09.794712 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b923c-7738-4317-99c8-406bc8360b93 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:09.795168 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b923c-7738-4317-99c8-406bc8360b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:09.795440 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b923c-7738-4317-99c8-406bc8360b93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:09.796271 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b923c-7738-4317-99c8-406bc8360b93 None admin] RBAC: Adding query filter params (group.id=c330bc4efa064d4b9146d2d257acee85, role.id=419e204ede334962ac80ce56c398bd4f, scope.project.id=db721c414b9e4fec93c61aef1313fdb0) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:09.796580 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b923c-7738-4317-99c8-406bc8360b93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:09.798052 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b923c-7738-4317-99c8-406bc8360b93 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:09.801542 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:09.806207 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 177/352] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Jun 29 12:07:09 2022] GET /identity/v3/role_assignments?group.id=c330bc4efa064d4b9146d2d257acee85&scope.project.id=db721c414b9e4fec93c61aef1313fdb0&role.id=419e204ede334962ac80ce56c398bd4f => generated 260 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:09.807590 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14b551-378a-46df-91c8-8f7bbc85777d None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:09.807885 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14b551-378a-46df-91c8-8f7bbc85777d None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:09.808166 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14b551-378a-46df-91c8-8f7bbc85777d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:09.831581 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-8b14b551-378a-46df-91c8-8f7bbc85777d None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:09.833379 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-8b14b551-378a-46df-91c8-8f7bbc85777d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:09.843526 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d180c8a-55ca-401b-8a9d-e9616f38f07f None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:09.897788 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e85d9-bc38-4fef-af65-6c30fb414b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:09.899254 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e85d9-bc38-4fef-af65-6c30fb414b29 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:09.899862 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e85d9-bc38-4fef-af65-6c30fb414b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:09.900144 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e85d9-bc38-4fef-af65-6c30fb414b29 None admin] PATH_INFO: `/v3/projects/db721c414b9e4fec93c61aef1313fdb0` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:09.901751 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e85d9-bc38-4fef-af65-6c30fb414b29 None admin] RBAC: Authorizing `identity:get_project(project_id=db721c414b9e4fec93c61aef1313fdb0)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:09.904194 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e85d9-bc38-4fef-af65-6c30fb414b29 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:09.906929 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 176/353] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:09 2022] GET /identity/v3/projects/db721c414b9e4fec93c61aef1313fdb0 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:09.908402 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c54ea2-148b-457c-a919-f9c3d9a41b5f None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:09.908692 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c54ea2-148b-457c-a919-f9c3d9a41b5f None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:09.908967 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c54ea2-148b-457c-a919-f9c3d9a41b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:09.931519 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 178/354] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:09.932727 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14b551-378a-46df-91c8-8f7bbc85777d None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:09.932835 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-70c54ea2-148b-457c-a919-f9c3d9a41b5f None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:09.934032 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-70c54ea2-148b-457c-a919-f9c3d9a41b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:09.977817 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:10.025788 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 177/355] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:10.026670 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c54ea2-148b-457c-a919-f9c3d9a41b5f None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:10.062490 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14b551-378a-46df-91c8-8f7bbc85777d None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:10.111061 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:10.122677 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83ae50-f362-4e86-880e-f7721a928056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:10.123908 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83ae50-f362-4e86-880e-f7721a928056 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:10.124196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83ae50-f362-4e86-880e-f7721a928056 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:10.124466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83ae50-f362-4e86-880e-f7721a928056 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:10.125386 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83ae50-f362-4e86-880e-f7721a928056 None admin] RBAC: Adding query filter params (name=member) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:10.125686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83ae50-f362-4e86-880e-f7721a928056 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:10.127543 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83ae50-f362-4e86-880e-f7721a928056 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:10.137974 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 179/356] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 29 12:07:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:10.141772 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aed1b6-0dc1-4c33-a946-9a62370c701a None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:10.142300 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aed1b6-0dc1-4c33-a946-9a62370c701a None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:10.143118 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aed1b6-0dc1-4c33-a946-9a62370c701a None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:10.144726 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 180/357] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:10.145698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aed1b6-0dc1-4c33-a946-9a62370c701a None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:10.177325 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c54ea2-148b-457c-a919-f9c3d9a41b5f None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:10.222142 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60918a8e-deca-462b-a541-ba2195515731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:10.223371 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60918a8e-deca-462b-a541-ba2195515731 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:10.223885 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60918a8e-deca-462b-a541-ba2195515731 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:10.224256 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60918a8e-deca-462b-a541-ba2195515731 None admin] PATH_INFO: `/v3/groups/c330bc4efa064d4b9146d2d257acee85` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:10.227384 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60918a8e-deca-462b-a541-ba2195515731 None admin] RBAC: Authorizing `identity:get_group(group_id=c330bc4efa064d4b9146d2d257acee85)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:10.227822 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60918a8e-deca-462b-a541-ba2195515731 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:10.229650 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 178/358] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Jun 29 12:07:10 2022] GET /identity/v3/groups/c330bc4efa064d4b9146d2d257acee85 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:10.231753 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60918a8e-deca-462b-a541-ba2195515731 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:10.285902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:10.286440 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aed1b6-0dc1-4c33-a946-9a62370c701a None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:10.337187 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af38cf-923b-4057-9258-8353c376c6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:10.338111 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af38cf-923b-4057-9258-8353c376c6ea None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:10.338473 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af38cf-923b-4057-9258-8353c376c6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:10.338877 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af38cf-923b-4057-9258-8353c376c6ea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:10.360181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af38cf-923b-4057-9258-8353c376c6ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:10.371057 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-03af38cf-923b-4057-9258-8353c376c6ea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:07:10.371057 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:10.371057 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:10.371057 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:10.371057 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:10.371057 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:10.371057 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:10.371057 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:10.371057 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:10.371057 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:10.371057 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:10.371057 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:10.371057 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:10.371057 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:10.371057 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:10.371057 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:10.371952 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:10.371952 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:10.371952 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:10.371952 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:10.371952 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:10.371952 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:10.371952 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:10.371952 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:10.371952 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:10.371952 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:10.371952 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:10.371952 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:10.371952 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:10.371952 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:10.371952 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:10.371952 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:10.373052 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:10.373052 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:10.373052 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:10.373052 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:10.373052 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:10.373052 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:10.373052 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:10.373052 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:10.373052 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:10.373052 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:10.373052 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:07:10.373052 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:10.373052 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 181/359] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:10.373851 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af38cf-923b-4057-9258-8353c376c6ea None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:10.382541 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60918a8e-deca-462b-a541-ba2195515731 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:10.423654 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a4b20-1def-4684-9c42-ec853f5458c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:10.424558 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a4b20-1def-4684-9c42-ec853f5458c1 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:10.424847 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a4b20-1def-4684-9c42-ec853f5458c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:10.425123 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a4b20-1def-4684-9c42-ec853f5458c1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:10.442373 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a4b20-1def-4684-9c42-ec853f5458c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:10.451101 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-d44a4b20-1def-4684-9c42-ec853f5458c1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:07:10.451101 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:10.451101 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:10.451101 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:10.451101 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:10.451101 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:10.451101 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:10.451101 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:10.451101 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:10.451101 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:10.451101 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:10.451101 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:10.451101 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:10.451101 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:10.451101 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:10.451101 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:10.452076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:10.452076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:10.452076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:10.452076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:10.452076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:10.452076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:10.452076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:10.452076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:10.452076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:10.452076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:10.452076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:10.452076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:10.452076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:10.452076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:10.452076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:10.452076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:10.452880 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:10.452880 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:10.452880 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:10.452880 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:10.452880 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:10.452880 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:10.452880 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:10.452880 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:10.452880 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:10.452880 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:10.452880 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:07:10.452880 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:10.453487 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 179/360] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 29 12:07:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:10.454546 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0f8ec-0908-449f-9370-dc8633cf01c8 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:10.454860 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0f8ec-0908-449f-9370-dc8633cf01c8 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:10.456970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:10.461530 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0f8ec-0908-449f-9370-dc8633cf01c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:10.483174 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-45c0f8ec-0908-449f-9370-dc8633cf01c8 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:10.484400 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-45c0f8ec-0908-449f-9370-dc8633cf01c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:10.527856 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af38cf-923b-4057-9258-8353c376c6ea None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:10.575821 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c0227-6a34-4790-960e-4a5b7d7d737e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:10.576911 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c0227-6a34-4790-960e-4a5b7d7d737e None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:10.577436 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c0227-6a34-4790-960e-4a5b7d7d737e None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:10.578010 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c0227-6a34-4790-960e-4a5b7d7d737e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:10.589571 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 180/361] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:10.590501 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0f8ec-0908-449f-9370-dc8633cf01c8 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:10.630271 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:10.680727 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c0227-6a34-4790-960e-4a5b7d7d737e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:10.682200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c0227-6a34-4790-960e-4a5b7d7d737e None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:10.720106 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0f8ec-0908-449f-9370-dc8633cf01c8 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:10.744505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:10.775619 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e34fe-acec-46f4-9a6f-606b9cebc542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:10.776295 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e34fe-acec-46f4-9a6f-606b9cebc542 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:10.776578 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e34fe-acec-46f4-9a6f-606b9cebc542 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:10.777319 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e34fe-acec-46f4-9a6f-606b9cebc542 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:10.778192 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e34fe-acec-46f4-9a6f-606b9cebc542 None admin] RBAC: Adding query filter params (group.id=c330bc4efa064d4b9146d2d257acee85, role.id=b0982ad59fae4158ba9249550f6452cd, scope.project.id=db721c414b9e4fec93c61aef1313fdb0) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:10.778926 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e34fe-acec-46f4-9a6f-606b9cebc542 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:10.780585 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e34fe-acec-46f4-9a6f-606b9cebc542 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:10.789710 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 181/362] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Jun 29 12:07:10 2022] GET /identity/v3/role_assignments?group.id=c330bc4efa064d4b9146d2d257acee85&scope.project.id=db721c414b9e4fec93c61aef1313fdb0&role.id=b0982ad59fae4158ba9249550f6452cd => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:10.790546 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e34fe-acec-46f4-9a6f-606b9cebc542 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:10.808014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 182/363] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:10.808958 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c0227-6a34-4790-960e-4a5b7d7d737e None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:10.904467 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:10.917670 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e34fe-acec-46f4-9a6f-606b9cebc542 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:10.934967 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c0227-6a34-4790-960e-4a5b7d7d737e None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:10.959075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6e2ec-3101-4cff-9d6e-37768d5b9871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:10.959075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6e2ec-3101-4cff-9d6e-37768d5b9871 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:10.959383 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6e2ec-3101-4cff-9d6e-37768d5b9871 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:10.959629 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6e2ec-3101-4cff-9d6e-37768d5b9871 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:10.962188 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6e2ec-3101-4cff-9d6e-37768d5b9871 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:10.962417 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6e2ec-3101-4cff-9d6e-37768d5b9871 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:10.964190 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6e2ec-3101-4cff-9d6e-37768d5b9871 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:10.974380 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 182/364] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 29 12:07:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:10.975392 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6e2ec-3101-4cff-9d6e-37768d5b9871 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:10.976263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fb092-18e1-47de-afe3-1a1973b9fd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:10.977190 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fb092-18e1-47de-afe3-1a1973b9fd30 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:10.977697 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fb092-18e1-47de-afe3-1a1973b9fd30 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:10.978225 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fb092-18e1-47de-afe3-1a1973b9fd30 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:10.979219 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8fb092-18e1-47de-afe3-1a1973b9fd30 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:10.979669 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8fb092-18e1-47de-afe3-1a1973b9fd30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:10.981222 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8fb092-18e1-47de-afe3-1a1973b9fd30 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:10.991485 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 183/365] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:10.992658 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fb092-18e1-47de-afe3-1a1973b9fd30 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:11.015682 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:11.104228 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6e2ec-3101-4cff-9d6e-37768d5b9871 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:11.134696 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fb092-18e1-47de-afe3-1a1973b9fd30 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:11.153832 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f882b61-3219-4a04-bce8-a6d6aba3abcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:11.155165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f882b61-3219-4a04-bce8-a6d6aba3abcc None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:11.155636 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f882b61-3219-4a04-bce8-a6d6aba3abcc None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:11.156095 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f882b61-3219-4a04-bce8-a6d6aba3abcc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:11.170432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f882b61-3219-4a04-bce8-a6d6aba3abcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:11.178029 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0f650-306d-4de6-903b-48e015e18dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:11.179497 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0f650-306d-4de6-903b-48e015e18dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:11.179871 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0f650-306d-4de6-903b-48e015e18dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:11.180156 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0f650-306d-4de6-903b-48e015e18dd9 None admin] PATH_INFO: `/v3/projects/5fd79607efc84957a3c849d0d14a8f76` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:11.181520 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b0f650-306d-4de6-903b-48e015e18dd9 None admin] RBAC: Authorizing `identity:get_project(project_id=5fd79607efc84957a3c849d0d14a8f76)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:11.182033 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-9f882b61-3219-4a04-bce8-a6d6aba3abcc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:07:11.182033 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:11.182033 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:11.182033 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:11.182033 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:11.182033 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:11.182033 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:11.182033 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:11.182033 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:11.182033 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:11.182033 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:11.182033 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:11.182033 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:11.182033 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:11.182033 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:11.182033 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:11.182912 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:11.182912 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:11.182912 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:11.182912 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:11.182912 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:11.182912 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:11.182912 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:11.182912 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:11.182912 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:11.182912 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:11.182912 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:11.182912 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:11.182912 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:11.182912 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:11.182912 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:11.182912 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:11.183743 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:11.183743 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:11.183743 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:11.183743 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:11.183743 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:11.183743 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:11.183743 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:11.183743 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:11.183743 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:11.183743 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:11.183743 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:07:11.183743 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:11.184352 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b0f650-306d-4de6-903b-48e015e18dd9 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:11.184849 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 184/366] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:10 2022] GET /identity/v3/projects/5fd79607efc84957a3c849d0d14a8f76 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:11.185437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0f650-306d-4de6-903b-48e015e18dd9 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:11.186789 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 183/367] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:07:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:11.187758 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f882b61-3219-4a04-bce8-a6d6aba3abcc None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:11.212914 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:11.316258 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:11.336914 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f882b61-3219-4a04-bce8-a6d6aba3abcc None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:11.339395 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0f650-306d-4de6-903b-48e015e18dd9 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:11.385344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddba6bf-3c81-4c32-bf80-ac5b52a67a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:11.386140 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddba6bf-3c81-4c32-bf80-ac5b52a67a74 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:11.386431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddba6bf-3c81-4c32-bf80-ac5b52a67a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:11.386863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddba6bf-3c81-4c32-bf80-ac5b52a67a74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:11.390733 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd1483-b40a-4bf9-aac3-ad7c8a0cd4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:11.392530 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd1483-b40a-4bf9-aac3-ad7c8a0cd4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:11.392818 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd1483-b40a-4bf9-aac3-ad7c8a0cd4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:11.393097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd1483-b40a-4bf9-aac3-ad7c8a0cd4f4 None admin] PATH_INFO: `/v3/users/fcd4960ef4eb4cab9e55e568a8ebe9c1` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:11.394312 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd1483-b40a-4bf9-aac3-ad7c8a0cd4f4 None admin] RBAC: Authorizing `identity:get_user(user_id=fcd4960ef4eb4cab9e55e568a8ebe9c1)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:11.395829 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd1483-b40a-4bf9-aac3-ad7c8a0cd4f4 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:11.398096 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 185/368] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:11 2022] GET /identity/v3/users/fcd4960ef4eb4cab9e55e568a8ebe9c1 => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:11.399510 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd1483-b40a-4bf9-aac3-ad7c8a0cd4f4 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:11.467189 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddba6bf-3c81-4c32-bf80-ac5b52a67a74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:11.468691 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddba6bf-3c81-4c32-bf80-ac5b52a67a74 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:11.485172 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:11.546515 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd1483-b40a-4bf9-aac3-ad7c8a0cd4f4 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:11.588155 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0cab5-e005-4af0-9ab5-2b236bbd5551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:11.588763 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0cab5-e005-4af0-9ab5-2b236bbd5551 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:11.589058 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0cab5-e005-4af0-9ab5-2b236bbd5551 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:11.589342 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0cab5-e005-4af0-9ab5-2b236bbd5551 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:11.590097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0cab5-e005-4af0-9ab5-2b236bbd5551 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:11.590409 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0cab5-e005-4af0-9ab5-2b236bbd5551 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:11.592899 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0cab5-e005-4af0-9ab5-2b236bbd5551 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:11.598984 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 184/369] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:11.599921 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddba6bf-3c81-4c32-bf80-ac5b52a67a74 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:11.602981 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 186/370] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:11.603682 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0cab5-e005-4af0-9ab5-2b236bbd5551 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:11.621903 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:11.737250 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0cab5-e005-4af0-9ab5-2b236bbd5551 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:11.755856 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddba6bf-3c81-4c32-bf80-ac5b52a67a74 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:11.773970 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:11.778139 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761af5d-7512-4b8b-8783-8d51f526e478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:11.778921 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761af5d-7512-4b8b-8783-8d51f526e478 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:11.779253 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761af5d-7512-4b8b-8783-8d51f526e478 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:11.779535 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761af5d-7512-4b8b-8783-8d51f526e478 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:11.780606 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761af5d-7512-4b8b-8783-8d51f526e478 None admin] RBAC: Adding query filter params (role.id=08fb0ec8050c40ea8efd40e54fde52aa, user.id=fcd4960ef4eb4cab9e55e568a8ebe9c1, scope.system=all) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:11.780923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761af5d-7512-4b8b-8783-8d51f526e478 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:11.782943 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761af5d-7512-4b8b-8783-8d51f526e478 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:11.797414 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 187/371] 10.222.0.13 () {56 vars in 1308 bytes} [Wed Jun 29 12:07:11 2022] GET /identity/v3/role_assignments?user.id=fcd4960ef4eb4cab9e55e568a8ebe9c1&scope.system=all&role.id=08fb0ec8050c40ea8efd40e54fde52aa => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:11.798960 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761af5d-7512-4b8b-8783-8d51f526e478 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:11.806351 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60b85c-0469-4b43-a773-67af7d76cdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:11.808348 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60b85c-0469-4b43-a773-67af7d76cdf4 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:11.808631 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60b85c-0469-4b43-a773-67af7d76cdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:11.814100 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60b85c-0469-4b43-a773-67af7d76cdf4 None admin] PATH_INFO: `/v3/groups/c330bc4efa064d4b9146d2d257acee85` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:11.817468 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60b85c-0469-4b43-a773-67af7d76cdf4 None admin] RBAC: Authorizing `identity:get_group(group_id=c330bc4efa064d4b9146d2d257acee85)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:11.818978 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60b85c-0469-4b43-a773-67af7d76cdf4 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:11.823611 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 185/372] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Jun 29 12:07:11 2022] GET /identity/v3/groups/c330bc4efa064d4b9146d2d257acee85 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:11.825980 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60b85c-0469-4b43-a773-67af7d76cdf4 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:11.950187 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:12.004560 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761af5d-7512-4b8b-8783-8d51f526e478 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:12.019211 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60b85c-0469-4b43-a773-67af7d76cdf4 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:12.055740 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cef5d-0656-4009-917b-84e5bce74089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:12.056756 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cef5d-0656-4009-917b-84e5bce74089 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:12.057227 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cef5d-0656-4009-917b-84e5bce74089 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:12.057709 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cef5d-0656-4009-917b-84e5bce74089 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:12.075344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a254b8-a70d-4ee4-b7a8-fce028906fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:12.076855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a254b8-a70d-4ee4-b7a8-fce028906fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:12.077218 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a254b8-a70d-4ee4-b7a8-fce028906fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:12.077559 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a254b8-a70d-4ee4-b7a8-fce028906fa6 None admin] PATH_INFO: `/v3/projects/5fd79607efc84957a3c849d0d14a8f76` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:12.079274 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a254b8-a70d-4ee4-b7a8-fce028906fa6 None admin] RBAC: Authorizing `identity:get_project(project_id=5fd79607efc84957a3c849d0d14a8f76)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:12.081101 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a254b8-a70d-4ee4-b7a8-fce028906fa6 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:12.086671 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 186/373] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:11 2022] GET /identity/v3/projects/5fd79607efc84957a3c849d0d14a8f76 => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:12.087651 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a254b8-a70d-4ee4-b7a8-fce028906fa6 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:12.171343 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:12.179520 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cef5d-0656-4009-917b-84e5bce74089 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:12.183110 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cef5d-0656-4009-917b-84e5bce74089 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:12.249344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a254b8-a70d-4ee4-b7a8-fce028906fa6 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:12.291470 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:12.317792 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903476e-f6ff-4532-bed7-125e9e2a5667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:12.318470 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903476e-f6ff-4532-bed7-125e9e2a5667 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:12.318784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903476e-f6ff-4532-bed7-125e9e2a5667 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:12.319065 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903476e-f6ff-4532-bed7-125e9e2a5667 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:12.319935 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4903476e-f6ff-4532-bed7-125e9e2a5667 None admin] RBAC: Adding query filter params (group.id=c330bc4efa064d4b9146d2d257acee85, role.id=419e204ede334962ac80ce56c398bd4f, scope.project.id=5fd79607efc84957a3c849d0d14a8f76) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:12.320255 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4903476e-f6ff-4532-bed7-125e9e2a5667 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:12.322089 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4903476e-f6ff-4532-bed7-125e9e2a5667 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:12.328072 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 187/374] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Jun 29 12:07:12 2022] GET /identity/v3/role_assignments?group.id=c330bc4efa064d4b9146d2d257acee85&scope.project.id=5fd79607efc84957a3c849d0d14a8f76&role.id=419e204ede334962ac80ce56c398bd4f => generated 260 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:12.329808 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903476e-f6ff-4532-bed7-125e9e2a5667 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:12.376139 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 188/375] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:12.377893 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f13087-37ab-475c-b8b5-9f47d8ee364a None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:12.378193 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f13087-37ab-475c-b8b5-9f47d8ee364a None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:12.378561 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f13087-37ab-475c-b8b5-9f47d8ee364a None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:12.379975 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 189/376] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:12.380723 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f13087-37ab-475c-b8b5-9f47d8ee364a None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:12.528398 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903476e-f6ff-4532-bed7-125e9e2a5667 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:12.543897 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:12.575245 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097b845-3b0a-4f3d-a081-29930faa488d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:12.576131 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097b845-3b0a-4f3d-a081-29930faa488d None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:12.576419 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097b845-3b0a-4f3d-a081-29930faa488d None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:12.576707 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097b845-3b0a-4f3d-a081-29930faa488d None admin] PATH_INFO: `/v3/groups/c330bc4efa064d4b9146d2d257acee85` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:12.577911 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8097b845-3b0a-4f3d-a081-29930faa488d None admin] RBAC: Authorizing `identity:get_group(group_id=c330bc4efa064d4b9146d2d257acee85)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:12.579419 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8097b845-3b0a-4f3d-a081-29930faa488d None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:12.586762 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 188/377] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Jun 29 12:07:12 2022] GET /identity/v3/groups/c330bc4efa064d4b9146d2d257acee85 => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:12.588311 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fd901-8c56-4ef4-b906-d1f44700ab5e None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:12.588607 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fd901-8c56-4ef4-b906-d1f44700ab5e None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:12.588974 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fd901-8c56-4ef4-b906-d1f44700ab5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:12.607299 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-7b8fd901-8c56-4ef4-b906-d1f44700ab5e None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:12.608664 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-7b8fd901-8c56-4ef4-b906-d1f44700ab5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:12.633095 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f13087-37ab-475c-b8b5-9f47d8ee364a None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:12.697006 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c00055-b2b5-4bcf-b241-e8d3ddef1c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:12.698270 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c00055-b2b5-4bcf-b241-e8d3ddef1c29 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:12.698788 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c00055-b2b5-4bcf-b241-e8d3ddef1c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:12.699237 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c00055-b2b5-4bcf-b241-e8d3ddef1c29 None admin] PATH_INFO: `/v3/projects/74e1ea071109496291a5ab7856fef887` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:12.701478 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c00055-b2b5-4bcf-b241-e8d3ddef1c29 None admin] RBAC: Authorizing `identity:get_project(project_id=74e1ea071109496291a5ab7856fef887)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:12.704419 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c00055-b2b5-4bcf-b241-e8d3ddef1c29 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:12.707978 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 190/378] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:12 2022] GET /identity/v3/projects/74e1ea071109496291a5ab7856fef887 => generated 344 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:12.709136 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c00055-b2b5-4bcf-b241-e8d3ddef1c29 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:12.728045 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 189/379] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:12.729281 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8fd901-8c56-4ef4-b906-d1f44700ab5e None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:12.795948 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:12.879987 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c00055-b2b5-4bcf-b241-e8d3ddef1c29 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:12.881384 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8fd901-8c56-4ef4-b906-d1f44700ab5e None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:12.896264 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:12.927057 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c0290-7f20-49da-83f3-59e59a003bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:12.928226 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c0290-7f20-49da-83f3-59e59a003bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:12.929232 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c0290-7f20-49da-83f3-59e59a003bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:12.929937 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c0290-7f20-49da-83f3-59e59a003bb9 None admin] PATH_INFO: `/v3/groups/79c2b175e7464eceb075454257ead955` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:12.930353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c853b74-f9d1-45dd-9cbe-781580a07611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:12.931115 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c853b74-f9d1-45dd-9cbe-781580a07611 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:12.931491 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c853b74-f9d1-45dd-9cbe-781580a07611 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:12.931841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c853b74-f9d1-45dd-9cbe-781580a07611 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:12.932945 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c853b74-f9d1-45dd-9cbe-781580a07611 None admin] RBAC: Adding query filter params (group.id=c330bc4efa064d4b9146d2d257acee85, role.id=b0982ad59fae4158ba9249550f6452cd, scope.project.id=5fd79607efc84957a3c849d0d14a8f76) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:12.933334 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c853b74-f9d1-45dd-9cbe-781580a07611 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:12.935862 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c853b74-f9d1-45dd-9cbe-781580a07611 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:12.939422 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c0290-7f20-49da-83f3-59e59a003bb9 None admin] RBAC: Authorizing `identity:get_group(group_id=79c2b175e7464eceb075454257ead955)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:12.941882 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c0290-7f20-49da-83f3-59e59a003bb9 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:12.943149 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 191/380] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Jun 29 12:07:12 2022] GET /identity/v3/role_assignments?group.id=c330bc4efa064d4b9146d2d257acee85&scope.project.id=5fd79607efc84957a3c849d0d14a8f76&role.id=b0982ad59fae4158ba9249550f6452cd => generated 260 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:12.944054 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 190/381] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Jun 29 12:07:12 2022] GET /identity/v3/groups/79c2b175e7464eceb075454257ead955 => generated 229 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:12.944177 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c853b74-f9d1-45dd-9cbe-781580a07611 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:12.957849 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c0290-7f20-49da-83f3-59e59a003bb9 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:13.081081 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c853b74-f9d1-45dd-9cbe-781580a07611 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:13.083216 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:13.128089 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242c72c-999e-4b06-a09e-20c06df90594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:13.129462 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242c72c-999e-4b06-a09e-20c06df90594 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:13.129967 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242c72c-999e-4b06-a09e-20c06df90594 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:13.130509 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242c72c-999e-4b06-a09e-20c06df90594 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:13.143367 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242c72c-999e-4b06-a09e-20c06df90594 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:13.152164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-8242c72c-999e-4b06-a09e-20c06df90594 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:13.152164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:13.152164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:13.152164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:13.152164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:13.152164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:13.152164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:13.152164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:13.152164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:13.152164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:13.152164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:13.152164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:13.152164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:13.152164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:13.152164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:13.152164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:13.153195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:13.153195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:13.153195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:13.153195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:13.153195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:13.153195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:13.153195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:13.153195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:13.153195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:13.153195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:13.153195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:13.153195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:13.153195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:13.153195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:13.153195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:13.153195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:13.154046 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:13.154046 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:13.154046 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:13.154046 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:13.154046 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:13.154046 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:13.154046 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:13.154046 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:13.154046 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:13.154046 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:13.154046 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:13.154046 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:13.157127 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 192/382] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:13.164870 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242c72c-999e-4b06-a09e-20c06df90594 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:13.167077 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c0290-7f20-49da-83f3-59e59a003bb9 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:13.207131 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8632e6-71b0-47cc-afb0-2d30ab47e0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:13.207797 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8632e6-71b0-47cc-afb0-2d30ab47e0dc None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:13.208076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8632e6-71b0-47cc-afb0-2d30ab47e0dc None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:13.208346 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8632e6-71b0-47cc-afb0-2d30ab47e0dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:13.209173 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8632e6-71b0-47cc-afb0-2d30ab47e0dc None admin] RBAC: Adding query filter params (group.id=79c2b175e7464eceb075454257ead955, role.id=5ef3464f4436446b88430cdf7cc1a3d7, scope.project.id=74e1ea071109496291a5ab7856fef887) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:13.209479 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8632e6-71b0-47cc-afb0-2d30ab47e0dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:13.211223 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8632e6-71b0-47cc-afb0-2d30ab47e0dc None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:13.218596 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 191/383] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Jun 29 12:07:12 2022] GET /identity/v3/role_assignments?group.id=79c2b175e7464eceb075454257ead955&scope.project.id=74e1ea071109496291a5ab7856fef887&role.id=5ef3464f4436446b88430cdf7cc1a3d7 => generated 260 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:07:13.220097 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1b788-88bf-4ea2-b9cb-58e16b2b800e None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:13.220409 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1b788-88bf-4ea2-b9cb-58e16b2b800e None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:13.220687 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1b788-88bf-4ea2-b9cb-58e16b2b800e None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:13.222242 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 192/384] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:13.228582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6375d2-f42f-460d-92fc-6043ce07f11f None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:13.228873 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6375d2-f42f-460d-92fc-6043ce07f11f None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:13.229429 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6375d2-f42f-460d-92fc-6043ce07f11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:13.247911 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-5d6375d2-f42f-460d-92fc-6043ce07f11f None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:13.249168 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-5d6375d2-f42f-460d-92fc-6043ce07f11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:13.299372 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:13.353222 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242c72c-999e-4b06-a09e-20c06df90594 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:13.388489 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 193/385] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:07:13.391774 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1fb42-7b9a-49d5-a64a-324b883e3502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:13.392734 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1fb42-7b9a-49d5-a64a-324b883e3502 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:13.393235 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1fb42-7b9a-49d5-a64a-324b883e3502 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:13.393726 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1fb42-7b9a-49d5-a64a-324b883e3502 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:13.394756 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1fb42-7b9a-49d5-a64a-324b883e3502 None admin] RBAC: Adding query filter params (name=member) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:13.395291 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1fb42-7b9a-49d5-a64a-324b883e3502 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:13.396925 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1fb42-7b9a-49d5-a64a-324b883e3502 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:13.407708 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 193/386] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 29 12:07:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:13.414083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6375d2-f42f-460d-92fc-6043ce07f11f None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:13.429829 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1fb42-7b9a-49d5-a64a-324b883e3502 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:13.470160 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:13.568342 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1fb42-7b9a-49d5-a64a-324b883e3502 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:13.610017 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6375d2-f42f-460d-92fc-6043ce07f11f None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:13.630489 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31927611-6170-4f42-9b00-7b73cf1272f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:13.631767 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31927611-6170-4f42-9b00-7b73cf1272f1 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:13.632777 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31927611-6170-4f42-9b00-7b73cf1272f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:13.633283 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31927611-6170-4f42-9b00-7b73cf1272f1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:13.653923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31927611-6170-4f42-9b00-7b73cf1272f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:13.665664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-31927611-6170-4f42-9b00-7b73cf1272f1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:07:13.665664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:13.665664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:13.665664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:13.665664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:13.665664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:13.665664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:13.665664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:13.665664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:13.665664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:13.665664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:13.665664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:13.665664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:13.665664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:13.665664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:13.665664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:13.666772 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:13.666772 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:13.666772 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:13.666772 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:13.666772 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:13.666772 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:13.666772 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:13.666772 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:13.666772 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:13.666772 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:13.666772 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:13.666772 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:13.666772 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:13.666772 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:13.666772 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:13.666772 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:13.667595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:13.667595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:13.667595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:13.667595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:13.667595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:13.667595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:13.667595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:13.667595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:13.667595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:13.667595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:13.667595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:07:13.667595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:13.675766 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 194/387] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 29 12:07:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:07:13.685180 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31927611-6170-4f42-9b00-7b73cf1272f1 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:13.695513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded9a77-b56b-4901-943d-3bb73095ddc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:13.696748 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded9a77-b56b-4901-943d-3bb73095ddc0 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:13.699121 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded9a77-b56b-4901-943d-3bb73095ddc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:13.699632 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded9a77-b56b-4901-943d-3bb73095ddc0 None admin] PATH_INFO: `/v3/groups/c330bc4efa064d4b9146d2d257acee85` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:13.701169 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded9a77-b56b-4901-943d-3bb73095ddc0 None admin] RBAC: Authorizing `identity:get_group(group_id=c330bc4efa064d4b9146d2d257acee85)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:13.705613 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded9a77-b56b-4901-943d-3bb73095ddc0 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:13.707649 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 194/388] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Jun 29 12:07:13 2022] GET /identity/v3/groups/c330bc4efa064d4b9146d2d257acee85 => generated 226 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:13.715690 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded9a77-b56b-4901-943d-3bb73095ddc0 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:13.792431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:13.858428 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:13.888457 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31927611-6170-4f42-9b00-7b73cf1272f1 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:13.908549 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded9a77-b56b-4901-943d-3bb73095ddc0 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:13.948436 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d26295-9ea0-4120-b5c7-7ce125c2b2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:13.949466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d26295-9ea0-4120-b5c7-7ce125c2b2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:13.949965 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d26295-9ea0-4120-b5c7-7ce125c2b2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:13.950441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d26295-9ea0-4120-b5c7-7ce125c2b2b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:13.951401 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d26295-9ea0-4120-b5c7-7ce125c2b2b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:13.951916 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d26295-9ea0-4120-b5c7-7ce125c2b2b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:13.953493 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d26295-9ea0-4120-b5c7-7ce125c2b2b2 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:13.963008 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 195/389] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:13.968896 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d26295-9ea0-4120-b5c7-7ce125c2b2b2 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:13.976545 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef3c6b-53fe-4d3a-a393-24d391595abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:13.977296 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef3c6b-53fe-4d3a-a393-24d391595abb None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:13.978686 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef3c6b-53fe-4d3a-a393-24d391595abb None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:13.978686 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef3c6b-53fe-4d3a-a393-24d391595abb None admin] PATH_INFO: `/v3/projects/db721c414b9e4fec93c61aef1313fdb0` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:13.980208 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef3c6b-53fe-4d3a-a393-24d391595abb None admin] RBAC: Authorizing `identity:get_project(project_id=db721c414b9e4fec93c61aef1313fdb0)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:13.983041 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef3c6b-53fe-4d3a-a393-24d391595abb None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:13.988023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 195/390] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:13 2022] GET /identity/v3/projects/db721c414b9e4fec93c61aef1313fdb0 => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:13.994246 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef3c6b-53fe-4d3a-a393-24d391595abb None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:14.150531 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d26295-9ea0-4120-b5c7-7ce125c2b2b2 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:14.187906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06816987-f350-49a9-a5f1-78d296f7b39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:14.188896 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06816987-f350-49a9-a5f1-78d296f7b39c None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:14.189188 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06816987-f350-49a9-a5f1-78d296f7b39c None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:14.189792 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06816987-f350-49a9-a5f1-78d296f7b39c None admin] PATH_INFO: `/v3/groups/c330bc4efa064d4b9146d2d257acee85` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:14.191144 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06816987-f350-49a9-a5f1-78d296f7b39c None admin] RBAC: Authorizing `identity:get_group(group_id=c330bc4efa064d4b9146d2d257acee85)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:14.192726 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06816987-f350-49a9-a5f1-78d296f7b39c None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:14.194915 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 196/391] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Jun 29 12:07:13 2022] GET /identity/v3/groups/c330bc4efa064d4b9146d2d257acee85 => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:14.200397 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06816987-f350-49a9-a5f1-78d296f7b39c None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:14.203519 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef3c6b-53fe-4d3a-a393-24d391595abb None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:14.215970 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:14.247000 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:14.263368 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700d0db-663e-41cf-bb3a-cf887903640c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:14.264581 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700d0db-663e-41cf-bb3a-cf887903640c None admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:14.264861 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700d0db-663e-41cf-bb3a-cf887903640c None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:14.265134 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700d0db-663e-41cf-bb3a-cf887903640c None admin] PATH_INFO: `/v3/projects/db721c414b9e4fec93c61aef1313fdb0/groups/c330bc4efa064d4b9146d2d257acee85/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:14.267181 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700d0db-663e-41cf-bb3a-cf887903640c None admin] RBAC: Authorizing `identity:create_grant(project_id=db721c414b9e4fec93c61aef1313fdb0, group_id=c330bc4efa064d4b9146d2d257acee85, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:14.269156 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700d0db-663e-41cf-bb3a-cf887903640c None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:14.285241 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 196/392] 10.222.0.13 () {58 vars in 1442 bytes} [Wed Jun 29 12:07:13 2022] PUT /identity/v3/projects/db721c414b9e4fec93c61aef1313fdb0/groups/c330bc4efa064d4b9146d2d257acee85/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:07:14.428995 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06816987-f350-49a9-a5f1-78d296f7b39c None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:14.479017 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc83d9-613f-4a59-be8a-fbd18e810d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:14.479966 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc83d9-613f-4a59-be8a-fbd18e810d24 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:14.480261 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc83d9-613f-4a59-be8a-fbd18e810d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:14.480542 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc83d9-613f-4a59-be8a-fbd18e810d24 None admin] PATH_INFO: `/v3/projects/db721c414b9e4fec93c61aef1313fdb0` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:14.481770 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc83d9-613f-4a59-be8a-fbd18e810d24 None admin] RBAC: Authorizing `identity:get_project(project_id=db721c414b9e4fec93c61aef1313fdb0)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:14.483302 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc83d9-613f-4a59-be8a-fbd18e810d24 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:14.485081 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 197/393] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:14 2022] GET /identity/v3/projects/db721c414b9e4fec93c61aef1313fdb0 => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:14.491738 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700d0db-663e-41cf-bb3a-cf887903640c None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:14.605727 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700d0db-663e-41cf-bb3a-cf887903640c None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:14.643856 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cea7ac-1898-480a-bc9f-994fa62e5df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:14.644793 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cea7ac-1898-480a-bc9f-994fa62e5df1 None admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:14.645076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cea7ac-1898-480a-bc9f-994fa62e5df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:14.645394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cea7ac-1898-480a-bc9f-994fa62e5df1 None admin] PATH_INFO: `/v3/projects/db721c414b9e4fec93c61aef1313fdb0/groups/c330bc4efa064d4b9146d2d257acee85/roles/b0982ad59fae4158ba9249550f6452cd` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:14.648379 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cea7ac-1898-480a-bc9f-994fa62e5df1 None admin] RBAC: Authorizing `identity:create_grant(project_id=db721c414b9e4fec93c61aef1313fdb0, group_id=c330bc4efa064d4b9146d2d257acee85, role_id=b0982ad59fae4158ba9249550f6452cd)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:14.650013 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cea7ac-1898-480a-bc9f-994fa62e5df1 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:14.668460 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 197/394] 10.222.0.13 () {58 vars in 1442 bytes} [Wed Jun 29 12:07:14 2022] PUT /identity/v3/projects/db721c414b9e4fec93c61aef1313fdb0/groups/c330bc4efa064d4b9146d2d257acee85/roles/b0982ad59fae4158ba9249550f6452cd => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:07:14.702415 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31deedd4-db9b-467c-977c-3e5fd39bc748 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:14.702598 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31deedd4-db9b-467c-977c-3e5fd39bc748 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:14.702914 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31deedd4-db9b-467c-977c-3e5fd39bc748 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:14.704717 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 198/395] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:14.718923 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa073819-3bb0-48cf-a559-1a8d37f3d0bc None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:14.719252 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa073819-3bb0-48cf-a559-1a8d37f3d0bc None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:14.719490 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa073819-3bb0-48cf-a559-1a8d37f3d0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:14.738620 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-fa073819-3bb0-48cf-a559-1a8d37f3d0bc None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:14.739987 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-fa073819-3bb0-48cf-a559-1a8d37f3d0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:14.760920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:14.823013 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 198/396] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:14.862317 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31deedd4-db9b-467c-977c-3e5fd39bc748 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:14.973535 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:15.001915 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31deedd4-db9b-467c-977c-3e5fd39bc748 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:15.043226 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec66c7e-6e0d-4d9a-8aa5-2bf7bc46db59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:15.044094 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec66c7e-6e0d-4d9a-8aa5-2bf7bc46db59 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:15.044403 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec66c7e-6e0d-4d9a-8aa5-2bf7bc46db59 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:15.044755 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec66c7e-6e0d-4d9a-8aa5-2bf7bc46db59 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:15.057226 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec66c7e-6e0d-4d9a-8aa5-2bf7bc46db59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:15.065234 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-2ec66c7e-6e0d-4d9a-8aa5-2bf7bc46db59 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:15.065234 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:15.065234 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:15.065234 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:15.065234 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:15.065234 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:15.065234 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:15.065234 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:15.065234 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:15.065234 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:15.065234 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:15.065234 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:15.065234 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:15.065234 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:15.065234 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:15.065234 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:15.066137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:15.066137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:15.066137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:15.066137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:15.066137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:15.066137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:15.066137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:15.066137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:15.066137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:15.066137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:15.066137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:15.066137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:15.066137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:15.066137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:15.066137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:15.066137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:15.067757 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:15.067757 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:15.067757 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:15.067757 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:15.067757 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:15.067757 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:15.067757 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:15.067757 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:15.067757 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:15.067757 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:15.067757 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:15.067757 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:15.067757 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 199/397] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:15.072565 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa073819-3bb0-48cf-a559-1a8d37f3d0bc None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:15.210967 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa073819-3bb0-48cf-a559-1a8d37f3d0bc None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:15.255651 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032cbbd-c1e4-49d5-8600-784cd797fbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:15.256261 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032cbbd-c1e4-49d5-8600-784cd797fbe2 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:15.256542 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032cbbd-c1e4-49d5-8600-784cd797fbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:15.256865 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032cbbd-c1e4-49d5-8600-784cd797fbe2 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:15.257623 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032cbbd-c1e4-49d5-8600-784cd797fbe2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:15.257927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032cbbd-c1e4-49d5-8600-784cd797fbe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:15.259463 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032cbbd-c1e4-49d5-8600-784cd797fbe2 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:15.268844 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 199/398] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 29 12:07:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:15.275362 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec66c7e-6e0d-4d9a-8aa5-2bf7bc46db59 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:15.310573 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6b927-f027-41df-8b98-9471de203866 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:15.310945 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6b927-f027-41df-8b98-9471de203866 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:15.311241 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6b927-f027-41df-8b98-9471de203866 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:15.312778 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 200/399] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:15.330931 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7cd6e-f711-4dd8-9ccd-3abe6977717a None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:15.331218 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7cd6e-f711-4dd8-9ccd-3abe6977717a None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:15.331486 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7cd6e-f711-4dd8-9ccd-3abe6977717a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:15.367722 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-5df7cd6e-f711-4dd8-9ccd-3abe6977717a None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:15.368931 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-5df7cd6e-f711-4dd8-9ccd-3abe6977717a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:15.394562 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:15.403661 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec66c7e-6e0d-4d9a-8aa5-2bf7bc46db59 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:15.446799 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ce8d8-6ad3-403c-8342-13685e2cf586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:15.447673 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ce8d8-6ad3-403c-8342-13685e2cf586 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:15.447954 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ce8d8-6ad3-403c-8342-13685e2cf586 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:15.448227 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ce8d8-6ad3-403c-8342-13685e2cf586 None admin] PATH_INFO: `/v3/groups/c330bc4efa064d4b9146d2d257acee85` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:15.452032 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ce8d8-6ad3-403c-8342-13685e2cf586 None admin] RBAC: Authorizing `identity:get_group(group_id=c330bc4efa064d4b9146d2d257acee85)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:15.453490 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ce8d8-6ad3-403c-8342-13685e2cf586 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:15.461463 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 200/400] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Jun 29 12:07:15 2022] GET /identity/v3/groups/c330bc4efa064d4b9146d2d257acee85 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:15.462364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ce8d8-6ad3-403c-8342-13685e2cf586 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:15.483063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:15.517684 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 201/401] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:07:15.540811 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7cd6e-f711-4dd8-9ccd-3abe6977717a None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:15.645087 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7cd6e-f711-4dd8-9ccd-3abe6977717a None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:15.658231 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ce8d8-6ad3-403c-8342-13685e2cf586 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:15.711307 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d9c11-bcf9-422d-a472-d785a3111f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:15.712127 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d9c11-bcf9-422d-a472-d785a3111f00 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:15.712404 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d9c11-bcf9-422d-a472-d785a3111f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:15.712672 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d9c11-bcf9-422d-a472-d785a3111f00 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:15.729414 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d9c11-bcf9-422d-a472-d785a3111f00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:15.731918 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701701c-5ad3-4f67-b6f8-65eccd0f166b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:15.732787 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701701c-5ad3-4f67-b6f8-65eccd0f166b None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:15.733065 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701701c-5ad3-4f67-b6f8-65eccd0f166b None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:15.733334 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701701c-5ad3-4f67-b6f8-65eccd0f166b None admin] PATH_INFO: `/v3/projects/5fd79607efc84957a3c849d0d14a8f76` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:15.739358 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3701701c-5ad3-4f67-b6f8-65eccd0f166b None admin] RBAC: Authorizing `identity:get_project(project_id=5fd79607efc84957a3c849d0d14a8f76)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:15.740821 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3701701c-5ad3-4f67-b6f8-65eccd0f166b None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:15.744905 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-1a5d9c11-bcf9-422d-a472-d785a3111f00 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:07:15.744905 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:15.744905 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:15.744905 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:15.744905 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:15.744905 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:15.744905 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:15.744905 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:15.744905 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:15.744905 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:15.744905 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:15.744905 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:15.744905 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:15.744905 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:15.744905 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:15.744905 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:15.745787 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:15.745787 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:15.745787 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:15.745787 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:15.745787 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:15.745787 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:15.745787 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:15.745787 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:15.745787 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:15.745787 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:15.745787 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:15.745787 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:15.745787 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:15.745787 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:15.745787 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:15.745787 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:15.746600 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:15.746600 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:15.746600 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:15.746600 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:15.746600 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:15.746600 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:15.746600 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:15.746600 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:15.746600 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:15.746600 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:15.746600 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:07:15.746600 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:15.747243 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 201/402] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:15 2022] GET /identity/v3/projects/5fd79607efc84957a3c849d0d14a8f76 => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:15.747320 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 202/403] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 29 12:07:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:07:15.751211 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701701c-5ad3-4f67-b6f8-65eccd0f166b None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:15.755961 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d9c11-bcf9-422d-a472-d785a3111f00 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:15.783077 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:15.867119 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:15.905905 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701701c-5ad3-4f67-b6f8-65eccd0f166b None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:15.971775 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9a0f9-ff7d-4232-8418-14440eb2f8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:15.972674 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9a0f9-ff7d-4232-8418-14440eb2f8aa None admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:15.972949 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9a0f9-ff7d-4232-8418-14440eb2f8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:15.973276 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9a0f9-ff7d-4232-8418-14440eb2f8aa None admin] PATH_INFO: `/v3/projects/5fd79607efc84957a3c849d0d14a8f76/groups/c330bc4efa064d4b9146d2d257acee85/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:15.975232 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b9a0f9-ff7d-4232-8418-14440eb2f8aa None admin] RBAC: Authorizing `identity:create_grant(project_id=5fd79607efc84957a3c849d0d14a8f76, group_id=c330bc4efa064d4b9146d2d257acee85, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:15.975596 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d9c11-bcf9-422d-a472-d785a3111f00 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:15.976696 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b9a0f9-ff7d-4232-8418-14440eb2f8aa None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:15.993663 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 202/404] 10.222.0.13 () {58 vars in 1442 bytes} [Wed Jun 29 12:07:15 2022] PUT /identity/v3/projects/5fd79607efc84957a3c849d0d14a8f76/groups/c330bc4efa064d4b9146d2d257acee85/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:07:15.998683 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581d3ce-7581-416a-b25c-a5d5d0e6e0aa None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:15.998683 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581d3ce-7581-416a-b25c-a5d5d0e6e0aa None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:15.998683 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581d3ce-7581-416a-b25c-a5d5d0e6e0aa None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:16.001131 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 203/405] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:16.003182 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c73f3-c265-41a3-ab2d-203361949eda None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:16.003474 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c73f3-c265-41a3-ab2d-203361949eda None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:16.003755 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c73f3-c265-41a3-ab2d-203361949eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:16.031211 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebde91-bf7f-4f1c-8a47-35cd07a14035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:16.032437 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebde91-bf7f-4f1c-8a47-35cd07a14035 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:16.032991 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebde91-bf7f-4f1c-8a47-35cd07a14035 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:16.033528 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebde91-bf7f-4f1c-8a47-35cd07a14035 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:16.034578 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eebde91-bf7f-4f1c-8a47-35cd07a14035 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:16.035274 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eebde91-bf7f-4f1c-8a47-35cd07a14035 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:16.036943 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eebde91-bf7f-4f1c-8a47-35cd07a14035 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:16.039940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-808c73f3-c265-41a3-ab2d-203361949eda None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:16.041252 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-808c73f3-c265-41a3-ab2d-203361949eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:16.053273 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 203/406] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:16.055331 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebde91-bf7f-4f1c-8a47-35cd07a14035 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:16.144951 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:16.186482 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebde91-bf7f-4f1c-8a47-35cd07a14035 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:16.210511 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 204/407] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:07:16.227410 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf09f52-271b-4662-90a7-b93b63612848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:16.229122 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf09f52-271b-4662-90a7-b93b63612848 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:16.229672 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf09f52-271b-4662-90a7-b93b63612848 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:16.230173 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf09f52-271b-4662-90a7-b93b63612848 None admin] PATH_INFO: `/v3/groups/c330bc4efa064d4b9146d2d257acee85` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:16.231650 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf09f52-271b-4662-90a7-b93b63612848 None admin] RBAC: Authorizing `identity:get_group(group_id=c330bc4efa064d4b9146d2d257acee85)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:16.233317 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf09f52-271b-4662-90a7-b93b63612848 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:16.235260 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 204/408] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Jun 29 12:07:16 2022] GET /identity/v3/groups/c330bc4efa064d4b9146d2d257acee85 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:16.241859 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c73f3-c265-41a3-ab2d-203361949eda None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:16.245218 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf09f52-271b-4662-90a7-b93b63612848 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:16.334140 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:16.378683 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c73f3-c265-41a3-ab2d-203361949eda None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:16.380856 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf09f52-271b-4662-90a7-b93b63612848 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:16.418680 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b3ce3-5f8c-43e9-9533-9a2024c9ead4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:16.420317 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b3ce3-5f8c-43e9-9533-9a2024c9ead4 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:16.421062 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b3ce3-5f8c-43e9-9533-9a2024c9ead4 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:16.421708 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b3ce3-5f8c-43e9-9533-9a2024c9ead4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:16.425405 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:16.435553 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b3ce3-5f8c-43e9-9533-9a2024c9ead4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:16.444779 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-271b3ce3-5f8c-43e9-9533-9a2024c9ead4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:07:16.444779 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:16.444779 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:16.444779 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:16.444779 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:16.444779 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:16.444779 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:16.444779 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:16.444779 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:16.444779 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:16.444779 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:16.444779 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:16.444779 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:16.444779 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:16.444779 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:16.444779 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:16.445710 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:16.445710 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:16.445710 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:16.445710 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:16.445710 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:16.445710 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:16.445710 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:16.445710 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:16.445710 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:16.445710 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:16.445710 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:16.445710 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:16.445710 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:16.445710 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:16.445710 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:16.445710 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:16.446525 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:16.446525 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:16.446525 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:16.446525 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:16.446525 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:16.446525 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:16.446525 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:16.446525 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:16.446525 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:16.446525 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:16.446525 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:07:16.446525 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:16.449413 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 205/409] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:07:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:07:16.454200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4adcbc-74c3-4df4-8e13-4a092f31f3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:16.454200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4adcbc-74c3-4df4-8e13-4a092f31f3cd None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:16.454200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4adcbc-74c3-4df4-8e13-4a092f31f3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:16.454200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4adcbc-74c3-4df4-8e13-4a092f31f3cd None admin] PATH_INFO: `/v3/projects/5fd79607efc84957a3c849d0d14a8f76` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:16.454820 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4adcbc-74c3-4df4-8e13-4a092f31f3cd None admin] RBAC: Authorizing `identity:get_project(project_id=5fd79607efc84957a3c849d0d14a8f76)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:16.456049 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b3ce3-5f8c-43e9-9533-9a2024c9ead4 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:16.456288 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4adcbc-74c3-4df4-8e13-4a092f31f3cd None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:16.458015 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 205/410] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:16 2022] GET /identity/v3/projects/5fd79607efc84957a3c849d0d14a8f76 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:16.465014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4adcbc-74c3-4df4-8e13-4a092f31f3cd None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:16.567037 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b3ce3-5f8c-43e9-9533-9a2024c9ead4 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:16.614560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10259726-3fc1-400c-87a9-f0de92e3e8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:16.615596 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10259726-3fc1-400c-87a9-f0de92e3e8db None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:16.616145 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10259726-3fc1-400c-87a9-f0de92e3e8db None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:16.616623 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10259726-3fc1-400c-87a9-f0de92e3e8db None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:16.617584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10259726-3fc1-400c-87a9-f0de92e3e8db None admin] RBAC: Adding query filter params (name=admin) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:16.618093 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10259726-3fc1-400c-87a9-f0de92e3e8db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:16.620603 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10259726-3fc1-400c-87a9-f0de92e3e8db None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:16.630380 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 206/411] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:16.636919 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10259726-3fc1-400c-87a9-f0de92e3e8db None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:16.716891 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4adcbc-74c3-4df4-8e13-4a092f31f3cd None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:16.742677 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:16.786285 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10259726-3fc1-400c-87a9-f0de92e3e8db None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:16.789820 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878e3a6-847b-451f-92b5-93672f38002f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:16.790808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878e3a6-847b-451f-92b5-93672f38002f None admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:16.791121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878e3a6-847b-451f-92b5-93672f38002f None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:16.791431 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878e3a6-847b-451f-92b5-93672f38002f None admin] PATH_INFO: `/v3/projects/5fd79607efc84957a3c849d0d14a8f76/groups/c330bc4efa064d4b9146d2d257acee85/roles/b0982ad59fae4158ba9249550f6452cd` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:16.794777 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878e3a6-847b-451f-92b5-93672f38002f None admin] RBAC: Authorizing `identity:create_grant(project_id=5fd79607efc84957a3c849d0d14a8f76, group_id=c330bc4efa064d4b9146d2d257acee85, role_id=b0982ad59fae4158ba9249550f6452cd)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:16.796235 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878e3a6-847b-451f-92b5-93672f38002f None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:16.805570 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:16.839720 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 206/412] 10.222.0.13 () {58 vars in 1442 bytes} [Wed Jun 29 12:07:16 2022] PUT /identity/v3/projects/5fd79607efc84957a3c849d0d14a8f76/groups/c330bc4efa064d4b9146d2d257acee85/roles/b0982ad59fae4158ba9249550f6452cd => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:07:16.849094 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971685da-2cb9-4c2b-9023-3cc09d532616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:16.849995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971685da-2cb9-4c2b-9023-3cc09d532616 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:16.850915 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971685da-2cb9-4c2b-9023-3cc09d532616 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:16.851207 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971685da-2cb9-4c2b-9023-3cc09d532616 None admin] PATH_INFO: `/v3/groups/79c2b175e7464eceb075454257ead955` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:16.852485 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971685da-2cb9-4c2b-9023-3cc09d532616 None admin] RBAC: Authorizing `identity:get_group(group_id=79c2b175e7464eceb075454257ead955)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:16.853974 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971685da-2cb9-4c2b-9023-3cc09d532616 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:16.856073 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 207/413] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Jun 29 12:07:16 2022] GET /identity/v3/groups/79c2b175e7464eceb075454257ead955 => generated 229 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:07:16.861629 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878e3a6-847b-451f-92b5-93672f38002f None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:16.956001 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a348a82-3118-4dc9-bc83-536c79d422c0 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:16.956360 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a348a82-3118-4dc9-bc83-536c79d422c0 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:16.956643 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a348a82-3118-4dc9-bc83-536c79d422c0 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:16.958034 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 208/414] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:16.964099 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402aa7dc-c7d1-450c-a696-fe31e377d813 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:16.964385 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402aa7dc-c7d1-450c-a696-fe31e377d813 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:16.964658 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402aa7dc-c7d1-450c-a696-fe31e377d813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:16.999746 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-402aa7dc-c7d1-450c-a696-fe31e377d813 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:17.000956 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-402aa7dc-c7d1-450c-a696-fe31e377d813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:17.023726 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878e3a6-847b-451f-92b5-93672f38002f None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:17.083099 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff5471-90eb-4970-b649-f011ad048e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:17.084493 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff5471-90eb-4970-b649-f011ad048e4f None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:17.085610 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff5471-90eb-4970-b649-f011ad048e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:17.086085 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff5471-90eb-4970-b649-f011ad048e4f None admin] PATH_INFO: `/v3/projects/74e1ea071109496291a5ab7856fef887` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:17.088808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff5471-90eb-4970-b649-f011ad048e4f None admin] RBAC: Authorizing `identity:get_project(project_id=74e1ea071109496291a5ab7856fef887)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:17.090754 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff5471-90eb-4970-b649-f011ad048e4f None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:17.093335 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 207/415] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:16 2022] GET /identity/v3/projects/74e1ea071109496291a5ab7856fef887 => generated 344 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:17.100488 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff5471-90eb-4970-b649-f011ad048e4f None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:17.116609 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 209/416] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:17.142971 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402aa7dc-c7d1-450c-a696-fe31e377d813 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:17.173357 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:17.214974 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff5471-90eb-4970-b649-f011ad048e4f None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:17.243279 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:17.255926 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd920a-9c30-4ad8-aef3-ca9e73630d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:17.257930 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd920a-9c30-4ad8-aef3-ca9e73630d3f None admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:17.258218 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd920a-9c30-4ad8-aef3-ca9e73630d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:17.258503 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd920a-9c30-4ad8-aef3-ca9e73630d3f None admin] PATH_INFO: `/v3/projects/74e1ea071109496291a5ab7856fef887/groups/79c2b175e7464eceb075454257ead955/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:17.261123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd920a-9c30-4ad8-aef3-ca9e73630d3f None admin] RBAC: Authorizing `identity:create_grant(project_id=74e1ea071109496291a5ab7856fef887, group_id=79c2b175e7464eceb075454257ead955, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:17.263510 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd920a-9c30-4ad8-aef3-ca9e73630d3f None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:17.287272 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 208/417] 10.222.0.13 () {58 vars in 1442 bytes} [Wed Jun 29 12:07:17 2022] PUT /identity/v3/projects/74e1ea071109496291a5ab7856fef887/groups/79c2b175e7464eceb075454257ead955/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:07:17.287272 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b76145-59a4-452a-9c8c-22d208f2e5f0 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:17.287272 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b76145-59a4-452a-9c8c-22d208f2e5f0 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:17.287272 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b76145-59a4-452a-9c8c-22d208f2e5f0 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:17.287272 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 209/418] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:17.293752 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62042ca0-edf2-4e5d-994d-18bff367bc07 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:17.294056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62042ca0-edf2-4e5d-994d-18bff367bc07 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:17.294609 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62042ca0-edf2-4e5d-994d-18bff367bc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:17.315608 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-62042ca0-edf2-4e5d-994d-18bff367bc07 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:17.316860 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-62042ca0-edf2-4e5d-994d-18bff367bc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:17.317160 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402aa7dc-c7d1-450c-a696-fe31e377d813 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:17.391363 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d10e2-76bd-4e44-baaa-fc0978466ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:17.393001 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d10e2-76bd-4e44-baaa-fc0978466ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:17.393285 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d10e2-76bd-4e44-baaa-fc0978466ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:17.395379 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d10e2-76bd-4e44-baaa-fc0978466ac2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:17.422944 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d10e2-76bd-4e44-baaa-fc0978466ac2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:17.438468 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-683d10e2-76bd-4e44-baaa-fc0978466ac2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:17.438468 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:17.438468 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:17.438468 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:17.438468 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:17.438468 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:17.438468 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:17.438468 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:17.438468 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:17.438468 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:17.438468 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:17.438468 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:17.438468 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:17.438468 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:17.438468 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:17.438468 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:17.439469 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:17.439469 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:17.439469 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:17.439469 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:17.439469 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:17.439469 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:17.439469 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:17.439469 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:17.439469 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:17.439469 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:17.439469 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:17.439469 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:17.439469 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:17.439469 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:17.439469 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:17.439469 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:17.440681 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:17.440681 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:17.440681 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:17.440681 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:17.440681 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:17.440681 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:17.440681 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:17.440681 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:17.440681 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:17.440681 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:17.440681 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:17.440681 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:17.440681 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 210/419] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:07:17.449837 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d10e2-76bd-4e44-baaa-fc0978466ac2 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:17.473454 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 210/420] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:17.515148 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62042ca0-edf2-4e5d-994d-18bff367bc07 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:17.596440 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:17.637652 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d10e2-76bd-4e44-baaa-fc0978466ac2 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:17.657348 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:17.684921 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62042ca0-edf2-4e5d-994d-18bff367bc07 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:17.699819 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc5266-9a58-4974-9d6a-c8fa325b1448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:17.700868 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc5266-9a58-4974-9d6a-c8fa325b1448 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:17.701356 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc5266-9a58-4974-9d6a-c8fa325b1448 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:17.701845 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc5266-9a58-4974-9d6a-c8fa325b1448 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:17.702830 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc5266-9a58-4974-9d6a-c8fa325b1448 None admin] RBAC: Adding query filter params (name=member) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:17.703366 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc5266-9a58-4974-9d6a-c8fa325b1448 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:17.704952 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc5266-9a58-4974-9d6a-c8fa325b1448 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:17.728032 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 211/421] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 29 12:07:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:17.731963 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc5266-9a58-4974-9d6a-c8fa325b1448 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:17.758153 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1afdf-ab06-49ea-ac4f-11180b1b8c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:17.759004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1afdf-ab06-49ea-ac4f-11180b1b8c91 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:17.759292 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1afdf-ab06-49ea-ac4f-11180b1b8c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:17.759569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1afdf-ab06-49ea-ac4f-11180b1b8c91 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:17.780811 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1afdf-ab06-49ea-ac4f-11180b1b8c91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:17.789865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-9ef1afdf-ab06-49ea-ac4f-11180b1b8c91 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:07:17.789865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:17.789865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:17.789865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:17.789865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:17.789865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:17.789865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:17.789865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:17.789865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:17.789865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:17.789865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:17.789865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:17.789865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:17.789865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:17.789865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:17.789865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:17.790781 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:17.790781 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:17.790781 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:17.790781 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:17.790781 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:17.790781 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:17.790781 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:17.790781 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:17.790781 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:17.790781 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:17.790781 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:17.790781 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:17.790781 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:17.790781 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:17.790781 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:17.790781 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:17.791601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:17.791601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:17.791601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:17.791601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:17.791601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:17.791601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:17.791601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:17.791601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:17.791601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:17.791601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:17.791601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:07:17.791601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:17.792196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 211/422] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 29 12:07:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:07:17.805217 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1afdf-ab06-49ea-ac4f-11180b1b8c91 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:17.936295 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc5266-9a58-4974-9d6a-c8fa325b1448 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:17.980300 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1afdf-ab06-49ea-ac4f-11180b1b8c91 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:18.003355 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:18.016584 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14981063-8850-4745-b306-a27e1924f0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:18.017537 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14981063-8850-4745-b306-a27e1924f0f8 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:18.018014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14981063-8850-4745-b306-a27e1924f0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:18.018481 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14981063-8850-4745-b306-a27e1924f0f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:18.019562 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14981063-8850-4745-b306-a27e1924f0f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:18.020064 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14981063-8850-4745-b306-a27e1924f0f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:18.021621 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14981063-8850-4745-b306-a27e1924f0f8 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:18.023377 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ba0d3-b59a-49cb-9c91-60b4502e84ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:18.024050 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ba0d3-b59a-49cb-9c91-60b4502e84ee None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:18.024363 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ba0d3-b59a-49cb-9c91-60b4502e84ee None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:18.024612 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ba0d3-b59a-49cb-9c91-60b4502e84ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:18.032328 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 212/423] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:18.039746 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14981063-8850-4745-b306-a27e1924f0f8 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:18.114765 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:18.140573 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ba0d3-b59a-49cb-9c91-60b4502e84ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:18.142369 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ba0d3-b59a-49cb-9c91-60b4502e84ee None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:18.246183 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14981063-8850-4745-b306-a27e1924f0f8 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:18.285427 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77f756-2d26-41d9-a21f-2ef346b3781a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:18.286435 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77f756-2d26-41d9-a21f-2ef346b3781a None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:18.286961 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77f756-2d26-41d9-a21f-2ef346b3781a None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:18.288000 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77f756-2d26-41d9-a21f-2ef346b3781a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:18.317503 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 212/424] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:18.325224 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ba0d3-b59a-49cb-9c91-60b4502e84ee None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:18.346329 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:18.378835 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77f756-2d26-41d9-a21f-2ef346b3781a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:18.380923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77f756-2d26-41d9-a21f-2ef346b3781a None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:18.481478 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:18.517191 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 213/425] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:18.523894 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77f756-2d26-41d9-a21f-2ef346b3781a None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:18.560818 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ba0d3-b59a-49cb-9c91-60b4502e84ee None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:18.605522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:18.613967 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca4c36-edf1-49d1-a58b-eb494d8a4ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:18.615368 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca4c36-edf1-49d1-a58b-eb494d8a4ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:18.616420 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca4c36-edf1-49d1-a58b-eb494d8a4ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:18.616915 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca4c36-edf1-49d1-a58b-eb494d8a4ed5 None admin] PATH_INFO: `/v3/projects/db721c414b9e4fec93c61aef1313fdb0` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:18.618702 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca4c36-edf1-49d1-a58b-eb494d8a4ed5 None admin] RBAC: Authorizing `identity:get_project(project_id=db721c414b9e4fec93c61aef1313fdb0)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:18.620815 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca4c36-edf1-49d1-a58b-eb494d8a4ed5 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:18.627863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 213/426] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:18 2022] GET /identity/v3/projects/db721c414b9e4fec93c61aef1313fdb0 => generated 298 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:07:18.629005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c84f8-0721-46aa-92de-471f1d279782 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:18.629293 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c84f8-0721-46aa-92de-471f1d279782 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:18.629573 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c84f8-0721-46aa-92de-471f1d279782 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:18.630895 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 214/427] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:18.631664 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c84f8-0721-46aa-92de-471f1d279782 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:18.641149 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77f756-2d26-41d9-a21f-2ef346b3781a None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:18.682828 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30dc6c0-2e6d-4505-9e03-ffcabeee3628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:18.684177 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30dc6c0-2e6d-4505-9e03-ffcabeee3628 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:18.684679 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30dc6c0-2e6d-4505-9e03-ffcabeee3628 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:18.685275 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30dc6c0-2e6d-4505-9e03-ffcabeee3628 None admin] PATH_INFO: `/v3/projects/db721c414b9e4fec93c61aef1313fdb0` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:18.686707 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30dc6c0-2e6d-4505-9e03-ffcabeee3628 None admin] RBAC: Authorizing `identity:get_project(project_id=db721c414b9e4fec93c61aef1313fdb0)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:18.688574 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30dc6c0-2e6d-4505-9e03-ffcabeee3628 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:18.690793 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 214/428] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:18 2022] GET /identity/v3/projects/db721c414b9e4fec93c61aef1313fdb0 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:18.692246 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a62fc-d4a2-41ce-b9a2-973c271b387c None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:18.692744 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a62fc-d4a2-41ce-b9a2-973c271b387c None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:18.693233 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a62fc-d4a2-41ce-b9a2-973c271b387c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:18.713018 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-dc4a62fc-d4a2-41ce-b9a2-973c271b387c None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:18.714531 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-dc4a62fc-d4a2-41ce-b9a2-973c271b387c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:18.748669 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c84f8-0721-46aa-92de-471f1d279782 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:18.786506 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd30052-a26b-4d1e-9edd-ffb1e3c453e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:18.787653 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd30052-a26b-4d1e-9edd-ffb1e3c453e9 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:18.788469 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd30052-a26b-4d1e-9edd-ffb1e3c453e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:18.788745 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd30052-a26b-4d1e-9edd-ffb1e3c453e9 None admin] PATH_INFO: `/v3/groups/c330bc4efa064d4b9146d2d257acee85` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:18.789930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd30052-a26b-4d1e-9edd-ffb1e3c453e9 None admin] RBAC: Authorizing `identity:get_group(group_id=c330bc4efa064d4b9146d2d257acee85)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:18.790923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 215/429] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:18.791509 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd30052-a26b-4d1e-9edd-ffb1e3c453e9 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:18.791980 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a62fc-d4a2-41ce-b9a2-973c271b387c None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:18.793497 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 215/430] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Jun 29 12:07:18 2022] GET /identity/v3/groups/c330bc4efa064d4b9146d2d257acee85 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:18.803620 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd30052-a26b-4d1e-9edd-ffb1e3c453e9 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:18.835395 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:18.870218 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:18.895988 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a62fc-d4a2-41ce-b9a2-973c271b387c None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:18.926522 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd30052-a26b-4d1e-9edd-ffb1e3c453e9 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:18.935733 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47710009-daa6-4094-bf6d-d5701da8153d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:18.936610 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47710009-daa6-4094-bf6d-d5701da8153d None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:18.936899 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47710009-daa6-4094-bf6d-d5701da8153d None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:18.937181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47710009-daa6-4094-bf6d-d5701da8153d None admin] PATH_INFO: `/v3/groups/c330bc4efa064d4b9146d2d257acee85` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:18.938377 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47710009-daa6-4094-bf6d-d5701da8153d None admin] RBAC: Authorizing `identity:get_group(group_id=c330bc4efa064d4b9146d2d257acee85)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:18.939992 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47710009-daa6-4094-bf6d-d5701da8153d None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:18.941909 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 216/431] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Jun 29 12:07:18 2022] GET /identity/v3/groups/c330bc4efa064d4b9146d2d257acee85 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:18.942705 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47710009-daa6-4094-bf6d-d5701da8153d None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:18.971307 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca1213-e43e-4330-a4a7-015d98e2fbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:18.972021 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca1213-e43e-4330-a4a7-015d98e2fbc6 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:18.972307 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca1213-e43e-4330-a4a7-015d98e2fbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:18.972583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca1213-e43e-4330-a4a7-015d98e2fbc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:18.973873 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca1213-e43e-4330-a4a7-015d98e2fbc6 None admin] RBAC: Adding query filter params (group.id=c330bc4efa064d4b9146d2d257acee85, role.id=419e204ede334962ac80ce56c398bd4f, scope.project.id=db721c414b9e4fec93c61aef1313fdb0) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:18.974196 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca1213-e43e-4330-a4a7-015d98e2fbc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:18.976712 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca1213-e43e-4330-a4a7-015d98e2fbc6 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:18.985472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 216/432] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Jun 29 12:07:18 2022] GET /identity/v3/role_assignments?group.id=c330bc4efa064d4b9146d2d257acee85&scope.project.id=db721c414b9e4fec93c61aef1313fdb0&role.id=419e204ede334962ac80ce56c398bd4f => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:18.986330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca1213-e43e-4330-a4a7-015d98e2fbc6 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:19.137190 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47710009-daa6-4094-bf6d-d5701da8153d None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:19.144878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:19.171839 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca1213-e43e-4330-a4a7-015d98e2fbc6 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:19.204435 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edf816-e224-423e-bd53-45a2f29a4846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:19.205254 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edf816-e224-423e-bd53-45a2f29a4846 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:19.205539 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edf816-e224-423e-bd53-45a2f29a4846 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:19.205822 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edf816-e224-423e-bd53-45a2f29a4846 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:19.209352 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc097f-076c-4677-8538-141173ffa05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:19.210929 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc097f-076c-4677-8538-141173ffa05b None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:19.211398 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc097f-076c-4677-8538-141173ffa05b None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:19.211854 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc097f-076c-4677-8538-141173ffa05b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:19.212870 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc097f-076c-4677-8538-141173ffa05b None admin] RBAC: Adding query filter params (group.id=c330bc4efa064d4b9146d2d257acee85, role.id=b0982ad59fae4158ba9249550f6452cd, scope.project.id=db721c414b9e4fec93c61aef1313fdb0) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:19.213475 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc097f-076c-4677-8538-141173ffa05b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:19.215532 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc097f-076c-4677-8538-141173ffa05b None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:19.223119 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 217/433] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Jun 29 12:07:18 2022] GET /identity/v3/role_assignments?group.id=c330bc4efa064d4b9146d2d257acee85&scope.project.id=db721c414b9e4fec93c61aef1313fdb0&role.id=b0982ad59fae4158ba9249550f6452cd => generated 611 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:19.224450 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca31e64-c18f-41e0-8d3a-6be94767a4fa None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:19.224772 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca31e64-c18f-41e0-8d3a-6be94767a4fa None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:19.225024 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca31e64-c18f-41e0-8d3a-6be94767a4fa None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:19.226466 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 218/434] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:19.231398 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18edf816-e224-423e-bd53-45a2f29a4846 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:19.233593 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b96d8-5761-488c-94cd-ea437b404b79 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:19.234120 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b96d8-5761-488c-94cd-ea437b404b79 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:19.234738 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b96d8-5761-488c-94cd-ea437b404b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:19.239704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-18edf816-e224-423e-bd53-45a2f29a4846 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:19.239704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:19.239704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:19.239704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:19.239704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:19.239704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:19.239704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:19.239704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:19.239704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:19.239704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:19.239704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:19.239704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:19.239704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:19.239704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:19.239704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:19.239704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:19.240667 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:19.240667 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:19.240667 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:19.240667 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:19.240667 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:19.240667 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:19.240667 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:19.240667 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:19.240667 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:19.240667 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:19.240667 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:19.240667 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:19.240667 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:19.240667 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:19.240667 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:19.240667 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:19.241853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:19.241853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:19.241853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:19.241853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:19.241853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:19.241853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:19.241853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:19.241853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:19.241853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:19.241853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:19.241853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:19.241853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:19.241853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 217/435] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:19.246967 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edf816-e224-423e-bd53-45a2f29a4846 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:19.259197 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-6d1b96d8-5761-488c-94cd-ea437b404b79 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:19.261642 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-6d1b96d8-5761-488c-94cd-ea437b404b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:19.263009 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:19.363382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 219/436] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:07:19.389432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b96d8-5761-488c-94cd-ea437b404b79 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:19.400648 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edf816-e224-423e-bd53-45a2f29a4846 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:19.439097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e89fac-eec6-4b6e-bc8a-dbe94f7ef1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:19.440007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e89fac-eec6-4b6e-bc8a-dbe94f7ef1e9 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:19.440506 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e89fac-eec6-4b6e-bc8a-dbe94f7ef1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:19.440980 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e89fac-eec6-4b6e-bc8a-dbe94f7ef1e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:19.441932 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e89fac-eec6-4b6e-bc8a-dbe94f7ef1e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:19.442399 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e89fac-eec6-4b6e-bc8a-dbe94f7ef1e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:19.443985 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e89fac-eec6-4b6e-bc8a-dbe94f7ef1e9 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:19.454527 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 218/437] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 29 12:07:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:19.461957 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e89fac-eec6-4b6e-bc8a-dbe94f7ef1e9 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:19.491654 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:19.532610 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b96d8-5761-488c-94cd-ea437b404b79 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:19.553922 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:19.583868 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ac059-1b58-48a6-964f-a7831251e899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:19.585229 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ac059-1b58-48a6-964f-a7831251e899 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:19.585511 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ac059-1b58-48a6-964f-a7831251e899 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:19.585790 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ac059-1b58-48a6-964f-a7831251e899 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:19.599484 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ac059-1b58-48a6-964f-a7831251e899 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:19.604574 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e89fac-eec6-4b6e-bc8a-dbe94f7ef1e9 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:19.610061 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-cf9ac059-1b58-48a6-964f-a7831251e899 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:07:19.610061 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:19.610061 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:19.610061 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:19.610061 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:19.610061 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:19.610061 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:19.610061 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:19.610061 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:19.610061 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:19.610061 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:19.610061 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:19.610061 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:19.610061 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:19.610061 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:19.610061 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:19.611290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:19.611290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:19.611290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:19.611290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:19.611290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:19.611290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:19.611290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:19.611290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:19.611290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:19.611290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:19.611290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:19.611290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:19.611290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:19.611290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:19.611290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:19.611290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:19.612319 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:19.612319 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:19.612319 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:19.612319 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:19.612319 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:19.612319 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:19.612319 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:19.612319 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:19.612319 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:19.612319 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:19.612319 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:07:19.612319 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:19.612319 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 220/438] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 29 12:07:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:19.619601 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ac059-1b58-48a6-964f-a7831251e899 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:19.653084 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eebe5b-16d0-46c7-ae85-8cbf7d274370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:19.654328 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eebe5b-16d0-46c7-ae85-8cbf7d274370 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:19.655451 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eebe5b-16d0-46c7-ae85-8cbf7d274370 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:19.655451 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eebe5b-16d0-46c7-ae85-8cbf7d274370 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:19.738005 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eebe5b-16d0-46c7-ae85-8cbf7d274370 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:19.739812 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eebe5b-16d0-46c7-ae85-8cbf7d274370 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:19.746306 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ac059-1b58-48a6-964f-a7831251e899 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:19.783660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:19.791519 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed7822-9e50-46b5-9167-df4f8dd06c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:19.792194 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed7822-9e50-46b5-9167-df4f8dd06c74 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:19.792478 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed7822-9e50-46b5-9167-df4f8dd06c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:19.792759 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed7822-9e50-46b5-9167-df4f8dd06c74 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:19.793511 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed7822-9e50-46b5-9167-df4f8dd06c74 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:19.793819 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed7822-9e50-46b5-9167-df4f8dd06c74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:19.795256 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed7822-9e50-46b5-9167-df4f8dd06c74 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:19.803890 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 221/439] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:07:19.805192 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796810a9-3655-42ae-81ca-9e8d8c863d5d None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:19.805485 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796810a9-3655-42ae-81ca-9e8d8c863d5d None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:19.805826 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796810a9-3655-42ae-81ca-9e8d8c863d5d None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:19.808491 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 222/440] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:19.810609 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796810a9-3655-42ae-81ca-9e8d8c863d5d None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:19.817353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:19.859826 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 219/441] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:19.860929 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7c1bd-d5e3-44ab-83db-7a144238229c None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:19.861219 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7c1bd-d5e3-44ab-83db-7a144238229c None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:19.861495 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7c1bd-d5e3-44ab-83db-7a144238229c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:19.877210 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-4ef7c1bd-d5e3-44ab-83db-7a144238229c None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:19.878402 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-4ef7c1bd-d5e3-44ab-83db-7a144238229c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:19.919886 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796810a9-3655-42ae-81ca-9e8d8c863d5d None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:19.942708 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 220/442] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:19.943519 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7c1bd-d5e3-44ab-83db-7a144238229c None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:19.954099 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97997fc4-6efb-494a-9a67-4aed7f69f1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:19.954912 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97997fc4-6efb-494a-9a67-4aed7f69f1da None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:19.955242 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97997fc4-6efb-494a-9a67-4aed7f69f1da None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:19.955531 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97997fc4-6efb-494a-9a67-4aed7f69f1da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:20.021340 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:20.029882 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97997fc4-6efb-494a-9a67-4aed7f69f1da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:20.031551 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97997fc4-6efb-494a-9a67-4aed7f69f1da None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:20.052052 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:20.059576 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7c1bd-d5e3-44ab-83db-7a144238229c None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:20.094372 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8409e-7322-421d-9386-a74a205cc849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:20.095259 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8409e-7322-421d-9386-a74a205cc849 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:20.095541 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8409e-7322-421d-9386-a74a205cc849 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:20.095812 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8409e-7322-421d-9386-a74a205cc849 None admin] PATH_INFO: `/v3/projects/5fd79607efc84957a3c849d0d14a8f76` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:20.097285 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8409e-7322-421d-9386-a74a205cc849 None admin] RBAC: Authorizing `identity:get_project(project_id=5fd79607efc84957a3c849d0d14a8f76)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:20.098755 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8409e-7322-421d-9386-a74a205cc849 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:20.100463 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 221/443] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:19 2022] GET /identity/v3/projects/5fd79607efc84957a3c849d0d14a8f76 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:20.101540 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8409e-7322-421d-9386-a74a205cc849 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:20.132731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 223/444] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:20.135540 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97997fc4-6efb-494a-9a67-4aed7f69f1da None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:20.200018 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8409e-7322-421d-9386-a74a205cc849 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:20.227074 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:20.234763 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97997fc4-6efb-494a-9a67-4aed7f69f1da None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:20.236664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc68978-76ac-4d4c-9b2f-29a84c6cea7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:20.237459 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc68978-76ac-4d4c-9b2f-29a84c6cea7b None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:20.237835 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc68978-76ac-4d4c-9b2f-29a84c6cea7b None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:20.238134 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc68978-76ac-4d4c-9b2f-29a84c6cea7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:20.249373 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc68978-76ac-4d4c-9b2f-29a84c6cea7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:20.258100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-8bc68978-76ac-4d4c-9b2f-29a84c6cea7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:07:20.258100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:20.258100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:20.258100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:20.258100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:20.258100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:20.258100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:20.258100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:20.258100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:20.258100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:20.258100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:20.258100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:20.258100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:20.258100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:20.258100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:20.258100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:20.259138 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:20.259138 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:20.259138 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:20.259138 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:20.259138 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:20.259138 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:20.259138 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:20.259138 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:20.259138 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:20.259138 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:20.259138 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:20.259138 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:20.259138 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:20.259138 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:20.259138 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:20.259138 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:20.259923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:20.259923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:20.259923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:20.259923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:20.259923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:20.259923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:20.259923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:20.259923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:20.259923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:20.259923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:20.259923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:07:20.259923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:20.259923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 222/445] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:07:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:20.260571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc68978-76ac-4d4c-9b2f-29a84c6cea7b None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:20.272726 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17489b66-6662-4353-94c0-ac6601802fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:20.273580 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17489b66-6662-4353-94c0-ac6601802fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:20.273862 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17489b66-6662-4353-94c0-ac6601802fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:20.274134 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17489b66-6662-4353-94c0-ac6601802fc6 None admin] PATH_INFO: `/v3/groups/c330bc4efa064d4b9146d2d257acee85` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:20.275296 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17489b66-6662-4353-94c0-ac6601802fc6 None admin] RBAC: Authorizing `identity:get_group(group_id=c330bc4efa064d4b9146d2d257acee85)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:20.276738 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17489b66-6662-4353-94c0-ac6601802fc6 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:20.278331 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 224/446] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Jun 29 12:07:20 2022] GET /identity/v3/groups/c330bc4efa064d4b9146d2d257acee85 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:20.279109 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17489b66-6662-4353-94c0-ac6601802fc6 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:20.284821 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:20.361763 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc68978-76ac-4d4c-9b2f-29a84c6cea7b None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:20.377921 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17489b66-6662-4353-94c0-ac6601802fc6 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:20.395194 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad049f-6f81-459d-bf54-3ce5782ba7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:20.396226 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad049f-6f81-459d-bf54-3ce5782ba7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:20.396504 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad049f-6f81-459d-bf54-3ce5782ba7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:20.396778 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad049f-6f81-459d-bf54-3ce5782ba7a4 None admin] PATH_INFO: `/v3/projects/5fd79607efc84957a3c849d0d14a8f76` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:20.398131 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad049f-6f81-459d-bf54-3ce5782ba7a4 None admin] RBAC: Authorizing `identity:get_project(project_id=5fd79607efc84957a3c849d0d14a8f76)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:20.399606 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad049f-6f81-459d-bf54-3ce5782ba7a4 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:20.401274 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 223/447] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:20 2022] GET /identity/v3/projects/5fd79607efc84957a3c849d0d14a8f76 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:20.402023 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad049f-6f81-459d-bf54-3ce5782ba7a4 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:20.411965 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad3d22-a524-433e-b60b-6cffbbac51aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:20.412938 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad3d22-a524-433e-b60b-6cffbbac51aa None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:20.413219 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad3d22-a524-433e-b60b-6cffbbac51aa None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:20.413648 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad3d22-a524-433e-b60b-6cffbbac51aa None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:20.414396 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad3d22-a524-433e-b60b-6cffbbac51aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:20.414848 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad3d22-a524-433e-b60b-6cffbbac51aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:20.416413 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad3d22-a524-433e-b60b-6cffbbac51aa None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:20.427488 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 225/448] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:20.428918 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad3d22-a524-433e-b60b-6cffbbac51aa None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:20.455234 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:20.500029 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:20.511731 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad049f-6f81-459d-bf54-3ce5782ba7a4 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:20.528082 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad3d22-a524-433e-b60b-6cffbbac51aa None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:20.544952 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87670e-5977-42b6-8b9a-ad8702bd99cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:20.545604 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87670e-5977-42b6-8b9a-ad8702bd99cb None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:20.545885 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87670e-5977-42b6-8b9a-ad8702bd99cb None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:20.546160 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87670e-5977-42b6-8b9a-ad8702bd99cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:20.547014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87670e-5977-42b6-8b9a-ad8702bd99cb None admin] RBAC: Adding query filter params (group.id=c330bc4efa064d4b9146d2d257acee85, role.id=419e204ede334962ac80ce56c398bd4f, scope.project.id=5fd79607efc84957a3c849d0d14a8f76) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:20.547331 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87670e-5977-42b6-8b9a-ad8702bd99cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:20.548783 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87670e-5977-42b6-8b9a-ad8702bd99cb None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:20.555134 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 224/449] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Jun 29 12:07:20 2022] GET /identity/v3/role_assignments?group.id=c330bc4efa064d4b9146d2d257acee85&scope.project.id=5fd79607efc84957a3c849d0d14a8f76&role.id=419e204ede334962ac80ce56c398bd4f => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:20.555915 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87670e-5977-42b6-8b9a-ad8702bd99cb None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:20.563335 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e73d4-3b81-4935-a195-da28d6cee5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:20.564254 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e73d4-3b81-4935-a195-da28d6cee5dd None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:20.564539 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e73d4-3b81-4935-a195-da28d6cee5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:20.564815 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e73d4-3b81-4935-a195-da28d6cee5dd None admin] PATH_INFO: `/v3/groups/c330bc4efa064d4b9146d2d257acee85` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:20.566065 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e73d4-3b81-4935-a195-da28d6cee5dd None admin] RBAC: Authorizing `identity:get_group(group_id=c330bc4efa064d4b9146d2d257acee85)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:20.567733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e73d4-3b81-4935-a195-da28d6cee5dd None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:20.574996 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 226/450] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Jun 29 12:07:20 2022] GET /identity/v3/groups/c330bc4efa064d4b9146d2d257acee85 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:20.576230 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e73d4-3b81-4935-a195-da28d6cee5dd None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:20.681812 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87670e-5977-42b6-8b9a-ad8702bd99cb None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:20.682792 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:20.694011 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e73d4-3b81-4935-a195-da28d6cee5dd None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:20.720160 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d37ef-5159-41ce-bff7-d26566dbf1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:20.720746 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d37ef-5159-41ce-bff7-d26566dbf1fa None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:20.721033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d37ef-5159-41ce-bff7-d26566dbf1fa None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:20.722115 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d37ef-5159-41ce-bff7-d26566dbf1fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:20.742215 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e280f8-8726-4b99-b419-2ed40ba01e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:20.743036 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e280f8-8726-4b99-b419-2ed40ba01e5e None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:20.743332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e280f8-8726-4b99-b419-2ed40ba01e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:20.743597 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e280f8-8726-4b99-b419-2ed40ba01e5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:20.744443 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e280f8-8726-4b99-b419-2ed40ba01e5e None admin] RBAC: Adding query filter params (group.id=c330bc4efa064d4b9146d2d257acee85, role.id=b0982ad59fae4158ba9249550f6452cd, scope.project.id=5fd79607efc84957a3c849d0d14a8f76) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:20.744759 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e280f8-8726-4b99-b419-2ed40ba01e5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:20.746346 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e280f8-8726-4b99-b419-2ed40ba01e5e None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:20.749257 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:20.753252 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 227/451] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Jun 29 12:07:20 2022] GET /identity/v3/role_assignments?group.id=c330bc4efa064d4b9146d2d257acee85&scope.project.id=5fd79607efc84957a3c849d0d14a8f76&role.id=b0982ad59fae4158ba9249550f6452cd => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:20.809588 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d37ef-5159-41ce-bff7-d26566dbf1fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:20.811166 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d37ef-5159-41ce-bff7-d26566dbf1fa None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:20.922738 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 225/452] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:20.929307 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e280f8-8726-4b99-b419-2ed40ba01e5e None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:21.038916 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e280f8-8726-4b99-b419-2ed40ba01e5e None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:21.073601 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bca41c-0f03-4ee5-bb64-0839b9a0e4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:21.074469 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bca41c-0f03-4ee5-bb64-0839b9a0e4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:21.074788 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bca41c-0f03-4ee5-bb64-0839b9a0e4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:21.075068 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bca41c-0f03-4ee5-bb64-0839b9a0e4c6 None admin] PATH_INFO: `/v3/projects/74e1ea071109496291a5ab7856fef887` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:21.076254 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bca41c-0f03-4ee5-bb64-0839b9a0e4c6 None admin] RBAC: Authorizing `identity:get_project(project_id=74e1ea071109496291a5ab7856fef887)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:21.077707 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bca41c-0f03-4ee5-bb64-0839b9a0e4c6 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:21.079446 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 228/453] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:20 2022] GET /identity/v3/projects/74e1ea071109496291a5ab7856fef887 => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:07:21.085790 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d37ef-5159-41ce-bff7-d26566dbf1fa None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:21.141182 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:21.185286 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d37ef-5159-41ce-bff7-d26566dbf1fa None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:21.217773 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc4603-c1fa-4579-ab1f-6dceb04143ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:21.218610 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc4603-c1fa-4579-ab1f-6dceb04143ce None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:21.218921 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc4603-c1fa-4579-ab1f-6dceb04143ce None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:21.219196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc4603-c1fa-4579-ab1f-6dceb04143ce None admin] PATH_INFO: `/v3/groups/79c2b175e7464eceb075454257ead955` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:21.220367 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc4603-c1fa-4579-ab1f-6dceb04143ce None admin] RBAC: Authorizing `identity:get_group(group_id=79c2b175e7464eceb075454257ead955)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:21.221778 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc4603-c1fa-4579-ab1f-6dceb04143ce None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:21.223420 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 226/454] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Jun 29 12:07:21 2022] GET /identity/v3/groups/79c2b175e7464eceb075454257ead955 => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:21.229808 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bca41c-0f03-4ee5-bb64-0839b9a0e4c6 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:21.254061 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:21.325332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bca41c-0f03-4ee5-bb64-0839b9a0e4c6 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:21.358575 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ba6d3-e244-4a30-b8a7-8cb0671516be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:21.359255 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ba6d3-e244-4a30-b8a7-8cb0671516be None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:21.359538 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ba6d3-e244-4a30-b8a7-8cb0671516be None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:21.359811 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ba6d3-e244-4a30-b8a7-8cb0671516be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:21.360622 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ba6d3-e244-4a30-b8a7-8cb0671516be None admin] RBAC: Adding query filter params (group.id=79c2b175e7464eceb075454257ead955, role.id=5ef3464f4436446b88430cdf7cc1a3d7, scope.project.id=74e1ea071109496291a5ab7856fef887) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:21.360930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ba6d3-e244-4a30-b8a7-8cb0671516be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:21.362354 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ba6d3-e244-4a30-b8a7-8cb0671516be None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:21.368356 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 229/455] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Jun 29 12:07:21 2022] GET /identity/v3/role_assignments?group.id=79c2b175e7464eceb075454257ead955&scope.project.id=74e1ea071109496291a5ab7856fef887&role.id=5ef3464f4436446b88430cdf7cc1a3d7 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:24.011743 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a12bb-f176-4a65-932d-17b7781cd510 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:24.011743 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a12bb-f176-4a65-932d-17b7781cd510 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:24.011743 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a12bb-f176-4a65-932d-17b7781cd510 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:24.012536 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ec8fd-8cdd-4fd5-a39b-220f1c178f9e None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:24.012536 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ec8fd-8cdd-4fd5-a39b-220f1c178f9e None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:24.012536 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ec8fd-8cdd-4fd5-a39b-220f1c178f9e None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:24.013098 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 227/456] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:24.013450 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 230/457] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:24.017161 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7b15d-ce42-4061-9024-638ac8ec1ec6 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:24.017676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7b15d-ce42-4061-9024-638ac8ec1ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:24.018171 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7b15d-ce42-4061-9024-638ac8ec1ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:24.018273 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deafd5b-4fe4-403f-98c2-bf38453dd8cb None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:24.018529 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deafd5b-4fe4-403f-98c2-bf38453dd8cb None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:24.019034 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deafd5b-4fe4-403f-98c2-bf38453dd8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:24.048059 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-04f7b15d-ce42-4061-9024-638ac8ec1ec6 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:24.049283 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-04f7b15d-ce42-4061-9024-638ac8ec1ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:24.051866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-6deafd5b-4fe4-403f-98c2-bf38453dd8cb None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:24.053606 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-6deafd5b-4fe4-403f-98c2-bf38453dd8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:24.162922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 231/458] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:07:24.189206 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deafd5b-4fe4-403f-98c2-bf38453dd8cb None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:24.206470 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 228/459] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:24.227023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:24.248735 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7b15d-ce42-4061-9024-638ac8ec1ec6 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:24.302879 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deafd5b-4fe4-403f-98c2-bf38453dd8cb None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:24.340181 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b855f1-7e63-498c-8272-c41f8c329bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:24.341355 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b855f1-7e63-498c-8272-c41f8c329bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:24.341834 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b855f1-7e63-498c-8272-c41f8c329bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:24.342305 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b855f1-7e63-498c-8272-c41f8c329bc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:24.345896 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:24.353394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b855f1-7e63-498c-8272-c41f8c329bc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:24.355133 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b855f1-7e63-498c-8272-c41f8c329bc1 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:24.374502 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-f5b855f1-7e63-498c-8272-c41f8c329bc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:24.374502 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:24.374502 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:24.374502 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:24.374502 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:24.374502 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:24.374502 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:24.374502 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:24.374502 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:24.374502 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:24.374502 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:24.374502 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:24.374502 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:24.374502 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:24.374502 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:24.375432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:24.375432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:24.375432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:24.375432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:24.375432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:24.375432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:24.375432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:24.375432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:24.375432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:24.375432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:24.375432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:24.375432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:24.375432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:24.375432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:24.375432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:24.375432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:24.375432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:24.376388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:24.376388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:24.376388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:24.376388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:24.378583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 232/460] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:07:24.380135 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad451bda-c6b5-4ea7-a502-188829243011 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:24.380636 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad451bda-c6b5-4ea7-a502-188829243011 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:24.381162 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad451bda-c6b5-4ea7-a502-188829243011 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:24.383436 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 233/461] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:24.388550 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad451bda-c6b5-4ea7-a502-188829243011 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:24.410188 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7b15d-ce42-4061-9024-638ac8ec1ec6 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:24.462491 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:24.462841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998fd50-9a4c-40dd-a2eb-b4e3673fc7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:24.463342 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998fd50-9a4c-40dd-a2eb-b4e3673fc7e5 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:24.463945 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998fd50-9a4c-40dd-a2eb-b4e3673fc7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:24.465158 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998fd50-9a4c-40dd-a2eb-b4e3673fc7e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:24.479100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998fd50-9a4c-40dd-a2eb-b4e3673fc7e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:24.481177 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998fd50-9a4c-40dd-a2eb-b4e3673fc7e5 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:24.498252 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad451bda-c6b5-4ea7-a502-188829243011 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:24.505181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-1998fd50-9a4c-40dd-a2eb-b4e3673fc7e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:24.505181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:24.505181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:24.505181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:24.505181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:24.505181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:24.505181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:24.505181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:24.505181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:24.505181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:24.505181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:24.505181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:24.505181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:24.505181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:24.505181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:24.506238 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:24.506238 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:24.506238 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:24.506238 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:24.506238 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:24.506238 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:24.506238 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:24.506238 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:24.506238 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:24.506238 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:24.506238 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:24.506238 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:24.506238 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:24.506238 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:24.506238 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:24.506238 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:24.506238 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:24.507343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:24.507343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:24.507343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:24.507343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:24.514514 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 229/462] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:24.515721 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d2e59-7a1f-4644-8926-1a869ee47a2f None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:24.516007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d2e59-7a1f-4644-8926-1a869ee47a2f None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:24.516283 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d2e59-7a1f-4644-8926-1a869ee47a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:24.533864 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-215d2e59-7a1f-4644-8926-1a869ee47a2f None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:24.535498 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-215d2e59-7a1f-4644-8926-1a869ee47a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:24.545714 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd187767-c8a0-4712-8b99-01451c16bb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:24.546475 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd187767-c8a0-4712-8b99-01451c16bb20 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:24.546865 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd187767-c8a0-4712-8b99-01451c16bb20 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:24.547218 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd187767-c8a0-4712-8b99-01451c16bb20 None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:24.548503 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd187767-c8a0-4712-8b99-01451c16bb20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:24.548888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd187767-c8a0-4712-8b99-01451c16bb20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:24.551052 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd187767-c8a0-4712-8b99-01451c16bb20 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:24.578870 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 234/463] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:07:24.580000 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd187767-c8a0-4712-8b99-01451c16bb20 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:24.622439 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 230/464] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:24.623657 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d2e59-7a1f-4644-8926-1a869ee47a2f None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:24.667884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:24.699054 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd187767-c8a0-4712-8b99-01451c16bb20 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:24.736563 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:24.745480 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf1a7f-7337-4207-bddf-fdb8d019e631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:24.746262 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf1a7f-7337-4207-bddf-fdb8d019e631 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:24.746622 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf1a7f-7337-4207-bddf-fdb8d019e631 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:24.747179 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf1a7f-7337-4207-bddf-fdb8d019e631 None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:24.748540 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf1a7f-7337-4207-bddf-fdb8d019e631 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:24.749118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf1a7f-7337-4207-bddf-fdb8d019e631 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:24.750862 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf1a7f-7337-4207-bddf-fdb8d019e631 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:24.754792 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d2e59-7a1f-4644-8926-1a869ee47a2f None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:24.762624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 235/465] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:24.764124 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b16e20-4f17-4e58-b3fe-c5a12aacb5c6 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:24.764408 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b16e20-4f17-4e58-b3fe-c5a12aacb5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:24.764686 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b16e20-4f17-4e58-b3fe-c5a12aacb5c6 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:24.765914 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 236/466] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:24.766803 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b16e20-4f17-4e58-b3fe-c5a12aacb5c6 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:24.799332 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795c8a2-e833-496b-9863-d1b006998a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:24.800013 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795c8a2-e833-496b-9863-d1b006998a2d None admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:24.800294 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795c8a2-e833-496b-9863-d1b006998a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:24.800569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795c8a2-e833-496b-9863-d1b006998a2d None admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:24.801274 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795c8a2-e833-496b-9863-d1b006998a2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:24.802763 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795c8a2-e833-496b-9863-d1b006998a2d None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:24.825699 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 231/467] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 29 12:07:24 2022] POST /identity/v3/users => generated 248 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:07:24.826782 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795c8a2-e833-496b-9863-d1b006998a2d None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:24.896498 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b16e20-4f17-4e58-b3fe-c5a12aacb5c6 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:24.937699 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1c041-36a1-492f-b64d-094b10e58894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:24.938782 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1c041-36a1-492f-b64d-094b10e58894 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:24.939209 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1c041-36a1-492f-b64d-094b10e58894 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:24.939677 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1c041-36a1-492f-b64d-094b10e58894 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:24.951366 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1c041-36a1-492f-b64d-094b10e58894 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:24.953087 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1c041-36a1-492f-b64d-094b10e58894 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:24.964294 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:24.974908 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-60c1c041-36a1-492f-b64d-094b10e58894 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:24.974908 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:24.974908 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:24.974908 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:24.974908 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:24.974908 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:24.974908 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:24.974908 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:24.974908 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:24.974908 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:24.974908 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:24.974908 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:24.974908 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:24.974908 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:24.974908 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:24.976356 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:24.976356 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:24.976356 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:24.976356 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:24.976356 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:24.976356 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:24.976356 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:24.976356 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:24.976356 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:24.976356 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:24.976356 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:24.976356 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:24.976356 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:24.976356 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:24.976356 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:24.976356 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:24.976356 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:24.977202 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:24.977202 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:24.977202 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:24.977202 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:24.980531 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795c8a2-e833-496b-9863-d1b006998a2d None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:24.982076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 237/468] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:24.983574 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45f91f-a189-4c59-a0a1-85b7f06a2c9a None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:24.983868 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45f91f-a189-4c59-a0a1-85b7f06a2c9a None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:24.984147 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45f91f-a189-4c59-a0a1-85b7f06a2c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:25.003314 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-8f45f91f-a189-4c59-a0a1-85b7f06a2c9a None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:25.004612 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-8f45f91f-a189-4c59-a0a1-85b7f06a2c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:25.032404 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4325708-9f9f-4e7f-8531-ecce08e346fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:25.033784 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4325708-9f9f-4e7f-8531-ecce08e346fd None admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:25.034315 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4325708-9f9f-4e7f-8531-ecce08e346fd None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:25.034898 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4325708-9f9f-4e7f-8531-ecce08e346fd None admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:25.035911 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4325708-9f9f-4e7f-8531-ecce08e346fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:25.038481 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4325708-9f9f-4e7f-8531-ecce08e346fd None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:25.049548 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:25.063987 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 232/469] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 29 12:07:24 2022] POST /identity/v3/users => generated 246 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:07:25.064842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4325708-9f9f-4e7f-8531-ecce08e346fd None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:25.107117 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 238/470] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:25.109256 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ab882-804c-41de-b9ed-c9c62f98024a None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:25.109548 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ab882-804c-41de-b9ed-c9c62f98024a None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:25.109829 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ab882-804c-41de-b9ed-c9c62f98024a None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:25.111651 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 239/471] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:25.117424 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9448ddf-5a93-4442-ae99-f3f4c012d51f None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:25.117706 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9448ddf-5a93-4442-ae99-f3f4c012d51f None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:25.117984 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9448ddf-5a93-4442-ae99-f3f4c012d51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:25.137443 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-e9448ddf-5a93-4442-ae99-f3f4c012d51f None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:25.138803 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-e9448ddf-5a93-4442-ae99-f3f4c012d51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:25.219733 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4325708-9f9f-4e7f-8531-ecce08e346fd None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:25.241412 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 240/472] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:07:25.242283 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9448ddf-5a93-4442-ae99-f3f4c012d51f None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:25.270418 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea8bf8-2004-4506-853a-529b07c3f4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:25.271497 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea8bf8-2004-4506-853a-529b07c3f4bb None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:25.272570 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea8bf8-2004-4506-853a-529b07c3f4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:25.272920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea8bf8-2004-4506-853a-529b07c3f4bb None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:25.273705 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea8bf8-2004-4506-853a-529b07c3f4bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:25.274061 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea8bf8-2004-4506-853a-529b07c3f4bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:25.275534 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea8bf8-2004-4506-853a-529b07c3f4bb None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:25.289371 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 233/473] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:25.290195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea8bf8-2004-4506-853a-529b07c3f4bb None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:25.298801 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:25.376465 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9448ddf-5a93-4442-ae99-f3f4c012d51f None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:25.378294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:25.419534 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349ea97-97dd-426f-850a-38119e45c544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:25.419993 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea8bf8-2004-4506-853a-529b07c3f4bb None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:25.420337 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349ea97-97dd-426f-850a-38119e45c544 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:25.420624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349ea97-97dd-426f-850a-38119e45c544 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:25.420902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349ea97-97dd-426f-850a-38119e45c544 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:25.432003 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349ea97-97dd-426f-850a-38119e45c544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:25.433504 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349ea97-97dd-426f-850a-38119e45c544 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:25.453884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-5349ea97-97dd-426f-850a-38119e45c544 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:25.453884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:25.453884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:25.453884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:25.453884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:25.453884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:25.453884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:25.453884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:25.453884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:25.453884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:25.453884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:25.453884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:25.453884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:25.453884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:25.453884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:25.455040 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:25.455040 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:25.455040 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:25.455040 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:25.455040 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:25.455040 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:25.455040 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:25.455040 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:25.455040 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:25.455040 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:25.455040 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:25.455040 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:25.455040 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:25.455040 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:25.455040 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:25.455040 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:25.455040 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:25.455898 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:25.455898 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:25.455898 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:25.455898 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:25.458328 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 241/474] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:25.463552 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349ea97-97dd-426f-850a-38119e45c544 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:25.468956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23255cf5-5878-4023-b7d2-2a214362d401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:25.469655 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23255cf5-5878-4023-b7d2-2a214362d401 None admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:25.469996 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23255cf5-5878-4023-b7d2-2a214362d401 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:25.470225 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23255cf5-5878-4023-b7d2-2a214362d401 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:25.471035 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23255cf5-5878-4023-b7d2-2a214362d401 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:25.472439 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23255cf5-5878-4023-b7d2-2a214362d401 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:25.480302 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.sql.core [None req-23255cf5-5878-4023-b7d2-2a214362d401 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 29 12:07:25.480302 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 29 12:07:25.480302 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [parameters: {'id': '98387f8945e842f085bc84759620a58c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 29 12:07:25.480302 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80081) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 29 12:07:25.505498 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-23255cf5-5878-4023-b7d2-2a214362d401 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 29 12:07:25.505498 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:25.505498 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 12:07:25.505498 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 12:07:25.505498 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 12:07:25.505498 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 12:07:25.505498 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 12:07:25.505498 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 12:07:25.505498 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 12:07:25.505498 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application conn.query(q) Jun 29 12:07:25.505498 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 12:07:25.505498 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 12:07:25.505498 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 12:07:25.505498 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application result.read() Jun 29 12:07:25.505498 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 12:07:25.507056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 12:07:25.507056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 12:07:25.507056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 12:07:25.507056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 12:07:25.507056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 12:07:25.507056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 12:07:25.507056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 12:07:25.507056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 29 12:07:25.507056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:25.507056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 29 12:07:25.507056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:25.507056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:25.507056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 29 12:07:25.507056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 29 12:07:25.507056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 29 12:07:25.507056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return ref.to_dict() Jun 29 12:07:25.507056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 12:07:25.507056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application next(self.gen) Jun 29 12:07:25.507972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 29 12:07:25.507972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application yield resource Jun 29 12:07:25.507972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 12:07:25.507972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application next(self.gen) Jun 29 12:07:25.507972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 29 12:07:25.507972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self.session.rollback() Jun 29 12:07:25.507972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 29 12:07:25.507972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self.force_reraise() Jun 29 12:07:25.507972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 29 12:07:25.507972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise self.value Jun 29 12:07:25.507972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 29 12:07:25.507972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 29 12:07:25.507972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 29 12:07:25.507972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application session.commit() Jun 29 12:07:25.507972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 29 12:07:25.507972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 29 12:07:25.507972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 29 12:07:25.508827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._prepare_impl() Jun 29 12:07:25.508827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 29 12:07:25.508827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self.session.flush() Jun 29 12:07:25.508827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 29 12:07:25.508827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._flush(objects) Jun 29 12:07:25.508827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 29 12:07:25.508827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 29 12:07:25.508827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 29 12:07:25.508827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application compat.raise_( Jun 29 12:07:25.508827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 12:07:25.508827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception Jun 29 12:07:25.508827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 29 12:07:25.508827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application flush_context.execute() Jun 29 12:07:25.508827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 29 12:07:25.508827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rec.execute(self) Jun 29 12:07:25.508827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 29 12:07:25.508827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 29 12:07:25.510475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 29 12:07:25.510475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 29 12:07:25.510475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 29 12:07:25.510475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 29 12:07:25.510475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 29 12:07:25.510475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 29 12:07:25.510475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 29 12:07:25.510475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 29 12:07:25.510475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 29 12:07:25.510475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 29 12:07:25.510475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 29 12:07:25.510475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 29 12:07:25.510475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 29 12:07:25.510475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 29 12:07:25.510475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 12:07:25.510475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception Jun 29 12:07:25.511837 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 12:07:25.511837 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 12:07:25.511837 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 12:07:25.511837 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 12:07:25.511837 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 12:07:25.511837 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 12:07:25.511837 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 12:07:25.511837 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application conn.query(q) Jun 29 12:07:25.511837 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 12:07:25.511837 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 12:07:25.511837 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 12:07:25.511837 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application result.read() Jun 29 12:07:25.511837 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 12:07:25.511837 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 12:07:25.511837 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 12:07:25.511837 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 12:07:25.514937 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 12:07:25.514937 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 12:07:25.514937 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 12:07:25.514937 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 12:07:25.514937 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 29 12:07:25.514937 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 29 12:07:25.514937 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [parameters: {'id': '98387f8945e842f085bc84759620a58c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 29 12:07:25.514937 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 29 12:07:25.514937 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:25.514937 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:07:25.514937 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:25.514937 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:25.514937 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:25.514937 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:25.514937 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:25.514937 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:25.516923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:25.516923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:25.516923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:25.516923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:25.516923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:25.516923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:25.516923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 29 12:07:25.516923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 29 12:07:25.516923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:25.516923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:25.516923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 29 12:07:25.516923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 29 12:07:25.516923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 29 12:07:25.516923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 29 12:07:25.516923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 29 12:07:25.516923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:25.520164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 234/475] 10.222.0.13 () {60 vars in 1131 bytes} [Wed Jun 29 12:07:25 2022] POST /identity/v3/roles => generated 144 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:25.520164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23255cf5-5878-4023-b7d2-2a214362d401 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:25.604758 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:25.609261 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349ea97-97dd-426f-850a-38119e45c544 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:25.639875 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23255cf5-5878-4023-b7d2-2a214362d401 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:25.652823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d9a89-f11e-491e-b657-f53967cc1aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:25.653704 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d9a89-f11e-491e-b657-f53967cc1aed None admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:25.654088 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d9a89-f11e-491e-b657-f53967cc1aed None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:25.654497 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d9a89-f11e-491e-b657-f53967cc1aed None admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:25.655576 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d9a89-f11e-491e-b657-f53967cc1aed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:25.657282 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d9a89-f11e-491e-b657-f53967cc1aed None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:25.679057 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7299e3a-fec0-470a-a0c7-faad3897a780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:25.680011 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7299e3a-fec0-470a-a0c7-faad3897a780 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:25.680516 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7299e3a-fec0-470a-a0c7-faad3897a780 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:25.680934 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7299e3a-fec0-470a-a0c7-faad3897a780 None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:25.682006 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7299e3a-fec0-470a-a0c7-faad3897a780 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:25.682323 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7299e3a-fec0-470a-a0c7-faad3897a780 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:25.683753 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7299e3a-fec0-470a-a0c7-faad3897a780 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:25.684893 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 242/476] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 29 12:07:25 2022] POST /identity/v3/users => generated 248 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:07:25.685943 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d9a89-f11e-491e-b657-f53967cc1aed None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:25.706714 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 235/477] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:25.706714 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7299e3a-fec0-470a-a0c7-faad3897a780 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:25.714031 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:25.844634 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7299e3a-fec0-470a-a0c7-faad3897a780 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:25.890954 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:25.892986 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ad9a2-1d20-4f36-b0d1-1cb174014dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:25.893690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ad9a2-1d20-4f36-b0d1-1cb174014dfb None admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:25.894242 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ad9a2-1d20-4f36-b0d1-1cb174014dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:25.894534 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ad9a2-1d20-4f36-b0d1-1cb174014dfb None admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:25.896588 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ad9a2-1d20-4f36-b0d1-1cb174014dfb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:25.898089 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ad9a2-1d20-4f36-b0d1-1cb174014dfb None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:25.922760 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 236/478] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 29 12:07:25 2022] POST /identity/v3/users => generated 249 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:07:25.923903 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d9a89-f11e-491e-b657-f53967cc1aed None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:25.967961 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bb519-4255-4e95-afbc-7426476cd2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:25.969263 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bb519-4255-4e95-afbc-7426476cd2b8 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:25.969693 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bb519-4255-4e95-afbc-7426476cd2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:25.970106 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bb519-4255-4e95-afbc-7426476cd2b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:25.984834 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801bb519-4255-4e95-afbc-7426476cd2b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:25.994526 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-801bb519-4255-4e95-afbc-7426476cd2b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:07:25.994526 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:25.994526 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:25.994526 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:25.994526 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:25.994526 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:25.994526 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:25.994526 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:25.994526 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:25.994526 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:25.994526 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:25.994526 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:25.994526 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:25.994526 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:25.994526 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:25.994526 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:25.995973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:25.995973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:25.995973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:25.995973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:25.995973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:25.995973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:25.995973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:25.995973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:25.995973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:25.995973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:25.995973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:25.995973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:25.995973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:25.995973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:25.995973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:25.995973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:25.997227 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:25.997227 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:25.997227 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:25.997227 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:25.997227 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:25.997227 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:25.997227 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:25.997227 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:25.997227 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:25.997227 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:25.997227 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:07:25.997227 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:25.999801 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 243/479] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 29 12:07:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:26.005852 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ad9a2-1d20-4f36-b0d1-1cb174014dfb None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:26.126436 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ad9a2-1d20-4f36-b0d1-1cb174014dfb None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:26.167910 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0786df8-ac1f-4ea7-9898-447a505d3bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:26.168656 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0786df8-ac1f-4ea7-9898-447a505d3bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:26.168942 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0786df8-ac1f-4ea7-9898-447a505d3bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:26.169273 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0786df8-ac1f-4ea7-9898-447a505d3bd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:26.170033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0786df8-ac1f-4ea7-9898-447a505d3bd1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:26.170345 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0786df8-ac1f-4ea7-9898-447a505d3bd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:26.171776 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0786df8-ac1f-4ea7-9898-447a505d3bd1 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:26.181796 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 237/480] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:27.362023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f371111-8c88-4fa7-8ec1-cbf8d2503552 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:27.362538 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f371111-8c88-4fa7-8ec1-cbf8d2503552 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:27.362614 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f371111-8c88-4fa7-8ec1-cbf8d2503552 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:27.364226 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 244/481] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:27.369747 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d89a2-5291-4f21-a07c-afb25b135907 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:27.370186 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d89a2-5291-4f21-a07c-afb25b135907 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:27.370372 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d89a2-5291-4f21-a07c-afb25b135907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:27.395601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-187d89a2-5291-4f21-a07c-afb25b135907 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:27.397433 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-187d89a2-5291-4f21-a07c-afb25b135907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:27.456445 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:27.488143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 238/482] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:27.524990 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f371111-8c88-4fa7-8ec1-cbf8d2503552 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:27.631851 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:27.680520 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f371111-8c88-4fa7-8ec1-cbf8d2503552 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:27.684196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85709c-0138-49fd-ade7-4168b857d826 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:27.684492 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85709c-0138-49fd-ade7-4168b857d826 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:27.684771 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85709c-0138-49fd-ade7-4168b857d826 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:27.686372 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 239/483] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:27.691434 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c58a1-d8c4-4b26-94ac-6b472830c0b4 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:27.691725 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c58a1-d8c4-4b26-94ac-6b472830c0b4 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:27.692002 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c58a1-d8c4-4b26-94ac-6b472830c0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:27.718329 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c7278-0fdb-4459-8008-2f3183d854ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:27.719174 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c7278-0fdb-4459-8008-2f3183d854ca None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:27.719465 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c7278-0fdb-4459-8008-2f3183d854ca None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:27.719752 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c7278-0fdb-4459-8008-2f3183d854ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:27.733395 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c7278-0fdb-4459-8008-2f3183d854ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:27.737518 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-051c58a1-d8c4-4b26-94ac-6b472830c0b4 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:27.738741 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-051c58a1-d8c4-4b26-94ac-6b472830c0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:27.745909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-ae4c7278-0fdb-4459-8008-2f3183d854ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:07:27.745909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:27.745909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:27.745909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:27.745909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:27.745909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:27.745909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:27.745909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:27.745909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:27.745909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:27.745909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:27.745909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:27.745909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:27.745909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:27.745909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:27.745909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:27.746878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:27.746878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:27.746878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:27.746878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:27.746878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:27.746878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:27.746878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:27.746878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:27.746878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:27.746878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:27.746878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:27.746878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:27.746878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:27.746878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:27.746878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:27.746878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:27.747813 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:27.747813 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:27.747813 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:27.747813 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:27.747813 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:27.747813 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:27.747813 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:27.747813 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:27.747813 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:27.747813 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:27.747813 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:07:27.747813 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:27.747813 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 245/484] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 29 12:07:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:27.755570 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c7278-0fdb-4459-8008-2f3183d854ca None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:27.875933 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 240/485] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:07:27.898103 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c58a1-d8c4-4b26-94ac-6b472830c0b4 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:27.963275 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c7278-0fdb-4459-8008-2f3183d854ca None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:28.012838 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c58a1-d8c4-4b26-94ac-6b472830c0b4 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:28.026749 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:28.027021 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:28.029353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a38a3a-cc81-4c2c-bf8c-facd6670429a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:28.030032 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a38a3a-cc81-4c2c-bf8c-facd6670429a None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:28.030317 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a38a3a-cc81-4c2c-bf8c-facd6670429a None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:28.030755 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a38a3a-cc81-4c2c-bf8c-facd6670429a None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:28.031650 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a38a3a-cc81-4c2c-bf8c-facd6670429a None admin] RBAC: Adding query filter params (name=service) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:28.031962 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a38a3a-cc81-4c2c-bf8c-facd6670429a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:28.034520 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a38a3a-cc81-4c2c-bf8c-facd6670429a None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:28.051390 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 246/486] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 29 12:07:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:28.054294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a38a3a-cc81-4c2c-bf8c-facd6670429a None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:28.079438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d6531-aa33-4d67-afb4-83b2f0867148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:28.080297 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d6531-aa33-4d67-afb4-83b2f0867148 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:28.080580 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d6531-aa33-4d67-afb4-83b2f0867148 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:28.080902 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d6531-aa33-4d67-afb4-83b2f0867148 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:28.101348 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d6531-aa33-4d67-afb4-83b2f0867148 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:28.113209 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-2b0d6531-aa33-4d67-afb4-83b2f0867148 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:07:28.113209 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:28.113209 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:28.113209 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:28.113209 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:28.113209 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:28.113209 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:28.113209 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:28.113209 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:28.113209 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:28.113209 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:28.113209 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:28.113209 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:28.113209 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:28.113209 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:28.113209 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:28.114120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:28.114120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:28.114120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:28.114120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:28.114120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:28.114120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:28.114120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:28.114120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:28.114120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:28.114120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:28.114120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:28.114120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:28.114120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:28.114120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:28.114120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:28.114120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:28.114985 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:28.114985 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:28.114985 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:28.114985 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:28.114985 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:28.114985 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:28.114985 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:28.114985 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:28.114985 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:28.114985 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:28.114985 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:07:28.114985 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:28.117574 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 241/487] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 29 12:07:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:07:28.121270 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d6531-aa33-4d67-afb4-83b2f0867148 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:28.245503 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a38a3a-cc81-4c2c-bf8c-facd6670429a None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:28.294383 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814c6ef-4f34-4d61-82c2-ad339b191513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:28.295223 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814c6ef-4f34-4d61-82c2-ad339b191513 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:28.295509 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814c6ef-4f34-4d61-82c2-ad339b191513 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:28.295785 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814c6ef-4f34-4d61-82c2-ad339b191513 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:28.309262 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d6531-aa33-4d67-afb4-83b2f0867148 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:28.311437 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814c6ef-4f34-4d61-82c2-ad339b191513 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:28.312908 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814c6ef-4f34-4d61-82c2-ad339b191513 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:28.341048 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-b814c6ef-4f34-4d61-82c2-ad339b191513 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:28.341048 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:28.341048 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:28.341048 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:28.341048 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:28.341048 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:28.341048 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:28.341048 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:28.341048 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:28.341048 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:28.341048 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:28.341048 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:28.341048 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:28.341048 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:28.341048 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:28.341954 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:28.341954 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:28.341954 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:28.341954 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:28.341954 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:28.341954 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:28.341954 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:28.341954 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:28.341954 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:28.341954 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:28.341954 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:28.341954 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:28.341954 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:28.341954 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:28.341954 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:28.341954 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:28.341954 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:28.342822 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:28.342822 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:28.342822 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:28.342822 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:28.345490 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 247/488] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:28.347000 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94bb52-5782-4b6d-9e29-def5075df7c7 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:28.347412 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94bb52-5782-4b6d-9e29-def5075df7c7 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:28.347831 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94bb52-5782-4b6d-9e29-def5075df7c7 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:28.354593 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 248/489] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:28.355568 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94bb52-5782-4b6d-9e29-def5075df7c7 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:28.358878 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75e463-1cdb-4fc8-b595-8f3b76b4bde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:28.359575 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75e463-1cdb-4fc8-b595-8f3b76b4bde3 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:28.359959 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75e463-1cdb-4fc8-b595-8f3b76b4bde3 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:28.361060 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75e463-1cdb-4fc8-b595-8f3b76b4bde3 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:28.361060 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75e463-1cdb-4fc8-b595-8f3b76b4bde3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:28.361549 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75e463-1cdb-4fc8-b595-8f3b76b4bde3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:28.363084 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75e463-1cdb-4fc8-b595-8f3b76b4bde3 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:28.374475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 242/490] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 29 12:07:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:28.376306 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156382f-0fd6-4bf0-a34f-8d6fab76554d None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:28.376850 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156382f-0fd6-4bf0-a34f-8d6fab76554d None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:28.377277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156382f-0fd6-4bf0-a34f-8d6fab76554d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:28.395011 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-2156382f-0fd6-4bf0-a34f-8d6fab76554d None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:28.396426 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-2156382f-0fd6-4bf0-a34f-8d6fab76554d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:28.421298 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:28.424810 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:28.482667 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 243/491] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:28.482667 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156382f-0fd6-4bf0-a34f-8d6fab76554d None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:28.515046 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94bb52-5782-4b6d-9e29-def5075df7c7 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:28.553172 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848046d-f508-434a-a579-816ad15c832b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:28.553917 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848046d-f508-434a-a579-816ad15c832b None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:28.554198 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848046d-f508-434a-a579-816ad15c832b None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:28.554472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848046d-f508-434a-a579-816ad15c832b None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:28.555680 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0848046d-f508-434a-a579-816ad15c832b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:28.556299 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0848046d-f508-434a-a579-816ad15c832b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:28.557815 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0848046d-f508-434a-a579-816ad15c832b None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:28.569768 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 249/492] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:28.570566 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848046d-f508-434a-a579-816ad15c832b None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:28.611230 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156382f-0fd6-4bf0-a34f-8d6fab76554d None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:28.650280 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b165d-373d-454b-ae1a-e3aa53f06424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:28.651104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b165d-373d-454b-ae1a-e3aa53f06424 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:28.651386 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b165d-373d-454b-ae1a-e3aa53f06424 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:28.651656 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b165d-373d-454b-ae1a-e3aa53f06424 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:28.665593 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b165d-373d-454b-ae1a-e3aa53f06424 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:28.667092 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b165d-373d-454b-ae1a-e3aa53f06424 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:28.679046 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848046d-f508-434a-a579-816ad15c832b None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:28.682179 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:28.685018 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-e88b165d-373d-454b-ae1a-e3aa53f06424 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:28.685018 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:28.685018 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:28.685018 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:28.685018 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:28.685018 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:28.685018 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:28.685018 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:28.685018 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:28.685018 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:28.685018 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:28.685018 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:28.685018 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:28.685018 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:28.685018 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:28.686247 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:28.686247 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:28.686247 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:28.686247 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:28.686247 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:28.686247 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:28.686247 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:28.686247 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:28.686247 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:28.686247 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:28.686247 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:28.686247 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:28.686247 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:28.686247 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:28.686247 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:28.686247 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:28.686247 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:28.688120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:28.688120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:28.688120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:28.688120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:28.688120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 244/493] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:28.688120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dbff7-f040-4367-9317-99633872b814 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:28.688120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dbff7-f040-4367-9317-99633872b814 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:28.688120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dbff7-f040-4367-9317-99633872b814 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:28.689523 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 245/494] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:28.690055 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557dbff7-f040-4367-9317-99633872b814 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:28.706026 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:28.730907 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35316eea-3f33-4f5c-b53d-c6728ed378d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:28.731717 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35316eea-3f33-4f5c-b53d-c6728ed378d8 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:28.731998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35316eea-3f33-4f5c-b53d-c6728ed378d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:28.732268 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35316eea-3f33-4f5c-b53d-c6728ed378d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:28.747063 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35316eea-3f33-4f5c-b53d-c6728ed378d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:28.758922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-35316eea-3f33-4f5c-b53d-c6728ed378d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:07:28.758922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:28.758922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:28.758922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:28.758922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:28.758922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:28.758922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:28.758922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:28.758922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:28.758922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:28.758922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:28.758922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:28.758922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:28.758922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:28.758922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:28.758922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:28.760062 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:28.760062 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:28.760062 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:28.760062 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:28.760062 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:28.760062 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:28.760062 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:28.760062 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:28.760062 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:28.760062 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:28.760062 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:28.760062 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:28.760062 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:28.760062 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:28.760062 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:28.760062 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:28.760888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:28.760888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:28.760888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:28.760888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:28.760888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:28.760888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:28.760888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:28.760888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:28.760888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:28.760888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:28.760888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:07:28.760888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:28.761501 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 250/495] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 29 12:07:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:28.761904 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35316eea-3f33-4f5c-b53d-c6728ed378d8 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:28.805326 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557dbff7-f040-4367-9317-99633872b814 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:28.844628 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef43cdb-8ca8-4aae-8933-f6325082d967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:28.845951 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef43cdb-8ca8-4aae-8933-f6325082d967 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:28.846463 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef43cdb-8ca8-4aae-8933-f6325082d967 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:28.847014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef43cdb-8ca8-4aae-8933-f6325082d967 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:28.857797 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef43cdb-8ca8-4aae-8933-f6325082d967 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:28.859286 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef43cdb-8ca8-4aae-8933-f6325082d967 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:28.866477 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35316eea-3f33-4f5c-b53d-c6728ed378d8 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:28.878277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-7ef43cdb-8ca8-4aae-8933-f6325082d967 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 29 12:07:28.878277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:28.878277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:28.878277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:28.878277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:28.878277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:28.878277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:28.878277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:28.878277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:28.878277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:28.878277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:28.878277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:28.878277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:07:28.878277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:07:28.878277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:07:28.878277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:07:28.879438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:28.879438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:28.879438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:07:28.879438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:28.879438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:07:28.879438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:28.879438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:28.879438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:28.879438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:28.879438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:28.879438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:28.879438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:28.879438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:28.879438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:28.879438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:28.879438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:28.879438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:28.879438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:28.880841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:28.880841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:28.880841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:07:28.880841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:07:28.880841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:07:28.880841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:07:28.880841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:07:28.880841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:07:28.880841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 29 12:07:28.880841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:28.880841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 246/496] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:28.881536 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ea79a-758d-4dbd-96e9-b2ce2a4b04cd None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:28.881536 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ea79a-758d-4dbd-96e9-b2ce2a4b04cd None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:28.881675 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ea79a-758d-4dbd-96e9-b2ce2a4b04cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:28.898856 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-ca9ea79a-758d-4dbd-96e9-b2ce2a4b04cd None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:28.900043 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-ca9ea79a-758d-4dbd-96e9-b2ce2a4b04cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:28.905679 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a231f6-4a32-4db7-94b3-b30c86468137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:28.906363 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a231f6-4a32-4db7-94b3-b30c86468137 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:28.906669 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a231f6-4a32-4db7-94b3-b30c86468137 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:28.906945 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a231f6-4a32-4db7-94b3-b30c86468137 None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:28.907657 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a231f6-4a32-4db7-94b3-b30c86468137 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:28.907963 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a231f6-4a32-4db7-94b3-b30c86468137 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:28.909344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a231f6-4a32-4db7-94b3-b30c86468137 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:28.921770 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 251/497] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:28.923075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790f848-7e38-4a4f-b32d-75336afa3f76 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:28.923364 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790f848-7e38-4a4f-b32d-75336afa3f76 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:28.923638 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790f848-7e38-4a4f-b32d-75336afa3f76 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:28.924843 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 252/498] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:28.925527 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790f848-7e38-4a4f-b32d-75336afa3f76 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:28.951797 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:28.973081 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 247/499] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:28.973922 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ea79a-758d-4dbd-96e9-b2ce2a4b04cd None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:28.976836 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:29.032287 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790f848-7e38-4a4f-b32d-75336afa3f76 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:29.067455 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d241a35-8a20-4360-8949-01ed652f1354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:29.068045 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d241a35-8a20-4360-8949-01ed652f1354 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:29.068348 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d241a35-8a20-4360-8949-01ed652f1354 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:29.068635 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d241a35-8a20-4360-8949-01ed652f1354 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:29.069372 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d241a35-8a20-4360-8949-01ed652f1354 None admin] RBAC: Adding query filter params (name=service) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:29.069675 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d241a35-8a20-4360-8949-01ed652f1354 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:29.071107 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d241a35-8a20-4360-8949-01ed652f1354 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:29.072486 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ea79a-758d-4dbd-96e9-b2ce2a4b04cd None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:29.079321 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 253/500] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 29 12:07:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:29.080191 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d241a35-8a20-4360-8949-01ed652f1354 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:29.111193 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ab6a6-a49f-4dcf-b03a-9b2ca361a3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:29.111859 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ab6a6-a49f-4dcf-b03a-9b2ca361a3c0 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:29.112141 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ab6a6-a49f-4dcf-b03a-9b2ca361a3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:29.112414 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ab6a6-a49f-4dcf-b03a-9b2ca361a3c0 None admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:29.113239 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ab6a6-a49f-4dcf-b03a-9b2ca361a3c0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:29.113547 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ab6a6-a49f-4dcf-b03a-9b2ca361a3c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:29.115002 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ab6a6-a49f-4dcf-b03a-9b2ca361a3c0 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:29.158843 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 248/501] 10.222.0.13 () {56 vars in 1137 bytes} [Wed Jun 29 12:07:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:29.160137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc0933-43f0-4e96-8cda-6ff176428d97 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:29.160433 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc0933-43f0-4e96-8cda-6ff176428d97 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:29.160713 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc0933-43f0-4e96-8cda-6ff176428d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:29.173679 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:29.179137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-50cc0933-43f0-4e96-8cda-6ff176428d97 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:29.180363 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-50cc0933-43f0-4e96-8cda-6ff176428d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:29.189904 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d241a35-8a20-4360-8949-01ed652f1354 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:29.222264 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbb7e6-a696-4657-a33e-ad1dbae936fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:29.223075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbb7e6-a696-4657-a33e-ad1dbae936fc None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:29.223357 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbb7e6-a696-4657-a33e-ad1dbae936fc None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:29.223629 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbb7e6-a696-4657-a33e-ad1dbae936fc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:29.231712 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbbb7e6-a696-4657-a33e-ad1dbae936fc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:29.233208 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbbb7e6-a696-4657-a33e-ad1dbae936fc None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:29.235625 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:29.247452 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 249/502] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:29.248264 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc0933-43f0-4e96-8cda-6ff176428d97 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:29.249161 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-1cbbb7e6-a696-4657-a33e-ad1dbae936fc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:07:29.249161 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:29.249161 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:29.249161 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:29.249161 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:29.249161 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:29.249161 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:29.249161 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:29.249161 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:29.249161 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:29.249161 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:29.249161 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:29.249161 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:07:29.249161 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:07:29.249161 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:07:29.249161 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:07:29.250023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:29.250023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:29.250023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:07:29.250023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:29.250023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:07:29.250023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:29.250023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:29.250023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:29.250023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:29.250023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:29.250023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:29.250023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:29.250023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:29.250023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:29.250023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:29.250023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:29.250023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:29.250023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:29.251042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:29.251042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:29.251042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:07:29.251042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:07:29.251042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:07:29.251042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:07:29.251042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:07:29.251042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:07:29.251042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:07:29.251042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:29.251042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 254/503] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Jun 29 12:07:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:29.251661 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbb7e6-a696-4657-a33e-ad1dbae936fc None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:29.350826 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc0933-43f0-4e96-8cda-6ff176428d97 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:29.365061 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbb7e6-a696-4657-a33e-ad1dbae936fc None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:29.384956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86493cf-d172-4ae0-b40f-b481a14f4046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:29.385753 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86493cf-d172-4ae0-b40f-b481a14f4046 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:29.386041 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86493cf-d172-4ae0-b40f-b481a14f4046 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:29.386320 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86493cf-d172-4ae0-b40f-b481a14f4046 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:29.396085 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86493cf-d172-4ae0-b40f-b481a14f4046 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:29.398098 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86493cf-d172-4ae0-b40f-b481a14f4046 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:29.398217 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bdf2a-6c31-4c7a-b2e1-b1306550ddcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:29.398979 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bdf2a-6c31-4c7a-b2e1-b1306550ddcd None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:29.399265 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bdf2a-6c31-4c7a-b2e1-b1306550ddcd None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:29.399543 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bdf2a-6c31-4c7a-b2e1-b1306550ddcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:29.409820 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1bdf2a-6c31-4c7a-b2e1-b1306550ddcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:29.411313 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1bdf2a-6c31-4c7a-b2e1-b1306550ddcd None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:29.416070 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-f86493cf-d172-4ae0-b40f-b481a14f4046 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:29.416070 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:29.416070 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:29.416070 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:29.416070 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:29.416070 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:29.416070 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:29.416070 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:29.416070 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:29.416070 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:29.416070 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:29.416070 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:29.416070 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:29.416070 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:29.416070 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:29.416884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:29.416884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:29.416884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:29.416884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:29.416884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:29.416884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:29.416884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:29.416884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:29.416884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:29.416884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:29.416884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:29.416884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:29.416884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:29.416884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:29.416884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:29.416884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:29.416884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:29.417826 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:29.417826 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:29.417826 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:29.417826 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:29.417826 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 250/504] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:29.418383 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86493cf-d172-4ae0-b40f-b481a14f4046 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:29.418778 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:29.434005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-4c1bdf2a-6c31-4c7a-b2e1-b1306550ddcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:29.434005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:29.434005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:29.434005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:29.434005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:29.434005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:29.434005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:29.434005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:29.434005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:29.434005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:29.434005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:29.434005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:29.434005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:29.434005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:29.434005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:29.435375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:29.435375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:29.435375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:29.435375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:29.435375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:29.435375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:29.435375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:29.435375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:29.435375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:29.435375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:29.435375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:29.435375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:29.435375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:29.435375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:29.435375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:29.435375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:29.435375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:29.436267 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:29.436267 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:29.436267 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:29.436267 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:29.436267 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 255/505] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:29.436267 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bdf2a-6c31-4c7a-b2e1-b1306550ddcd None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:29.470418 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:29.532611 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86493cf-d172-4ae0-b40f-b481a14f4046 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:29.545054 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bdf2a-6c31-4c7a-b2e1-b1306550ddcd None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:29.568556 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3e496-72e4-4caa-a1bf-c3a0d56f3e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:29.569199 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3e496-72e4-4caa-a1bf-c3a0d56f3e3f None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:29.569479 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3e496-72e4-4caa-a1bf-c3a0d56f3e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:29.569747 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3e496-72e4-4caa-a1bf-c3a0d56f3e3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:29.578602 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd4140-1711-4f03-9275-c04eda3b7f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:29.579290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd4140-1711-4f03-9275-c04eda3b7f85 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:29.579576 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd4140-1711-4f03-9275-c04eda3b7f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:29.579853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd4140-1711-4f03-9275-c04eda3b7f85 None admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:29.580681 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd4140-1711-4f03-9275-c04eda3b7f85 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:29.580989 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd4140-1711-4f03-9275-c04eda3b7f85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:29.582425 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd4140-1711-4f03-9275-c04eda3b7f85 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:29.618736 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 256/506] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Jun 29 12:07:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:29.619490 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd4140-1711-4f03-9275-c04eda3b7f85 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:29.639027 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3e496-72e4-4caa-a1bf-c3a0d56f3e3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:29.640504 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3e496-72e4-4caa-a1bf-c3a0d56f3e3f None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:29.675033 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:29.681481 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:29.718206 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd4140-1711-4f03-9275-c04eda3b7f85 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:29.742171 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 251/507] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:29.743136 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3e496-72e4-4caa-a1bf-c3a0d56f3e3f None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:29.755502 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98127d88-065a-41a0-8852-a1e21e50f53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:29.756900 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98127d88-065a-41a0-8852-a1e21e50f53e None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:29.757181 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98127d88-065a-41a0-8852-a1e21e50f53e None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:29.757452 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98127d88-065a-41a0-8852-a1e21e50f53e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:29.768288 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98127d88-065a-41a0-8852-a1e21e50f53e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:29.776666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-98127d88-065a-41a0-8852-a1e21e50f53e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:07:29.776666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:29.776666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:29.776666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:29.776666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:29.776666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:29.776666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:29.776666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:29.776666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:29.776666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:29.776666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:29.776666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:29.776666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:29.776666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:29.776666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:29.776666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:29.777750 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:29.777750 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:29.777750 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:29.777750 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:29.777750 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:29.777750 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:29.777750 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:29.777750 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:29.777750 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:29.777750 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:29.777750 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:29.777750 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:29.777750 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:29.777750 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:29.777750 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:29.777750 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:29.778584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:29.778584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:29.778584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:29.778584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:29.778584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:29.778584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:29.778584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:29.778584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:29.778584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:29.778584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:29.778584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:07:29.778584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:29.778584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 257/508] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 29 12:07:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:29.778584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98127d88-065a-41a0-8852-a1e21e50f53e None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:29.852221 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3e496-72e4-4caa-a1bf-c3a0d56f3e3f None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:29.880000 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98127d88-065a-41a0-8852-a1e21e50f53e None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:29.888777 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007e594-2d0f-4e3d-913f-2812eaf00ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:29.889524 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007e594-2d0f-4e3d-913f-2812eaf00ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:29.889919 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007e594-2d0f-4e3d-913f-2812eaf00ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:29.890238 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007e594-2d0f-4e3d-913f-2812eaf00ec1 None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:29.891054 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007e594-2d0f-4e3d-913f-2812eaf00ec1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:29.891367 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007e594-2d0f-4e3d-913f-2812eaf00ec1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:29.892746 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007e594-2d0f-4e3d-913f-2812eaf00ec1 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:29.899683 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:29.904920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 252/509] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:29.905799 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007e594-2d0f-4e3d-913f-2812eaf00ec1 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:29.908697 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:29.918800 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efe344-a2a0-4515-a149-842b8c3d7c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:29.919457 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efe344-a2a0-4515-a149-842b8c3d7c9e None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:29.919738 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efe344-a2a0-4515-a149-842b8c3d7c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:29.920011 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efe344-a2a0-4515-a149-842b8c3d7c9e None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:29.920728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efe344-a2a0-4515-a149-842b8c3d7c9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:29.921034 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efe344-a2a0-4515-a149-842b8c3d7c9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:29.922432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efe344-a2a0-4515-a149-842b8c3d7c9e None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:29.934604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 258/510] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:29.935345 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efe344-a2a0-4515-a149-842b8c3d7c9e None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:30.007479 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007e594-2d0f-4e3d-913f-2812eaf00ec1 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:30.034863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efe344-a2a0-4515-a149-842b8c3d7c9e None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:30.041027 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcfa32-3ed5-40b4-b7ee-cffff33c73fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:30.041678 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcfa32-3ed5-40b4-b7ee-cffff33c73fd None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:30.041968 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcfa32-3ed5-40b4-b7ee-cffff33c73fd None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:30.042256 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcfa32-3ed5-40b4-b7ee-cffff33c73fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:30.068135 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91f001-d3db-41c2-bd30-841ed3311e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:30.069703 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91f001-d3db-41c2-bd30-841ed3311e65 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:30.069986 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91f001-d3db-41c2-bd30-841ed3311e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:30.070307 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91f001-d3db-41c2-bd30-841ed3311e65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:30.081238 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf91f001-d3db-41c2-bd30-841ed3311e65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:30.082715 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf91f001-d3db-41c2-bd30-841ed3311e65 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:30.099585 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-bf91f001-d3db-41c2-bd30-841ed3311e65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:30.099585 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:30.099585 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:30.099585 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:30.099585 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:30.099585 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:30.099585 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:30.099585 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:30.099585 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:30.099585 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:30.099585 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:30.099585 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:30.099585 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:30.099585 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:30.099585 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:30.100425 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:30.100425 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:30.100425 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:30.100425 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:30.100425 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:30.100425 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:30.100425 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:30.100425 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:30.100425 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:30.100425 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:30.100425 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:30.100425 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:30.100425 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:30.100425 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:30.100425 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:30.100425 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:30.100425 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:30.101521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:30.101521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:30.101521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:30.101521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:30.101521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 259/511] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:30.101789 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91f001-d3db-41c2-bd30-841ed3311e65 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:30.112100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdcfa32-3ed5-40b4-b7ee-cffff33c73fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:30.113568 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdcfa32-3ed5-40b4-b7ee-cffff33c73fd None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:30.116384 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:30.134485 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:30.205395 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91f001-d3db-41c2-bd30-841ed3311e65 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:30.215661 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 253/512] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:30.216563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcfa32-3ed5-40b4-b7ee-cffff33c73fd None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:30.238692 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5a6d1-7517-4840-9277-ae3a3fcc4276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:30.239355 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5a6d1-7517-4840-9277-ae3a3fcc4276 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:30.239638 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5a6d1-7517-4840-9277-ae3a3fcc4276 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:30.239914 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5a6d1-7517-4840-9277-ae3a3fcc4276 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:30.241155 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5a6d1-7517-4840-9277-ae3a3fcc4276 None admin] RBAC: Adding query filter params (name=service) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:30.241722 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5a6d1-7517-4840-9277-ae3a3fcc4276 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:30.243153 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5a6d1-7517-4840-9277-ae3a3fcc4276 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:30.250850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 260/513] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 29 12:07:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:30.251620 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5a6d1-7517-4840-9277-ae3a3fcc4276 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:30.317866 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcfa32-3ed5-40b4-b7ee-cffff33c73fd None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:30.320120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:30.341828 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:30.352786 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5a6d1-7517-4840-9277-ae3a3fcc4276 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:30.353336 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49b56e-7fd8-47b1-8cb0-0728d8dc5e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:30.354014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49b56e-7fd8-47b1-8cb0-0728d8dc5e86 None admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:30.354299 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49b56e-7fd8-47b1-8cb0-0728d8dc5e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:30.354917 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49b56e-7fd8-47b1-8cb0-0728d8dc5e86 None admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:30.355385 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c49b56e-7fd8-47b1-8cb0-0728d8dc5e86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:30.356834 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c49b56e-7fd8-47b1-8cb0-0728d8dc5e86 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:30.390320 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 254/514] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 29 12:07:30 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:07:30.390320 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49b56e-7fd8-47b1-8cb0-0728d8dc5e86 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:30.395267 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b004e0-01d1-4a1e-aa12-be0ae9a765a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:30.396194 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b004e0-01d1-4a1e-aa12-be0ae9a765a5 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:30.396543 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b004e0-01d1-4a1e-aa12-be0ae9a765a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:30.396831 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b004e0-01d1-4a1e-aa12-be0ae9a765a5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:30.405562 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b004e0-01d1-4a1e-aa12-be0ae9a765a5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:30.407131 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b004e0-01d1-4a1e-aa12-be0ae9a765a5 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:30.424075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-96b004e0-01d1-4a1e-aa12-be0ae9a765a5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 12:07:30.424075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:30.424075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:30.424075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:30.424075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:30.424075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:30.424075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:30.424075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:30.424075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:30.424075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:30.424075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:30.424075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:30.424075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:07:30.424075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:07:30.424075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:07:30.424075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:07:30.425074 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:30.425074 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:30.425074 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:07:30.425074 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:30.425074 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:07:30.425074 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:30.425074 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:30.425074 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:30.425074 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:30.425074 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:30.425074 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:30.425074 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:30.425074 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:30.425074 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:30.425074 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:30.425074 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:30.425074 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:30.425074 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:30.425966 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:30.425966 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:30.425966 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:07:30.425966 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:07:30.425966 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:07:30.425966 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:07:30.425966 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:07:30.425966 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:07:30.425966 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 12:07:30.425966 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:30.425966 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 261/515] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:30.426543 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b004e0-01d1-4a1e-aa12-be0ae9a765a5 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:30.498205 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49b56e-7fd8-47b1-8cb0-0728d8dc5e86 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:30.541411 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861f0a6-bba6-40dc-9e14-a2b3913f8204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:30.542088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861f0a6-bba6-40dc-9e14-a2b3913f8204 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:30.542383 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861f0a6-bba6-40dc-9e14-a2b3913f8204 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:30.542736 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861f0a6-bba6-40dc-9e14-a2b3913f8204 None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:30.543471 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861f0a6-bba6-40dc-9e14-a2b3913f8204 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:30.543786 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861f0a6-bba6-40dc-9e14-a2b3913f8204 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:30.545166 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861f0a6-bba6-40dc-9e14-a2b3913f8204 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:30.545922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b004e0-01d1-4a1e-aa12-be0ae9a765a5 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:30.557790 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 255/516] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:30.558624 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861f0a6-bba6-40dc-9e14-a2b3913f8204 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:30.586532 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:30.589289 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9758380-ea2f-47b8-80ea-14fdbc5d334a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:30.590082 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9758380-ea2f-47b8-80ea-14fdbc5d334a None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:30.590356 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9758380-ea2f-47b8-80ea-14fdbc5d334a None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:30.590630 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9758380-ea2f-47b8-80ea-14fdbc5d334a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:30.601610 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9758380-ea2f-47b8-80ea-14fdbc5d334a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:30.603166 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9758380-ea2f-47b8-80ea-14fdbc5d334a None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:30.622745 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-f9758380-ea2f-47b8-80ea-14fdbc5d334a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:30.622745 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:30.622745 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:30.622745 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:30.622745 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:30.622745 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:30.622745 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:30.622745 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:30.622745 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:30.622745 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:30.622745 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:30.622745 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:30.622745 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:30.622745 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:30.622745 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:30.623662 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:30.623662 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:30.623662 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:30.623662 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:30.623662 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:30.623662 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:30.623662 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:30.623662 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:30.623662 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:30.623662 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:30.623662 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:30.623662 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:30.623662 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:30.623662 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:30.623662 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:30.623662 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:30.623662 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:30.624532 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:30.624532 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:30.624532 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:30.624532 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:30.624739 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 262/517] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:30.626768 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9758380-ea2f-47b8-80ea-14fdbc5d334a None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:30.629770 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:30.673261 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861f0a6-bba6-40dc-9e14-a2b3913f8204 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:30.707944 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457b80e-0dc6-40ff-b9bd-f12bf9b01d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:30.708748 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457b80e-0dc6-40ff-b9bd-f12bf9b01d01 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:30.709084 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457b80e-0dc6-40ff-b9bd-f12bf9b01d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:30.709894 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457b80e-0dc6-40ff-b9bd-f12bf9b01d01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:30.722850 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457b80e-0dc6-40ff-b9bd-f12bf9b01d01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:30.724416 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457b80e-0dc6-40ff-b9bd-f12bf9b01d01 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:30.737724 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9758380-ea2f-47b8-80ea-14fdbc5d334a None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:30.747696 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-2457b80e-0dc6-40ff-b9bd-f12bf9b01d01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:30.747696 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:30.747696 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:30.747696 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:30.747696 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:30.747696 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:30.747696 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:30.747696 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:30.747696 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:30.747696 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:30.747696 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:30.747696 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:30.747696 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:30.747696 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:30.747696 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:30.748569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:30.748569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:30.748569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:30.748569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:30.748569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:30.748569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:30.748569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:30.748569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:30.748569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:30.748569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:30.748569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:30.748569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:30.748569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:30.748569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:30.748569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:30.748569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:30.748569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:30.749419 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:30.749419 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:30.749419 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:30.749419 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:30.750956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 256/518] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:30.751634 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457b80e-0dc6-40ff-b9bd-f12bf9b01d01 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:30.778600 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f4b14-5914-48c8-86c2-a7b19bb89a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:30.779298 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f4b14-5914-48c8-86c2-a7b19bb89a2c None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:30.779582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f4b14-5914-48c8-86c2-a7b19bb89a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:30.779853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f4b14-5914-48c8-86c2-a7b19bb89a2c None admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:30.780690 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f4b14-5914-48c8-86c2-a7b19bb89a2c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:30.780997 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f4b14-5914-48c8-86c2-a7b19bb89a2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:30.782435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f4b14-5914-48c8-86c2-a7b19bb89a2c None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:30.800686 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 263/519] 10.222.0.13 () {56 vars in 1137 bytes} [Wed Jun 29 12:07:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:30.801345 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f4b14-5914-48c8-86c2-a7b19bb89a2c None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:30.833493 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:30.864568 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:30.867775 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457b80e-0dc6-40ff-b9bd-f12bf9b01d01 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:30.907144 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18b72f-91bd-4214-a5da-fec14face54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:30.907355 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f4b14-5914-48c8-86c2-a7b19bb89a2c None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:30.907944 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18b72f-91bd-4214-a5da-fec14face54e None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:30.908229 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18b72f-91bd-4214-a5da-fec14face54e None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:30.908507 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18b72f-91bd-4214-a5da-fec14face54e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:30.916304 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a18b72f-91bd-4214-a5da-fec14face54e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:30.917790 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a18b72f-91bd-4214-a5da-fec14face54e None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:30.932947 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-8a18b72f-91bd-4214-a5da-fec14face54e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:30.932947 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:30.932947 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:30.932947 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:30.932947 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:30.932947 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:30.932947 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:30.932947 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:30.932947 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:30.932947 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:30.932947 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:30.932947 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:30.932947 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:07:30.932947 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:07:30.932947 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:07:30.933971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:07:30.933971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:30.933971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:30.933971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:30.933971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:30.933971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:30.933971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:30.933971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:30.933971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:30.933971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:30.933971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:30.933971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:30.933971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:30.933971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:30.933971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:30.933971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:30.933971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:30.934870 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:07:30.934870 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:07:30.934870 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:07:30.934870 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:07:30.934870 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:07:30.934870 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:07:30.934870 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:30.934870 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:30.934870 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 257/520] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:30.934870 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18b72f-91bd-4214-a5da-fec14face54e None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:30.954435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e5000-708e-49b5-b4b3-343c39625a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:30.955492 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e5000-708e-49b5-b4b3-343c39625a16 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:30.955828 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e5000-708e-49b5-b4b3-343c39625a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:30.956103 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e5000-708e-49b5-b4b3-343c39625a16 None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:30.957105 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e5000-708e-49b5-b4b3-343c39625a16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:30.957212 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e5000-708e-49b5-b4b3-343c39625a16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:30.958860 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e5000-708e-49b5-b4b3-343c39625a16 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:30.975388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 264/521] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:30.975388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e5000-708e-49b5-b4b3-343c39625a16 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:31.055227 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18b72f-91bd-4214-a5da-fec14face54e None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:31.086723 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:31.090423 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e5000-708e-49b5-b4b3-343c39625a16 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:31.094045 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252dd9c5-1d9e-40b2-a118-ee43edc2d314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:31.094722 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dd9c5-1d9e-40b2-a118-ee43edc2d314 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:31.095010 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dd9c5-1d9e-40b2-a118-ee43edc2d314 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:31.095284 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dd9c5-1d9e-40b2-a118-ee43edc2d314 None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:31.096008 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252dd9c5-1d9e-40b2-a118-ee43edc2d314 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:31.096316 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252dd9c5-1d9e-40b2-a118-ee43edc2d314 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:31.097715 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252dd9c5-1d9e-40b2-a118-ee43edc2d314 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:31.110791 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 258/522] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:31.111662 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252dd9c5-1d9e-40b2-a118-ee43edc2d314 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:31.117898 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:31.134656 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0d3c7-4b21-42a1-9b5c-c6ea4723b94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:31.135320 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0d3c7-4b21-42a1-9b5c-c6ea4723b94d None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:31.135606 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0d3c7-4b21-42a1-9b5c-c6ea4723b94d None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:31.135884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0d3c7-4b21-42a1-9b5c-c6ea4723b94d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:31.213115 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0d3c7-4b21-42a1-9b5c-c6ea4723b94d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:31.214518 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0d3c7-4b21-42a1-9b5c-c6ea4723b94d None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:31.221344 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252dd9c5-1d9e-40b2-a118-ee43edc2d314 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:31.255372 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d24588-21ea-4193-81dd-2e141ddf2d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:31.256059 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d24588-21ea-4193-81dd-2e141ddf2d81 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:31.256407 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d24588-21ea-4193-81dd-2e141ddf2d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:31.256625 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d24588-21ea-4193-81dd-2e141ddf2d81 None admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:31.257407 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d24588-21ea-4193-81dd-2e141ddf2d81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:31.257723 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d24588-21ea-4193-81dd-2e141ddf2d81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:31.259198 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d24588-21ea-4193-81dd-2e141ddf2d81 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:31.276945 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 259/523] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:07:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:31.277751 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d24588-21ea-4193-81dd-2e141ddf2d81 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:31.323811 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 265/524] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:31.324928 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0d3c7-4b21-42a1-9b5c-c6ea4723b94d None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:31.339163 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:31.346875 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:31.392612 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d24588-21ea-4193-81dd-2e141ddf2d81 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:31.429214 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0d3c7-4b21-42a1-9b5c-c6ea4723b94d None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:31.430197 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8a696-0bbc-4e49-b380-e77789ae924a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:31.431027 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8a696-0bbc-4e49-b380-e77789ae924a None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:31.431315 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8a696-0bbc-4e49-b380-e77789ae924a None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:31.431603 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8a696-0bbc-4e49-b380-e77789ae924a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:31.438469 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8a696-0bbc-4e49-b380-e77789ae924a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:31.439963 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8a696-0bbc-4e49-b380-e77789ae924a None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:31.454551 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-17e8a696-0bbc-4e49-b380-e77789ae924a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:31.454551 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:31.454551 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:31.454551 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:31.454551 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:31.454551 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:31.454551 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:31.454551 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:31.454551 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:31.454551 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:31.454551 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:31.454551 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:31.454551 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:07:31.454551 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:07:31.454551 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:07:31.455698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:07:31.455698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:31.455698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:31.455698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:31.455698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:31.455698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:31.455698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:31.455698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:31.455698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:31.455698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:31.455698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:31.455698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:31.455698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:31.455698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:31.455698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:31.455698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:31.455698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:31.457174 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:07:31.457174 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:07:31.457174 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:07:31.457174 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:07:31.457174 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:07:31.457174 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:07:31.457174 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:31.457174 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:31.457174 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 260/525] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:31.461266 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8a696-0bbc-4e49-b380-e77789ae924a None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:31.467285 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b48c5-0a2b-4f0a-8430-1dfe699af675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:31.468104 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b48c5-0a2b-4f0a-8430-1dfe699af675 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:31.468455 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b48c5-0a2b-4f0a-8430-1dfe699af675 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:31.468798 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b48c5-0a2b-4f0a-8430-1dfe699af675 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:31.476874 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b48c5-0a2b-4f0a-8430-1dfe699af675 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:31.478411 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b48c5-0a2b-4f0a-8430-1dfe699af675 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:31.493699 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-278b48c5-0a2b-4f0a-8430-1dfe699af675 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 12:07:31.493699 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:31.493699 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:31.493699 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:31.493699 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:31.493699 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:31.493699 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:31.493699 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:31.493699 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:31.493699 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:31.493699 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:31.493699 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:31.493699 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:07:31.493699 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:07:31.493699 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:07:31.493699 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:07:31.494855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:31.494855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:31.494855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:07:31.494855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:31.494855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:07:31.494855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:31.494855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:31.494855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:31.494855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:31.494855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:31.494855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:31.494855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:31.494855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:31.494855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:31.494855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:31.494855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:31.494855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:31.494855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:31.495888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:31.495888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:31.495888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:07:31.495888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:07:31.495888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:07:31.495888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:07:31.495888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:07:31.495888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:07:31.495888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 12:07:31.495888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:31.495888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 266/526] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 29 12:07:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:31.495888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b48c5-0a2b-4f0a-8430-1dfe699af675 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:31.584917 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8a696-0bbc-4e49-b380-e77789ae924a None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:31.585138 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:31.595798 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:31.609025 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b48c5-0a2b-4f0a-8430-1dfe699af675 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:31.623634 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642745af-843b-4595-a41f-2518cb10f32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:31.624293 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642745af-843b-4595-a41f-2518cb10f32b None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:31.624576 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642745af-843b-4595-a41f-2518cb10f32b None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:31.624852 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642745af-843b-4595-a41f-2518cb10f32b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:31.625678 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642745af-843b-4595-a41f-2518cb10f32b None admin] RBAC: Adding query filter params (role.id=0be824a9ecd0492f984e3b3b991e3984, scope.project.id=489877ae137244c5b83291671c703c99, user.id=09d603d756a9484bbf48cfd6d56bdb0b) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:31.625996 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642745af-843b-4595-a41f-2518cb10f32b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:31.627468 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642745af-843b-4595-a41f-2518cb10f32b None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:31.642859 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 261/527] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:07:31 2022] GET /identity/v3/role_assignments?user.id=09d603d756a9484bbf48cfd6d56bdb0b&scope.project.id=489877ae137244c5b83291671c703c99&role.id=0be824a9ecd0492f984e3b3b991e3984 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:31.642859 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642745af-843b-4595-a41f-2518cb10f32b None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:31.658293 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01483db-49ee-4307-8698-67b0383495e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:31.659301 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01483db-49ee-4307-8698-67b0383495e1 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:31.659677 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01483db-49ee-4307-8698-67b0383495e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:31.660044 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01483db-49ee-4307-8698-67b0383495e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:31.674522 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01483db-49ee-4307-8698-67b0383495e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:31.676315 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01483db-49ee-4307-8698-67b0383495e1 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:31.696430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-f01483db-49ee-4307-8698-67b0383495e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:31.696430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:31.696430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:31.696430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:31.696430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:31.696430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:31.696430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:31.696430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:31.696430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:31.696430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:31.696430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:31.696430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:31.696430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:31.696430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:31.696430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:31.697616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:31.697616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:31.697616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:31.697616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:31.697616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:31.697616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:31.697616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:31.697616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:31.697616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:31.697616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:31.697616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:31.697616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:31.697616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:31.697616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:31.697616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:31.697616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:31.697616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:31.698704 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:31.698704 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:31.698704 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:31.698704 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:31.700159 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 267/528] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:31.700965 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01483db-49ee-4307-8698-67b0383495e1 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:31.796209 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642745af-843b-4595-a41f-2518cb10f32b None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:31.836167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01483db-49ee-4307-8698-67b0383495e1 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:31.841206 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5c20f-0c6c-4ae8-bb80-f72fa8eed09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:31.842046 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5c20f-0c6c-4ae8-bb80-f72fa8eed09e None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:31.842482 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5c20f-0c6c-4ae8-bb80-f72fa8eed09e None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:31.842958 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5c20f-0c6c-4ae8-bb80-f72fa8eed09e None admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:31.843882 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5c20f-0c6c-4ae8-bb80-f72fa8eed09e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:31.844362 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5c20f-0c6c-4ae8-bb80-f72fa8eed09e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:31.846956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5c20f-0c6c-4ae8-bb80-f72fa8eed09e None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:31.869880 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 262/529] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:07:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:31.869880 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5c20f-0c6c-4ae8-bb80-f72fa8eed09e None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:31.878308 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:31.885625 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea7412-9b3e-4b40-afdc-07f18dd1ad0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:31.886299 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea7412-9b3e-4b40-afdc-07f18dd1ad0f None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:31.886579 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea7412-9b3e-4b40-afdc-07f18dd1ad0f None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:31.886896 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea7412-9b3e-4b40-afdc-07f18dd1ad0f None admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:31.887856 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea7412-9b3e-4b40-afdc-07f18dd1ad0f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:31.888164 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea7412-9b3e-4b40-afdc-07f18dd1ad0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:31.889603 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea7412-9b3e-4b40-afdc-07f18dd1ad0f None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:31.913531 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 268/530] 10.222.0.13 () {56 vars in 1139 bytes} [Wed Jun 29 12:07:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:31.913531 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea7412-9b3e-4b40-afdc-07f18dd1ad0f None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:31.913811 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:32.007834 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5c20f-0c6c-4ae8-bb80-f72fa8eed09e None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:32.029961 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea7412-9b3e-4b40-afdc-07f18dd1ad0f None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:32.055915 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9722176-5719-484b-96c5-8b4f7a65df4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:32.056703 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9722176-5719-484b-96c5-8b4f7a65df4d None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:32.056998 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9722176-5719-484b-96c5-8b4f7a65df4d None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:32.057278 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9722176-5719-484b-96c5-8b4f7a65df4d None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:32.058041 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9722176-5719-484b-96c5-8b4f7a65df4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:32.058412 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9722176-5719-484b-96c5-8b4f7a65df4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:32.060398 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9722176-5719-484b-96c5-8b4f7a65df4d None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:32.067435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c93d50-729c-4da3-92ec-b94d55b17116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:32.068094 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c93d50-729c-4da3-92ec-b94d55b17116 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:32.068412 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c93d50-729c-4da3-92ec-b94d55b17116 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:32.068736 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c93d50-729c-4da3-92ec-b94d55b17116 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:32.069800 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c93d50-729c-4da3-92ec-b94d55b17116 None admin] RBAC: Adding query filter params (role.id=0be824a9ecd0492f984e3b3b991e3984, scope.project.id=489877ae137244c5b83291671c703c99, user.id=3fbcf547421b42e4b520f9246326bff8) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:32.070114 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c93d50-729c-4da3-92ec-b94d55b17116 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:32.071586 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c93d50-729c-4da3-92ec-b94d55b17116 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:32.076939 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 263/531] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:32.077985 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9722176-5719-484b-96c5-8b4f7a65df4d None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:32.078726 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 269/532] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:07:31 2022] GET /identity/v3/role_assignments?user.id=3fbcf547421b42e4b520f9246326bff8&scope.project.id=489877ae137244c5b83291671c703c99&role.id=0be824a9ecd0492f984e3b3b991e3984 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:32.084064 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c93d50-729c-4da3-92ec-b94d55b17116 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:32.201293 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:32.259314 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:32.263945 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9722176-5719-484b-96c5-8b4f7a65df4d None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:32.269217 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c93d50-729c-4da3-92ec-b94d55b17116 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:32.302839 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3c77c-0f0f-4f34-969e-a0d9ea09eeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:32.304008 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3c77c-0f0f-4f34-969e-a0d9ea09eeef None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:32.304628 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3c77c-0f0f-4f34-969e-a0d9ea09eeef None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:32.305172 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3c77c-0f0f-4f34-969e-a0d9ea09eeef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:32.338558 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542f110-6ab5-495a-b63d-643806c4b910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:32.339464 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542f110-6ab5-495a-b63d-643806c4b910 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:32.339761 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542f110-6ab5-495a-b63d-643806c4b910 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:32.340072 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542f110-6ab5-495a-b63d-643806c4b910 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:32.355699 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1542f110-6ab5-495a-b63d-643806c4b910 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:32.357322 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1542f110-6ab5-495a-b63d-643806c4b910 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:32.384136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-1542f110-6ab5-495a-b63d-643806c4b910 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:32.384136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:32.384136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:32.384136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:32.384136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:32.384136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:32.384136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:32.384136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:32.384136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:32.384136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:32.384136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:32.384136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:32.384136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:07:32.384136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:07:32.384136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:07:32.385076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:07:32.385076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:32.385076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:32.385076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:32.385076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:32.385076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:32.385076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:32.385076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:32.385076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:32.385076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:32.385076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:32.385076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:32.385076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:32.385076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:32.385076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:32.385076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:32.385076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:32.390748 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:07:32.390748 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:07:32.390748 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:07:32.390748 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:07:32.390748 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:07:32.390748 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:07:32.390748 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:32.390748 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:32.390748 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 270/533] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:07:32.396094 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542f110-6ab5-495a-b63d-643806c4b910 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:32.402703 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3c77c-0f0f-4f34-969e-a0d9ea09eeef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:32.404874 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3c77c-0f0f-4f34-969e-a0d9ea09eeef None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:32.511851 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 264/534] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:32.513966 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f143f3f-7cbd-418b-bb9a-411edd6f4068 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:32.514531 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f143f3f-7cbd-418b-bb9a-411edd6f4068 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:32.514883 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f143f3f-7cbd-418b-bb9a-411edd6f4068 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:32.520786 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 265/535] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:32.520786 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f143f3f-7cbd-418b-bb9a-411edd6f4068 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:32.523240 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:32.562411 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542f110-6ab5-495a-b63d-643806c4b910 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:32.578023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:32.605670 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32373154-e279-4de9-910e-787de96dc8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:32.606429 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32373154-e279-4de9-910e-787de96dc8ac None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:32.606709 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32373154-e279-4de9-910e-787de96dc8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:32.606993 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32373154-e279-4de9-910e-787de96dc8ac None admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:32.607788 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32373154-e279-4de9-910e-787de96dc8ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:32.608099 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32373154-e279-4de9-910e-787de96dc8ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:32.609613 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32373154-e279-4de9-910e-787de96dc8ac None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:32.638163 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f143f3f-7cbd-418b-bb9a-411edd6f4068 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:32.642565 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 271/536] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:07:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:32.644964 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d059970-f5ac-4448-aedf-5a56c240f14a None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:32.645260 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d059970-f5ac-4448-aedf-5a56c240f14a None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:32.645545 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d059970-f5ac-4448-aedf-5a56c240f14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:32.666816 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-1d059970-f5ac-4448-aedf-5a56c240f14a None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:32.668322 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-1d059970-f5ac-4448-aedf-5a56c240f14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:32.685363 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba82c61-2da6-4501-880a-3339b88d2b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:32.686208 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba82c61-2da6-4501-880a-3339b88d2b21 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:32.686522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba82c61-2da6-4501-880a-3339b88d2b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:32.686805 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba82c61-2da6-4501-880a-3339b88d2b21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:32.698631 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba82c61-2da6-4501-880a-3339b88d2b21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:32.700204 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba82c61-2da6-4501-880a-3339b88d2b21 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:32.721121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-2ba82c61-2da6-4501-880a-3339b88d2b21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:32.721121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:32.721121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:32.721121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:32.721121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:32.721121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:32.721121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:32.721121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:32.721121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:32.721121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:32.721121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:32.721121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:32.721121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:32.721121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:32.721121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:32.722038 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:32.722038 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:32.722038 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:32.722038 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:32.722038 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:32.722038 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:32.722038 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:32.722038 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:32.722038 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:32.722038 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:32.722038 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:32.722038 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:32.722038 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:32.722038 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:32.722038 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:32.722038 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:32.722038 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:32.722938 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:32.722938 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:32.722938 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:32.722938 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:32.722938 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 266/537] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:32.723920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba82c61-2da6-4501-880a-3339b88d2b21 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:32.753707 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 272/538] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:32.754547 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d059970-f5ac-4448-aedf-5a56c240f14a None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:32.777702 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:32.833752 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba82c61-2da6-4501-880a-3339b88d2b21 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:32.869392 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311bb29-0032-46c3-9db9-4e526a5fcba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:32.870056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311bb29-0032-46c3-9db9-4e526a5fcba8 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:32.870343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311bb29-0032-46c3-9db9-4e526a5fcba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:32.870620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311bb29-0032-46c3-9db9-4e526a5fcba8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:32.871489 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311bb29-0032-46c3-9db9-4e526a5fcba8 None admin] RBAC: Adding query filter params (role.id=0be824a9ecd0492f984e3b3b991e3984, scope.project.id=489877ae137244c5b83291671c703c99, user.id=4009947e15c347e19da8b4fbddfb2875) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:32.871807 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311bb29-0032-46c3-9db9-4e526a5fcba8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:32.873304 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311bb29-0032-46c3-9db9-4e526a5fcba8 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:32.878521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d059970-f5ac-4448-aedf-5a56c240f14a None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:32.879915 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 267/539] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:07:32 2022] GET /identity/v3/role_assignments?user.id=4009947e15c347e19da8b4fbddfb2875&scope.project.id=489877ae137244c5b83291671c703c99&role.id=0be824a9ecd0492f984e3b3b991e3984 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:32.881347 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311bb29-0032-46c3-9db9-4e526a5fcba8 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:32.899086 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:32.955183 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b2b80-73ef-45ae-b605-d5af975563d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:32.955974 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b2b80-73ef-45ae-b605-d5af975563d3 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:32.956263 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b2b80-73ef-45ae-b605-d5af975563d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:32.956540 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b2b80-73ef-45ae-b605-d5af975563d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:32.957337 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b2b80-73ef-45ae-b605-d5af975563d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:32.957649 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b2b80-73ef-45ae-b605-d5af975563d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:32.959929 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b2b80-73ef-45ae-b605-d5af975563d3 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:32.984597 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 273/540] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:32.987019 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b2b80-73ef-45ae-b605-d5af975563d3 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:32.992428 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311bb29-0032-46c3-9db9-4e526a5fcba8 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:33.003357 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:33.029896 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5121ce0-2e12-4e06-b0d6-f85375c7e17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:33.030756 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5121ce0-2e12-4e06-b0d6-f85375c7e17d None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:33.031117 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5121ce0-2e12-4e06-b0d6-f85375c7e17d None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:33.031465 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5121ce0-2e12-4e06-b0d6-f85375c7e17d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:33.043784 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5121ce0-2e12-4e06-b0d6-f85375c7e17d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:33.051800 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-c5121ce0-2e12-4e06-b0d6-f85375c7e17d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:07:33.051800 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:33.051800 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:33.051800 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:33.051800 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:33.051800 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:33.051800 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:33.051800 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:33.051800 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:33.051800 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:33.051800 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:33.051800 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:33.051800 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:33.051800 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:33.051800 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:33.051800 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:33.054322 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:33.054322 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:33.054322 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:33.054322 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:33.054322 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:33.054322 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:33.054322 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:33.054322 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:33.054322 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:33.054322 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:33.054322 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:33.054322 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:33.054322 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:33.054322 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:33.054322 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:33.054322 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:33.055823 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:33.055823 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:33.055823 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:33.055823 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:33.055823 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:33.055823 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:33.055823 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:33.055823 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:33.055823 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:33.055823 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:33.055823 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:07:33.055823 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:33.055823 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 268/541] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 29 12:07:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:33.064053 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5121ce0-2e12-4e06-b0d6-f85375c7e17d None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:33.169451 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b2b80-73ef-45ae-b605-d5af975563d3 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:33.218312 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a35b3e-77f0-4d2f-99d1-e86f8e011da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:33.219404 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a35b3e-77f0-4d2f-99d1-e86f8e011da1 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:33.219691 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a35b3e-77f0-4d2f-99d1-e86f8e011da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:33.219969 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a35b3e-77f0-4d2f-99d1-e86f8e011da1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:33.229210 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a35b3e-77f0-4d2f-99d1-e86f8e011da1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:33.231245 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a35b3e-77f0-4d2f-99d1-e86f8e011da1 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:33.238046 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5121ce0-2e12-4e06-b0d6-f85375c7e17d None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:33.248850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-52a35b3e-77f0-4d2f-99d1-e86f8e011da1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:33.248850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:33.248850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:33.248850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:33.248850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:33.248850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:33.248850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:33.248850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:33.248850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:33.248850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:33.248850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:33.248850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:33.248850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:07:33.248850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:07:33.248850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:07:33.249927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:07:33.249927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:33.249927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:33.249927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:33.249927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:33.249927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:33.249927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:33.249927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:33.249927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:33.249927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:33.249927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:33.249927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:33.249927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:33.249927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:33.249927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:33.249927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:33.249927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:33.250861 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:07:33.250861 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:07:33.250861 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:07:33.250861 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:07:33.250861 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:07:33.250861 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:07:33.250861 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:33.250861 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:33.250861 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 274/542] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:07:33.257972 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a35b3e-77f0-4d2f-99d1-e86f8e011da1 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:33.307092 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:33.307386 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94867ef6-6786-4a5c-938b-dcc8e78b48aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:33.307804 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94867ef6-6786-4a5c-938b-dcc8e78b48aa None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:33.308090 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94867ef6-6786-4a5c-938b-dcc8e78b48aa None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:33.308372 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94867ef6-6786-4a5c-938b-dcc8e78b48aa None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:33.309124 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94867ef6-6786-4a5c-938b-dcc8e78b48aa None admin] RBAC: Adding query filter params (name=service) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:33.309553 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94867ef6-6786-4a5c-938b-dcc8e78b48aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:33.311174 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94867ef6-6786-4a5c-938b-dcc8e78b48aa None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:33.334307 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 269/543] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 29 12:07:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:33.340648 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94867ef6-6786-4a5c-938b-dcc8e78b48aa None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:33.402135 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:33.462484 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a35b3e-77f0-4d2f-99d1-e86f8e011da1 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:33.476980 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94867ef6-6786-4a5c-938b-dcc8e78b48aa None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:33.514606 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ca192-646d-47ae-a833-7d4d2b1d22da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:33.515449 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ca192-646d-47ae-a833-7d4d2b1d22da None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:33.515738 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ca192-646d-47ae-a833-7d4d2b1d22da None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:33.516022 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ca192-646d-47ae-a833-7d4d2b1d22da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:33.538006 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ca192-646d-47ae-a833-7d4d2b1d22da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:33.539197 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07523ebb-cfe6-4621-abdc-25c61f10367d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:33.539539 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ca192-646d-47ae-a833-7d4d2b1d22da None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:33.540489 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07523ebb-cfe6-4621-abdc-25c61f10367d None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:33.540964 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07523ebb-cfe6-4621-abdc-25c61f10367d None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:33.541433 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07523ebb-cfe6-4621-abdc-25c61f10367d None admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:33.542435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07523ebb-cfe6-4621-abdc-25c61f10367d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:33.542968 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07523ebb-cfe6-4621-abdc-25c61f10367d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:33.550658 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07523ebb-cfe6-4621-abdc-25c61f10367d None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:33.557723 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-086ca192-646d-47ae-a833-7d4d2b1d22da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:33.557723 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:33.557723 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:33.557723 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:33.557723 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:33.557723 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:33.557723 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:33.557723 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:33.557723 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:33.557723 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:33.557723 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:33.557723 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:33.557723 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:33.557723 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:33.557723 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:33.558561 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:33.558561 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:33.558561 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:33.558561 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:33.558561 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:33.558561 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:33.558561 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:33.558561 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:33.558561 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:33.558561 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:33.558561 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:33.558561 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:33.558561 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:33.558561 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:33.558561 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:33.558561 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:33.558561 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:33.559430 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:33.559430 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:33.559430 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:33.559430 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:33.559430 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 270/544] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:07:33.569024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ca192-646d-47ae-a833-7d4d2b1d22da None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:33.570694 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 275/545] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:07:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:33.582513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07523ebb-cfe6-4621-abdc-25c61f10367d None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:33.665882 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:33.682672 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ca192-646d-47ae-a833-7d4d2b1d22da None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:33.722872 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5b066-b6cb-49de-8973-8ddea3aa126a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:33.723554 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5b066-b6cb-49de-8973-8ddea3aa126a None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:33.723840 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5b066-b6cb-49de-8973-8ddea3aa126a None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:33.724121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5b066-b6cb-49de-8973-8ddea3aa126a None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:33.724911 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e5b066-b6cb-49de-8973-8ddea3aa126a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:33.725250 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e5b066-b6cb-49de-8973-8ddea3aa126a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:33.726628 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e5b066-b6cb-49de-8973-8ddea3aa126a None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:33.753058 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 271/546] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:33.759717 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5b066-b6cb-49de-8973-8ddea3aa126a None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:33.766985 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:33.800606 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07523ebb-cfe6-4621-abdc-25c61f10367d None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:33.858146 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f165c-b1b0-460d-ad86-703d2e5bd54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:33.858747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f165c-b1b0-460d-ad86-703d2e5bd54b None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:33.859032 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f165c-b1b0-460d-ad86-703d2e5bd54b None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:33.859304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f165c-b1b0-460d-ad86-703d2e5bd54b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:33.860132 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f165c-b1b0-460d-ad86-703d2e5bd54b None admin] RBAC: Adding query filter params (role.id=0be824a9ecd0492f984e3b3b991e3984, scope.project.id=489877ae137244c5b83291671c703c99, user.id=50f5cc247f6b445f81fc3715d7bce92d) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:33.860446 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f165c-b1b0-460d-ad86-703d2e5bd54b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:33.861887 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f165c-b1b0-460d-ad86-703d2e5bd54b None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:33.872099 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 276/547] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:07:33 2022] GET /identity/v3/role_assignments?user.id=50f5cc247f6b445f81fc3715d7bce92d&scope.project.id=489877ae137244c5b83291671c703c99&role.id=0be824a9ecd0492f984e3b3b991e3984 => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:33.945021 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5b066-b6cb-49de-8973-8ddea3aa126a None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:33.949678 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af262b4-15dd-4472-a38a-9b5bcd1fa992 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:33.949967 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af262b4-15dd-4472-a38a-9b5bcd1fa992 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:33.950248 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af262b4-15dd-4472-a38a-9b5bcd1fa992 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:33.951760 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 277/548] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:33.964764 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c9ea6-24b1-4287-8abd-4b83439b90b0 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:33.965069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c9ea6-24b1-4287-8abd-4b83439b90b0 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:33.965306 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c9ea6-24b1-4287-8abd-4b83439b90b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:33.989032 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-a81c9ea6-24b1-4287-8abd-4b83439b90b0 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:33.992481 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-a81c9ea6-24b1-4287-8abd-4b83439b90b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:34.027276 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb07f3d-0203-46d3-b7de-7c3774564df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:34.028105 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb07f3d-0203-46d3-b7de-7c3774564df4 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:34.028388 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb07f3d-0203-46d3-b7de-7c3774564df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:34.028664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb07f3d-0203-46d3-b7de-7c3774564df4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:34.046813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb07f3d-0203-46d3-b7de-7c3774564df4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:34.048399 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb07f3d-0203-46d3-b7de-7c3774564df4 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:34.067006 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-cbb07f3d-0203-46d3-b7de-7c3774564df4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 12:07:34.067006 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:34.067006 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:34.067006 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:34.067006 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:34.067006 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:34.067006 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:34.067006 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:34.067006 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:34.067006 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:34.067006 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:34.067006 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:34.067006 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:07:34.067006 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:07:34.067006 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:07:34.067006 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:07:34.070200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:34.070200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:34.070200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:07:34.070200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:34.070200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:07:34.070200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:34.070200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:34.070200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:34.070200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:34.070200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:34.070200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:34.070200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:34.070200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:34.070200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:34.070200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:34.070200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:34.070200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:34.070200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:34.072567 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:34.072567 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:34.072567 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:07:34.072567 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:07:34.072567 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:07:34.072567 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:07:34.072567 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:07:34.072567 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:07:34.072567 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 12:07:34.072567 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:34.072567 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 272/549] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:07:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:34.078931 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb07f3d-0203-46d3-b7de-7c3774564df4 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:34.088576 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:34.138268 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 278/550] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:07:34.160136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c9ea6-24b1-4287-8abd-4b83439b90b0 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:34.249740 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb07f3d-0203-46d3-b7de-7c3774564df4 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:34.292376 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a952708-dc77-4ef2-9609-508d4b1a5223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:34.293071 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a952708-dc77-4ef2-9609-508d4b1a5223 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:34.293357 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a952708-dc77-4ef2-9609-508d4b1a5223 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:34.293635 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a952708-dc77-4ef2-9609-508d4b1a5223 None admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:34.294481 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a952708-dc77-4ef2-9609-508d4b1a5223 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:34.294823 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a952708-dc77-4ef2-9609-508d4b1a5223 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:34.303183 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a952708-dc77-4ef2-9609-508d4b1a5223 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:34.307834 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:34.338340 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 273/551] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Jun 29 12:07:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:34.341197 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c9ea6-24b1-4287-8abd-4b83439b90b0 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:34.344381 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a952708-dc77-4ef2-9609-508d4b1a5223 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:34.387199 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7933f17-29c4-4d45-9ff2-7b31d113145e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:34.388587 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7933f17-29c4-4d45-9ff2-7b31d113145e None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:34.390305 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7933f17-29c4-4d45-9ff2-7b31d113145e None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:34.391589 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7933f17-29c4-4d45-9ff2-7b31d113145e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:34.410894 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7933f17-29c4-4d45-9ff2-7b31d113145e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:34.420794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-c7933f17-29c4-4d45-9ff2-7b31d113145e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:07:34.420794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:34.420794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:34.420794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:34.420794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:34.420794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:34.420794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:34.420794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:34.420794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:34.420794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:34.420794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:34.420794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:34.420794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:34.420794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:34.420794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:34.420794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:34.421784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:34.421784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:34.421784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:34.421784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:34.421784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:34.421784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:34.421784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:34.421784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:34.421784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:34.421784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:34.421784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:34.421784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:34.421784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:34.421784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:34.421784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:34.421784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:34.422725 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:34.422725 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:34.422725 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:34.422725 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:34.422725 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:34.422725 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:34.422725 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:34.422725 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:34.422725 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:34.422725 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:34.422725 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:07:34.422725 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:34.435501 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 279/552] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 29 12:07:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:07:34.443191 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7933f17-29c4-4d45-9ff2-7b31d113145e None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:34.479018 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:34.551975 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a952708-dc77-4ef2-9609-508d4b1a5223 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:34.615566 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714cd8f-bd3f-4074-a72d-90619224ceef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:34.616734 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714cd8f-bd3f-4074-a72d-90619224ceef None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:34.617286 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714cd8f-bd3f-4074-a72d-90619224ceef None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:34.617573 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714cd8f-bd3f-4074-a72d-90619224ceef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:34.619108 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7933f17-29c4-4d45-9ff2-7b31d113145e None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:34.661216 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7a469-520f-49dd-9afb-e3974ab0fb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:34.662748 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7a469-520f-49dd-9afb-e3974ab0fb15 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:34.663043 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7a469-520f-49dd-9afb-e3974ab0fb15 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:34.663316 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7a469-520f-49dd-9afb-e3974ab0fb15 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:34.664105 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7a469-520f-49dd-9afb-e3974ab0fb15 None admin] RBAC: Adding query filter params (name=service) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:34.664467 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7a469-520f-49dd-9afb-e3974ab0fb15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:34.665981 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7a469-520f-49dd-9afb-e3974ab0fb15 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:34.672421 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:34.676250 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 280/553] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 29 12:07:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:34.682166 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc038f-c696-4d58-b4c5-edbd1e76c50d None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:34.682685 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc038f-c696-4d58-b4c5-edbd1e76c50d None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:34.683140 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc038f-c696-4d58-b4c5-edbd1e76c50d None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:34.684957 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 281/554] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:34.685787 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc038f-c696-4d58-b4c5-edbd1e76c50d None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:34.703270 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714cd8f-bd3f-4074-a72d-90619224ceef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:34.705472 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714cd8f-bd3f-4074-a72d-90619224ceef None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:34.788099 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:34.802880 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc038f-c696-4d58-b4c5-edbd1e76c50d None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:34.831340 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 274/555] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 12:07:34.832776 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d40f01-6481-4e8c-86e1-9d66296f5d31 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:34.833071 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d40f01-6481-4e8c-86e1-9d66296f5d31 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:34.833356 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d40f01-6481-4e8c-86e1-9d66296f5d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:34.840974 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f86d05-81fe-4553-97af-5435e433b69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:34.841772 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f86d05-81fe-4553-97af-5435e433b69b None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:34.842054 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f86d05-81fe-4553-97af-5435e433b69b None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:34.842332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f86d05-81fe-4553-97af-5435e433b69b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:34.851816 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-73d40f01-6481-4e8c-86e1-9d66296f5d31 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:34.853079 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-73d40f01-6481-4e8c-86e1-9d66296f5d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:34.853363 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f86d05-81fe-4553-97af-5435e433b69b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:34.854863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f86d05-81fe-4553-97af-5435e433b69b None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:34.872809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-98f86d05-81fe-4553-97af-5435e433b69b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:34.872809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:34.872809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:34.872809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:34.872809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:34.872809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:34.872809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:34.872809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:34.872809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:34.872809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:34.872809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:34.872809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:34.872809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:34.872809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:34.872809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:34.874900 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:34.874900 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:34.874900 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:34.874900 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:34.874900 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:34.874900 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:34.874900 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:34.874900 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:34.874900 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:34.874900 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:34.874900 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:34.874900 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:34.874900 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:34.874900 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:34.874900 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:34.874900 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:34.874900 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:34.877138 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:34.877138 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:34.877138 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:34.877138 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:34.877138 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 282/556] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:34.877138 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f86d05-81fe-4553-97af-5435e433b69b None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:34.929524 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:34.934465 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 275/557] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:34.935367 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d40f01-6481-4e8c-86e1-9d66296f5d31 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:34.978884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f86d05-81fe-4553-97af-5435e433b69b None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:35.013427 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eca669-ebde-41a0-8dc6-cd8a725342cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:35.014339 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eca669-ebde-41a0-8dc6-cd8a725342cc None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:35.014716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eca669-ebde-41a0-8dc6-cd8a725342cc None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:35.015063 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eca669-ebde-41a0-8dc6-cd8a725342cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:35.026458 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eca669-ebde-41a0-8dc6-cd8a725342cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:35.028043 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eca669-ebde-41a0-8dc6-cd8a725342cc None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:35.037723 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:35.045704 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-28eca669-ebde-41a0-8dc6-cd8a725342cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:35.045704 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:35.045704 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:35.045704 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:35.045704 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:35.045704 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:35.045704 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:35.045704 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:35.045704 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:35.045704 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:35.045704 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:35.045704 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:35.045704 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:35.045704 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:35.045704 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:35.048248 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:35.048248 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:35.048248 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:35.048248 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:35.048248 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:35.048248 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:35.048248 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:35.048248 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:35.048248 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:35.048248 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:35.048248 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:35.048248 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:35.048248 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:35.048248 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:35.048248 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:35.048248 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:35.048248 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:35.050535 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:35.050535 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:35.050535 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:35.050535 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:35.051084 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d40f01-6481-4e8c-86e1-9d66296f5d31 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:35.051231 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 283/558] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:35.051231 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eca669-ebde-41a0-8dc6-cd8a725342cc None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:35.087615 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b6787-d54c-42d1-a865-e22a2d99d956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:35.088300 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b6787-d54c-42d1-a865-e22a2d99d956 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:35.088634 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b6787-d54c-42d1-a865-e22a2d99d956 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:35.088921 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b6787-d54c-42d1-a865-e22a2d99d956 None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:35.089712 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b6787-d54c-42d1-a865-e22a2d99d956 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:35.090130 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b6787-d54c-42d1-a865-e22a2d99d956 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:35.091573 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b6787-d54c-42d1-a865-e22a2d99d956 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:35.109744 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 276/559] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:35.110670 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b6787-d54c-42d1-a865-e22a2d99d956 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:35.153262 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eca669-ebde-41a0-8dc6-cd8a725342cc None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:35.156045 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:35.189948 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566813e5-6d0a-4099-8579-eeef704fc5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:35.190707 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566813e5-6d0a-4099-8579-eeef704fc5e3 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:35.190999 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566813e5-6d0a-4099-8579-eeef704fc5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:35.191271 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566813e5-6d0a-4099-8579-eeef704fc5e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:35.202234 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566813e5-6d0a-4099-8579-eeef704fc5e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:35.211513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-566813e5-6d0a-4099-8579-eeef704fc5e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:07:35.211513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:35.211513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:35.211513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:35.211513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:35.211513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:35.211513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:35.211513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:35.211513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:35.211513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:35.211513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:35.211513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:35.211513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:35.211513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:35.211513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:35.211513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:35.213774 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:35.213774 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:35.213774 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:35.213774 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:35.213774 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:35.213774 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:35.213774 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:35.213774 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:35.213774 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:35.213774 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:35.213774 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:35.213774 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:35.213774 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:35.213774 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:35.213774 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:35.213774 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:35.215958 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:35.215958 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:35.215958 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:35.215958 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:35.215958 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:35.215958 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:35.215958 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:35.215958 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:35.215958 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:35.215958 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:35.215958 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:07:35.215958 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:35.215958 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 284/560] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 29 12:07:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:35.215958 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566813e5-6d0a-4099-8579-eeef704fc5e3 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:35.234536 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b6787-d54c-42d1-a865-e22a2d99d956 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:35.273418 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673df9a-8875-44df-9ca4-c047f12aa16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:35.274098 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673df9a-8875-44df-9ca4-c047f12aa16f None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:35.274484 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673df9a-8875-44df-9ca4-c047f12aa16f None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:35.274801 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673df9a-8875-44df-9ca4-c047f12aa16f None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:35.275633 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673df9a-8875-44df-9ca4-c047f12aa16f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:35.275946 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673df9a-8875-44df-9ca4-c047f12aa16f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:35.277427 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673df9a-8875-44df-9ca4-c047f12aa16f None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:35.291589 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 277/561] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:35.292520 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673df9a-8875-44df-9ca4-c047f12aa16f None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:35.309264 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:35.320928 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566813e5-6d0a-4099-8579-eeef704fc5e3 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:35.357113 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f054731-0539-4be0-9d39-9980af626802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:35.358157 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f054731-0539-4be0-9d39-9980af626802 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:35.358442 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f054731-0539-4be0-9d39-9980af626802 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:35.358775 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f054731-0539-4be0-9d39-9980af626802 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:35.368616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f054731-0539-4be0-9d39-9980af626802 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:35.370072 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f054731-0539-4be0-9d39-9980af626802 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:35.388520 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-1f054731-0539-4be0-9d39-9980af626802 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 29 12:07:35.388520 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:35.388520 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:35.388520 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:35.388520 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:35.388520 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:35.388520 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:35.388520 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:35.388520 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:35.388520 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:35.388520 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:35.388520 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:35.388520 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:07:35.388520 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:07:35.388520 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:07:35.388520 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:07:35.390577 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:35.390577 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:35.390577 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:07:35.390577 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:35.390577 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:07:35.390577 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:35.390577 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:35.390577 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:35.390577 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:35.390577 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:35.390577 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:35.390577 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:35.390577 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:35.390577 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:35.390577 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:35.390577 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:35.390577 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:35.390577 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:35.392564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:35.392564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:35.392564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:07:35.392564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:07:35.392564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:07:35.392564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:07:35.392564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:07:35.392564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:07:35.392564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 29 12:07:35.392564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:35.392564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 285/562] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:35.392564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f054731-0539-4be0-9d39-9980af626802 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:35.402422 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673df9a-8875-44df-9ca4-c047f12aa16f None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:35.420624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:35.439054 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af23160-2066-47a6-b7df-aa2f553203c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:35.439735 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af23160-2066-47a6-b7df-aa2f553203c6 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:35.440078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af23160-2066-47a6-b7df-aa2f553203c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:35.440312 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af23160-2066-47a6-b7df-aa2f553203c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:35.441059 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af23160-2066-47a6-b7df-aa2f553203c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:35.441372 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af23160-2066-47a6-b7df-aa2f553203c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:35.442783 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af23160-2066-47a6-b7df-aa2f553203c6 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:35.452167 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 278/563] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 29 12:07:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:35.453572 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcb90a-d94b-4c68-846a-9611c1229f61 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:35.453864 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcb90a-d94b-4c68-846a-9611c1229f61 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:35.454146 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcb90a-d94b-4c68-846a-9611c1229f61 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:35.459624 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 279/564] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:35.459624 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dcb90a-d94b-4c68-846a-9611c1229f61 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:35.522822 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f054731-0539-4be0-9d39-9980af626802 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:35.538016 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:35.561647 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745161d5-a100-4507-ba57-9c325543e18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:35.562400 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745161d5-a100-4507-ba57-9c325543e18b None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:35.562711 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745161d5-a100-4507-ba57-9c325543e18b None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:35.563178 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745161d5-a100-4507-ba57-9c325543e18b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:35.566658 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dcb90a-d94b-4c68-846a-9611c1229f61 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:35.571727 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745161d5-a100-4507-ba57-9c325543e18b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:35.573207 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745161d5-a100-4507-ba57-9c325543e18b None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:35.587573 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-745161d5-a100-4507-ba57-9c325543e18b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:35.587573 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:35.587573 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:35.587573 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:35.587573 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:35.587573 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:35.587573 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:35.587573 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:35.587573 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:35.587573 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:35.587573 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:35.587573 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:35.587573 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:07:35.587573 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:07:35.587573 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:07:35.588497 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:07:35.588497 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:35.588497 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:35.588497 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:35.588497 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:35.588497 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:35.588497 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:35.588497 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:35.588497 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:35.588497 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:35.588497 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:35.588497 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:35.588497 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:35.588497 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:35.588497 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:35.588497 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:35.588497 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:35.589384 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:07:35.589384 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:07:35.589384 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:07:35.589384 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:07:35.589384 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:07:35.589384 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:07:35.589384 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:35.589384 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:35.589384 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 286/565] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:35.590481 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745161d5-a100-4507-ba57-9c325543e18b None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:35.612215 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ebc65-c753-4e37-b45f-b9e8f59fc054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:35.612898 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ebc65-c753-4e37-b45f-b9e8f59fc054 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:35.613187 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ebc65-c753-4e37-b45f-b9e8f59fc054 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:35.613562 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ebc65-c753-4e37-b45f-b9e8f59fc054 None admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:35.614405 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ebc65-c753-4e37-b45f-b9e8f59fc054 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:35.614750 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ebc65-c753-4e37-b45f-b9e8f59fc054 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:35.616688 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ebc65-c753-4e37-b45f-b9e8f59fc054 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:35.635673 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 280/566] 10.222.0.13 () {56 vars in 1137 bytes} [Wed Jun 29 12:07:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:35.637194 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e31ee-3faf-416c-96aa-157cf3cce44d None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:35.637493 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e31ee-3faf-416c-96aa-157cf3cce44d None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:35.637772 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e31ee-3faf-416c-96aa-157cf3cce44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:35.654056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-498e31ee-3faf-416c-96aa-157cf3cce44d None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:35.655406 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-498e31ee-3faf-416c-96aa-157cf3cce44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:35.687953 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:35.707886 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745161d5-a100-4507-ba57-9c325543e18b None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:35.727729 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 281/567] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:35.728881 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e31ee-3faf-416c-96aa-157cf3cce44d None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:35.759743 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee25e9-5e62-4703-97f4-5d6c96d8747b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:35.760824 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee25e9-5e62-4703-97f4-5d6c96d8747b None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:35.761115 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee25e9-5e62-4703-97f4-5d6c96d8747b None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:35.761393 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee25e9-5e62-4703-97f4-5d6c96d8747b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:35.772236 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee25e9-5e62-4703-97f4-5d6c96d8747b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:35.773708 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee25e9-5e62-4703-97f4-5d6c96d8747b None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:35.792494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-ffee25e9-5e62-4703-97f4-5d6c96d8747b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:35.792494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:35.792494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:35.792494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:35.792494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:35.792494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:35.792494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:35.792494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:35.792494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:35.792494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:35.792494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:35.792494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:35.792494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:35.792494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:35.792494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:35.793438 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:35.793438 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:35.793438 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:35.793438 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:35.793438 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:35.793438 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:35.793438 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:35.793438 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:35.793438 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:35.793438 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:35.793438 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:35.793438 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:35.793438 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:35.793438 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:35.793438 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:35.793438 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:35.793438 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:35.794338 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:35.794338 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:35.794338 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:35.794338 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:35.794338 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 287/568] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:35.794624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee25e9-5e62-4703-97f4-5d6c96d8747b None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:35.801812 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:35.846345 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e31ee-3faf-416c-96aa-157cf3cce44d None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:35.885219 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8794ea-ae89-46f1-bf4c-6a8fd2dad6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:35.885903 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8794ea-ae89-46f1-bf4c-6a8fd2dad6e6 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:35.886203 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8794ea-ae89-46f1-bf4c-6a8fd2dad6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:35.886472 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8794ea-ae89-46f1-bf4c-6a8fd2dad6e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:35.887286 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8794ea-ae89-46f1-bf4c-6a8fd2dad6e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:35.889318 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8794ea-ae89-46f1-bf4c-6a8fd2dad6e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:35.890825 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8794ea-ae89-46f1-bf4c-6a8fd2dad6e6 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:35.903593 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 282/569] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:07:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:35.904228 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8794ea-ae89-46f1-bf4c-6a8fd2dad6e6 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:35.915383 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee25e9-5e62-4703-97f4-5d6c96d8747b None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:35.951192 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddbeade-7262-463b-a049-acd68d24c4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:35.951985 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbeade-7262-463b-a049-acd68d24c4ec None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:35.952269 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbeade-7262-463b-a049-acd68d24c4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:35.952553 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbeade-7262-463b-a049-acd68d24c4ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:35.955327 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:35.965093 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddbeade-7262-463b-a049-acd68d24c4ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:35.966875 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddbeade-7262-463b-a049-acd68d24c4ec None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:35.985388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-dddbeade-7262-463b-a049-acd68d24c4ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:35.985388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:35.985388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:35.985388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:35.985388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:35.985388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:35.985388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:35.985388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:35.985388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:35.985388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:35.985388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:35.985388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:35.985388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:35.985388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:35.985388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:35.986332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:35.986332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:35.986332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:35.986332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:35.986332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:35.986332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:35.986332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:35.986332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:35.986332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:35.986332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:35.986332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:35.986332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:35.986332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:35.986332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:35.986332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:35.986332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:35.986332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:35.987251 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:35.987251 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:35.987251 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:35.987251 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:35.989288 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 288/570] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:35.990154 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddbeade-7262-463b-a049-acd68d24c4ec None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:36.022908 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8794ea-ae89-46f1-bf4c-6a8fd2dad6e6 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:36.046820 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:36.060858 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14becbc6-028b-401d-a1ba-6f09a97d610f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:36.061660 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14becbc6-028b-401d-a1ba-6f09a97d610f None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:36.061944 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14becbc6-028b-401d-a1ba-6f09a97d610f None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:36.062223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14becbc6-028b-401d-a1ba-6f09a97d610f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:36.072877 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14becbc6-028b-401d-a1ba-6f09a97d610f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:36.080630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-14becbc6-028b-401d-a1ba-6f09a97d610f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:07:36.080630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:36.080630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:36.080630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:36.080630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:36.080630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:36.080630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:36.080630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:36.080630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:36.080630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:36.080630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:36.080630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:36.080630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:36.080630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:36.080630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:36.080630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:36.081676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:36.081676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:36.081676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:36.081676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:36.081676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:36.081676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:36.081676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:36.081676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:36.081676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:36.081676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:36.081676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:36.081676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:36.081676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:36.081676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:36.081676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:36.081676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:36.082516 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:36.082516 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:36.082516 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:36.082516 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:36.082516 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:36.082516 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:36.082516 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:36.082516 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:36.082516 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:36.082516 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:36.082516 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:07:36.082516 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:36.082516 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 283/571] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 29 12:07:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:36.083914 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14becbc6-028b-401d-a1ba-6f09a97d610f None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:36.108467 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddbeade-7262-463b-a049-acd68d24c4ec None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:36.142910 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb861d6a-7a83-46e2-bbc2-5d54aa710f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:36.143563 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb861d6a-7a83-46e2-bbc2-5d54aa710f10 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:36.143845 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb861d6a-7a83-46e2-bbc2-5d54aa710f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:36.144115 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb861d6a-7a83-46e2-bbc2-5d54aa710f10 None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:36.144822 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb861d6a-7a83-46e2-bbc2-5d54aa710f10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:36.145127 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb861d6a-7a83-46e2-bbc2-5d54aa710f10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:36.146512 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb861d6a-7a83-46e2-bbc2-5d54aa710f10 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:36.157931 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 289/572] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:36.158748 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb861d6a-7a83-46e2-bbc2-5d54aa710f10 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:36.185973 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14becbc6-028b-401d-a1ba-6f09a97d610f None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:36.211060 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:36.220224 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca447a74-e431-4f8e-8ffa-a86b83af7cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:36.220811 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca447a74-e431-4f8e-8ffa-a86b83af7cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:36.221092 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca447a74-e431-4f8e-8ffa-a86b83af7cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:36.221373 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca447a74-e431-4f8e-8ffa-a86b83af7cc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:36.222202 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca447a74-e431-4f8e-8ffa-a86b83af7cc3 None admin] RBAC: Adding query filter params (role.id=0be824a9ecd0492f984e3b3b991e3984, scope.project.id=489877ae137244c5b83291671c703c99, user.id=11efdbeeaa5c428aa344f7f0f5b061ba) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:36.222517 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca447a74-e431-4f8e-8ffa-a86b83af7cc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:36.223989 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca447a74-e431-4f8e-8ffa-a86b83af7cc3 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:36.230696 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 284/573] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:07:36 2022] GET /identity/v3/role_assignments?user.id=11efdbeeaa5c428aa344f7f0f5b061ba&scope.project.id=489877ae137244c5b83291671c703c99&role.id=0be824a9ecd0492f984e3b3b991e3984 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:36.231481 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca447a74-e431-4f8e-8ffa-a86b83af7cc3 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:36.267630 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb861d6a-7a83-46e2-bbc2-5d54aa710f10 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:36.291391 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:36.311129 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feeb1b5-057a-44f2-8aba-1e692fc41cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:36.311815 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feeb1b5-057a-44f2-8aba-1e692fc41cce None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:36.312099 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feeb1b5-057a-44f2-8aba-1e692fc41cce None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:36.312380 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feeb1b5-057a-44f2-8aba-1e692fc41cce None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:36.313148 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feeb1b5-057a-44f2-8aba-1e692fc41cce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:36.313428 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feeb1b5-057a-44f2-8aba-1e692fc41cce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:36.314977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feeb1b5-057a-44f2-8aba-1e692fc41cce None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:36.329349 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 290/574] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:36.330927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93019271-a36c-40dc-88c1-852a74a84235 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:36.331218 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93019271-a36c-40dc-88c1-852a74a84235 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:36.331496 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93019271-a36c-40dc-88c1-852a74a84235 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:36.334763 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 291/575] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:36.334763 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93019271-a36c-40dc-88c1-852a74a84235 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:36.356262 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca447a74-e431-4f8e-8ffa-a86b83af7cc3 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:36.396119 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff03b73-e2e7-4fb9-bd46-e8121a1a8456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:36.396812 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff03b73-e2e7-4fb9-bd46-e8121a1a8456 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:36.397106 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff03b73-e2e7-4fb9-bd46-e8121a1a8456 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:36.397389 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff03b73-e2e7-4fb9-bd46-e8121a1a8456 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:36.398164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff03b73-e2e7-4fb9-bd46-e8121a1a8456 None admin] RBAC: Adding query filter params (name=service) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:36.398458 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff03b73-e2e7-4fb9-bd46-e8121a1a8456 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:36.399874 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff03b73-e2e7-4fb9-bd46-e8121a1a8456 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:36.408212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 285/576] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 29 12:07:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:36.409009 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff03b73-e2e7-4fb9-bd46-e8121a1a8456 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:36.454725 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93019271-a36c-40dc-88c1-852a74a84235 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:36.464183 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:36.491253 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510b4d8-e640-4a6b-a8f1-0754681ebada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:36.491960 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510b4d8-e640-4a6b-a8f1-0754681ebada None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:36.492241 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510b4d8-e640-4a6b-a8f1-0754681ebada None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:36.492516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510b4d8-e640-4a6b-a8f1-0754681ebada None admin] PATH_INFO: `/v3/users/nova` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:36.499743 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510b4d8-e640-4a6b-a8f1-0754681ebada None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:36.501203 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510b4d8-e640-4a6b-a8f1-0754681ebada None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:36.516346 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-7510b4d8-e640-4a6b-a8f1-0754681ebada None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:07:36.516346 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:36.516346 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:36.516346 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:36.516346 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:36.516346 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:36.516346 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:36.516346 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:36.516346 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:36.516346 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:36.516346 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:36.516346 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:36.516346 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:07:36.516346 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:07:36.516346 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:07:36.516346 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:07:36.517312 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:36.517312 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:36.517312 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:07:36.517312 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:36.517312 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:07:36.517312 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:36.517312 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:36.517312 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:36.517312 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:36.517312 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:36.517312 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:36.517312 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:36.517312 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:36.517312 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:36.517312 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:36.517312 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:36.517312 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:36.517312 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:36.523493 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:36.523493 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:36.523493 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:07:36.523493 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:07:36.523493 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:07:36.523493 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:07:36.523493 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:07:36.523493 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:07:36.523493 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:07:36.523493 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:36.524031 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff03b73-e2e7-4fb9-bd46-e8121a1a8456 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:36.524105 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 292/577] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Jun 29 12:07:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:36.524105 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a2ee1-5154-478a-ba3d-82c9d3c97f1a None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:36.524105 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a2ee1-5154-478a-ba3d-82c9d3c97f1a None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:36.524105 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a2ee1-5154-478a-ba3d-82c9d3c97f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:36.533809 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:36.537226 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-151a2ee1-5154-478a-ba3d-82c9d3c97f1a None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:36.538529 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-151a2ee1-5154-478a-ba3d-82c9d3c97f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:36.564506 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e9cca-9fba-4498-9a39-ed48dbd2759d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:36.565319 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e9cca-9fba-4498-9a39-ed48dbd2759d None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:36.565627 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e9cca-9fba-4498-9a39-ed48dbd2759d None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:36.565879 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e9cca-9fba-4498-9a39-ed48dbd2759d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:36.573086 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e9cca-9fba-4498-9a39-ed48dbd2759d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:36.574631 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e9cca-9fba-4498-9a39-ed48dbd2759d None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:36.589076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-ef2e9cca-9fba-4498-9a39-ed48dbd2759d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:36.589076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:36.589076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:36.589076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:36.589076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:36.589076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:36.589076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:36.589076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:36.589076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:36.589076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:36.589076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:36.589076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:36.589076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:07:36.589076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:07:36.589076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:07:36.590004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:07:36.590004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:36.590004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:36.590004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:36.590004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:36.590004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:36.590004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:36.590004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:36.590004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:36.590004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:36.590004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:36.590004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:36.590004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:36.590004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:36.590004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:36.590004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:36.590004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:36.590920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:07:36.590920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:07:36.590920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:07:36.590920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:07:36.590920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:07:36.590920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:07:36.590920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:36.590920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:36.590920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 286/578] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:36.592194 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e9cca-9fba-4498-9a39-ed48dbd2759d None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:36.611798 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 293/579] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:36.619652 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a2ee1-5154-478a-ba3d-82c9d3c97f1a None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:36.707163 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e9cca-9fba-4498-9a39-ed48dbd2759d None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:36.735766 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:36.740828 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a2ee1-5154-478a-ba3d-82c9d3c97f1a None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:36.746282 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a8cda-e74f-4eeb-b7b8-248820bd54f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:36.747062 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a8cda-e74f-4eeb-b7b8-248820bd54f4 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:36.747346 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a8cda-e74f-4eeb-b7b8-248820bd54f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:36.747617 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a8cda-e74f-4eeb-b7b8-248820bd54f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:36.757921 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a8cda-e74f-4eeb-b7b8-248820bd54f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:36.759547 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a8cda-e74f-4eeb-b7b8-248820bd54f4 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:36.778777 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-a42a8cda-e74f-4eeb-b7b8-248820bd54f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:36.778777 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:36.778777 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:36.778777 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:36.778777 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:36.778777 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:36.778777 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:36.778777 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:36.778777 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:36.778777 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:36.778777 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:36.778777 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:36.778777 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:36.778777 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:36.778777 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:36.779689 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:36.779689 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:36.779689 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:36.779689 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:36.779689 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:36.779689 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:36.779689 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:36.779689 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:36.779689 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:36.779689 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:36.779689 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:36.779689 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:36.779689 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:36.779689 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:36.779689 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:36.779689 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:36.779689 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:36.785628 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:36.785628 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:36.785628 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:36.785628 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:36.785921 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb72e6d-f069-47ac-b6e2-7e86bbcecf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:36.785921 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb72e6d-f069-47ac-b6e2-7e86bbcecf2e None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:36.785921 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb72e6d-f069-47ac-b6e2-7e86bbcecf2e None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:36.785921 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb72e6d-f069-47ac-b6e2-7e86bbcecf2e None admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:36.786312 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 287/580] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:36.786394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb72e6d-f069-47ac-b6e2-7e86bbcecf2e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:36.786486 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a8cda-e74f-4eeb-b7b8-248820bd54f4 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:36.786570 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb72e6d-f069-47ac-b6e2-7e86bbcecf2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:36.786570 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb72e6d-f069-47ac-b6e2-7e86bbcecf2e None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:36.804296 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 294/581] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Jun 29 12:07:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:36.805196 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb72e6d-f069-47ac-b6e2-7e86bbcecf2e None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:36.813355 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:36.902041 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a8cda-e74f-4eeb-b7b8-248820bd54f4 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:36.913022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb72e6d-f069-47ac-b6e2-7e86bbcecf2e None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:36.941323 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d78bc-be82-45f2-9144-9461aa18e79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:36.941990 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d78bc-be82-45f2-9144-9461aa18e79b None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:36.942278 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d78bc-be82-45f2-9144-9461aa18e79b None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:36.942557 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d78bc-be82-45f2-9144-9461aa18e79b None admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:36.943411 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d78bc-be82-45f2-9144-9461aa18e79b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:36.943729 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d78bc-be82-45f2-9144-9461aa18e79b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:36.945186 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d78bc-be82-45f2-9144-9461aa18e79b None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:36.951477 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de06ba7-a38e-4109-a5cb-ebded893bc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:36.952819 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de06ba7-a38e-4109-a5cb-ebded893bc56 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:36.953243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de06ba7-a38e-4109-a5cb-ebded893bc56 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:36.953779 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de06ba7-a38e-4109-a5cb-ebded893bc56 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:36.956840 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 288/582] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:07:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:36.957851 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d78bc-be82-45f2-9144-9461aa18e79b None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:36.968619 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de06ba7-a38e-4109-a5cb-ebded893bc56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:36.976930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-2de06ba7-a38e-4109-a5cb-ebded893bc56 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:07:36.976930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:36.976930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:36.976930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:36.976930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:36.976930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:36.976930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:36.976930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:36.976930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:36.976930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:36.976930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:36.976930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:36.976930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:36.976930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:36.976930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:36.976930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:36.977911 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:36.977911 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:36.977911 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:36.977911 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:36.977911 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:36.977911 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:36.977911 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:36.977911 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:36.977911 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:36.977911 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:36.977911 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:36.977911 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:36.977911 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:36.977911 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:36.977911 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:36.977911 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:36.978833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:36.978833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:36.978833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:36.978833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:36.978833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:36.978833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:36.978833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:36.978833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:36.978833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:36.978833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:36.978833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:07:36.978833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:36.978833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 295/583] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 29 12:07:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:36.979540 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de06ba7-a38e-4109-a5cb-ebded893bc56 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:36.999068 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:37.053742 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:37.076698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d78bc-be82-45f2-9144-9461aa18e79b None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:37.086768 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de06ba7-a38e-4109-a5cb-ebded893bc56 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:37.112504 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aced96d-55a0-469a-99ee-c50a3aabec5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:37.113175 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aced96d-55a0-469a-99ee-c50a3aabec5c None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:37.113462 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aced96d-55a0-469a-99ee-c50a3aabec5c None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:37.113735 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aced96d-55a0-469a-99ee-c50a3aabec5c None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:37.114460 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aced96d-55a0-469a-99ee-c50a3aabec5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:37.114804 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aced96d-55a0-469a-99ee-c50a3aabec5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:37.116274 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aced96d-55a0-469a-99ee-c50a3aabec5c None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:37.122864 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc73ad-fdb7-42d4-9208-8f8d7e820f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:37.124109 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc73ad-fdb7-42d4-9208-8f8d7e820f1b None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:37.124398 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc73ad-fdb7-42d4-9208-8f8d7e820f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:37.124673 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc73ad-fdb7-42d4-9208-8f8d7e820f1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:37.128130 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 289/584] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:37.128787 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aced96d-55a0-469a-99ee-c50a3aabec5c None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:37.142107 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc73ad-fdb7-42d4-9208-8f8d7e820f1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:37.143777 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc73ad-fdb7-42d4-9208-8f8d7e820f1b None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:37.161448 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-81bc73ad-fdb7-42d4-9208-8f8d7e820f1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:37.161448 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:37.161448 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:37.161448 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:37.161448 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:37.161448 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:37.161448 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:37.161448 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:37.161448 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:37.161448 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:37.161448 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:37.161448 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:37.161448 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:37.161448 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:37.161448 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:37.167971 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:37.167971 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:37.167971 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:37.167971 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:37.167971 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:37.167971 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:37.167971 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:37.167971 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:37.167971 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:37.167971 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:37.167971 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:37.167971 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:37.167971 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:37.167971 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:37.167971 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:37.167971 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:37.167971 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:37.168889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:37.168889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:37.168889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:37.168889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:37.168889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 296/585] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:37.168889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc73ad-fdb7-42d4-9208-8f8d7e820f1b None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:37.239951 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:37.257662 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aced96d-55a0-469a-99ee-c50a3aabec5c None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:37.276349 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc73ad-fdb7-42d4-9208-8f8d7e820f1b None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:37.295249 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f30b9-6827-424a-9523-b30b43a06f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:37.296142 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f30b9-6827-424a-9523-b30b43a06f20 None admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:37.296423 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f30b9-6827-424a-9523-b30b43a06f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:37.296693 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f30b9-6827-424a-9523-b30b43a06f20 None admin] PATH_INFO: `/v3/projects/489877ae137244c5b83291671c703c99/users/09d603d756a9484bbf48cfd6d56bdb0b/roles/0be824a9ecd0492f984e3b3b991e3984` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:37.308815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:37.314418 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f30b9-6827-424a-9523-b30b43a06f20 None admin] RBAC: Authorizing `identity:create_grant(project_id=489877ae137244c5b83291671c703c99, user_id=09d603d756a9484bbf48cfd6d56bdb0b, role_id=0be824a9ecd0492f984e3b3b991e3984)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:37.316114 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f30b9-6827-424a-9523-b30b43a06f20 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:37.316223 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105d1d3-a753-4c51-bb2b-ec20f8987144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:37.316878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105d1d3-a753-4c51-bb2b-ec20f8987144 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:37.317098 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105d1d3-a753-4c51-bb2b-ec20f8987144 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:37.317367 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105d1d3-a753-4c51-bb2b-ec20f8987144 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:37.318660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105d1d3-a753-4c51-bb2b-ec20f8987144 None admin] RBAC: Adding query filter params (name=service) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:37.319031 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105d1d3-a753-4c51-bb2b-ec20f8987144 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:37.320390 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105d1d3-a753-4c51-bb2b-ec20f8987144 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:37.334699 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 297/586] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 29 12:07:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:37.334699 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105d1d3-a753-4c51-bb2b-ec20f8987144 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:37.334967 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 290/587] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 29 12:07:37 2022] PUT /identity/v3/projects/489877ae137244c5b83291671c703c99/users/09d603d756a9484bbf48cfd6d56bdb0b/roles/0be824a9ecd0492f984e3b3b991e3984 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:07:37.335877 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f30b9-6827-424a-9523-b30b43a06f20 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:37.466934 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105d1d3-a753-4c51-bb2b-ec20f8987144 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:37.475962 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f30b9-6827-424a-9523-b30b43a06f20 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:37.501745 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:37.510195 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f4b51-ada1-45d2-8186-295c1098461c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:37.511010 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f4b51-ada1-45d2-8186-295c1098461c None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:37.511296 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f4b51-ada1-45d2-8186-295c1098461c None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:37.511575 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f4b51-ada1-45d2-8186-295c1098461c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:37.519857 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f4b51-ada1-45d2-8186-295c1098461c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:37.521948 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f4b51-ada1-45d2-8186-295c1098461c None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:37.526153 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1c73c-a8f7-424f-b559-2653d9eef4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:37.526891 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1c73c-a8f7-424f-b559-2653d9eef4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:37.527178 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1c73c-a8f7-424f-b559-2653d9eef4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:37.527454 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1c73c-a8f7-424f-b559-2653d9eef4d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:37.528180 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1c73c-a8f7-424f-b559-2653d9eef4d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:37.528488 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1c73c-a8f7-424f-b559-2653d9eef4d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:37.529915 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1c73c-a8f7-424f-b559-2653d9eef4d7 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:37.536345 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-d45f4b51-ada1-45d2-8186-295c1098461c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 12:07:37.536345 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:37.536345 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:37.536345 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:37.536345 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:37.536345 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:37.536345 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:37.536345 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:37.536345 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:37.536345 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:37.536345 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:37.536345 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:37.536345 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:07:37.536345 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:07:37.536345 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:07:37.536345 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:07:37.537676 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:37.537676 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:37.537676 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:07:37.537676 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:37.537676 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:07:37.537676 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:37.537676 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:37.537676 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:37.537676 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:37.537676 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:37.537676 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:37.537676 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:37.537676 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:37.537676 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:37.537676 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:37.537676 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:37.537676 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:37.537676 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:37.538652 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:37.538652 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:37.538652 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:07:37.538652 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:07:37.538652 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:07:37.538652 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:07:37.538652 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:07:37.538652 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:07:37.538652 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 12:07:37.538652 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:37.538652 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 298/588] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:37.538652 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f4b51-ada1-45d2-8186-295c1098461c None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:37.548835 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 291/589] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:37.549618 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1c73c-a8f7-424f-b559-2653d9eef4d7 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:37.613240 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:37.672213 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f4b51-ada1-45d2-8186-295c1098461c None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:37.684451 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1c73c-a8f7-424f-b559-2653d9eef4d7 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:37.717009 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280dfe0-8147-4750-932b-8916c301952a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:37.718324 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280dfe0-8147-4750-932b-8916c301952a None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:37.718663 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280dfe0-8147-4750-932b-8916c301952a None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:37.718941 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280dfe0-8147-4750-932b-8916c301952a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:37.736638 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280dfe0-8147-4750-932b-8916c301952a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:37.738892 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8082a-d61b-4326-8d94-0289063c14e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:37.739024 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280dfe0-8147-4750-932b-8916c301952a None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:37.739633 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8082a-d61b-4326-8d94-0289063c14e0 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:37.740452 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8082a-d61b-4326-8d94-0289063c14e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:37.740784 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8082a-d61b-4326-8d94-0289063c14e0 None admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:37.741620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c8082a-d61b-4326-8d94-0289063c14e0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:37.741931 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c8082a-d61b-4326-8d94-0289063c14e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:37.743393 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c8082a-d61b-4326-8d94-0289063c14e0 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:37.759998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-f280dfe0-8147-4750-932b-8916c301952a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:37.759998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:37.759998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:37.759998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:37.759998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:37.759998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:37.759998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:37.759998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:37.759998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:37.759998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:37.759998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:37.759998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:37.759998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:37.759998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:37.759998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:37.760976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:37.760976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:37.760976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:37.760976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:37.760976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:37.760976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:37.760976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:37.760976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:37.760976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:37.760976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:37.760976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:37.760976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:37.760976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:37.760976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:37.760976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:37.760976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:37.760976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:37.761872 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:37.761872 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:37.761872 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:37.761872 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:37.763051 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 292/590] 10.222.0.13 () {56 vars in 1137 bytes} [Wed Jun 29 12:07:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:37.763882 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8082a-d61b-4326-8d94-0289063c14e0 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:37.764512 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 299/591] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:37.774679 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280dfe0-8147-4750-932b-8916c301952a None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:37.827183 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:37.874870 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8082a-d61b-4326-8d94-0289063c14e0 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:37.877505 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280dfe0-8147-4750-932b-8916c301952a None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:37.885174 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:37.918051 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350392b-d08d-4b20-a27b-4e86253f22a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:37.919344 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350392b-d08d-4b20-a27b-4e86253f22a3 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:37.920110 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350392b-d08d-4b20-a27b-4e86253f22a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:37.920829 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350392b-d08d-4b20-a27b-4e86253f22a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:37.925082 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff5ab7-41db-471b-b35c-afc26c99057d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:37.925952 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff5ab7-41db-471b-b35c-afc26c99057d None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:37.926327 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff5ab7-41db-471b-b35c-afc26c99057d None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:37.926702 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff5ab7-41db-471b-b35c-afc26c99057d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:37.930063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350392b-d08d-4b20-a27b-4e86253f22a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:37.932137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350392b-d08d-4b20-a27b-4e86253f22a3 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:37.940469 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff5ab7-41db-471b-b35c-afc26c99057d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:37.941932 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff5ab7-41db-471b-b35c-afc26c99057d None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:37.950808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-b350392b-d08d-4b20-a27b-4e86253f22a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:37.950808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:37.950808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:37.950808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:37.950808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:37.950808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:37.950808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:37.950808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:37.950808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:37.950808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:37.950808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:37.950808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:37.950808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:07:37.950808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:07:37.950808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:07:37.951700 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:07:37.951700 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:37.951700 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:37.951700 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:37.951700 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:37.951700 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:37.951700 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:37.951700 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:37.951700 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:37.951700 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:37.951700 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:37.951700 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:37.951700 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:37.951700 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:37.951700 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:37.951700 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:37.951700 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:37.952617 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:07:37.952617 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:07:37.952617 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:07:37.952617 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:07:37.952617 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:07:37.952617 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:07:37.952617 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:37.952617 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:37.952617 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 293/592] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:37.953561 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350392b-d08d-4b20-a27b-4e86253f22a3 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:37.964582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-ccff5ab7-41db-471b-b35c-afc26c99057d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:37.964582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:37.964582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:37.964582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:37.964582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:37.964582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:37.964582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:37.964582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:37.964582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:37.964582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:37.964582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:37.964582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:37.964582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:37.964582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:37.964582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:37.965837 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:37.965837 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:37.965837 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:37.965837 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:37.965837 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:37.965837 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:37.965837 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:37.965837 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:37.965837 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:37.965837 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:37.965837 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:37.965837 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:37.965837 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:37.965837 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:37.965837 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:37.965837 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:37.965837 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:37.966761 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:37.966761 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:37.966761 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:37.966761 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:37.968106 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 300/593] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:37.973789 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff5ab7-41db-471b-b35c-afc26c99057d None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:38.068901 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350392b-d08d-4b20-a27b-4e86253f22a3 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:38.088952 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:38.097966 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff5ab7-41db-471b-b35c-afc26c99057d None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:38.108157 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c80650-223f-4799-8553-2c4c0c7e95bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:38.108815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c80650-223f-4799-8553-2c4c0c7e95bb None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:38.109103 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c80650-223f-4799-8553-2c4c0c7e95bb None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:38.109384 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c80650-223f-4799-8553-2c4c0c7e95bb None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:38.110119 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c80650-223f-4799-8553-2c4c0c7e95bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:38.110432 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c80650-223f-4799-8553-2c4c0c7e95bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:38.111969 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c80650-223f-4799-8553-2c4c0c7e95bb None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:38.130680 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 294/594] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:38.130680 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c80650-223f-4799-8553-2c4c0c7e95bb None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:38.150285 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8e145-7e21-4784-beaa-28d6c9198f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:38.151933 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8e145-7e21-4784-beaa-28d6c9198f69 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:38.152598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8e145-7e21-4784-beaa-28d6c9198f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:38.153183 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8e145-7e21-4784-beaa-28d6c9198f69 None admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:38.154446 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8e145-7e21-4784-beaa-28d6c9198f69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:38.155400 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8e145-7e21-4784-beaa-28d6c9198f69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:38.157614 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8e145-7e21-4784-beaa-28d6c9198f69 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:38.158445 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:38.178136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 301/595] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:07:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:38.179622 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8e145-7e21-4784-beaa-28d6c9198f69 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:38.247712 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c80650-223f-4799-8553-2c4c0c7e95bb None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:38.288419 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e85c2-8c87-4447-8e6c-afe7b85ebe3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:38.289092 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e85c2-8c87-4447-8e6c-afe7b85ebe3a None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:38.289377 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e85c2-8c87-4447-8e6c-afe7b85ebe3a None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:38.289651 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e85c2-8c87-4447-8e6c-afe7b85ebe3a None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:38.290376 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e85c2-8c87-4447-8e6c-afe7b85ebe3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:38.290727 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e85c2-8c87-4447-8e6c-afe7b85ebe3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:38.292119 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e85c2-8c87-4447-8e6c-afe7b85ebe3a None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:38.304811 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 295/596] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:38.305695 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e85c2-8c87-4447-8e6c-afe7b85ebe3a None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:38.320093 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8e145-7e21-4784-beaa-28d6c9198f69 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:38.357758 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3975e11-d440-4b2f-8179-9e8d76cffb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:38.358559 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3975e11-d440-4b2f-8179-9e8d76cffb03 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:38.358871 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3975e11-d440-4b2f-8179-9e8d76cffb03 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:38.359151 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3975e11-d440-4b2f-8179-9e8d76cffb03 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:38.366509 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3975e11-d440-4b2f-8179-9e8d76cffb03 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:38.368067 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3975e11-d440-4b2f-8179-9e8d76cffb03 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:38.383650 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-a3975e11-d440-4b2f-8179-9e8d76cffb03 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 12:07:38.383650 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:38.383650 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:38.383650 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:38.383650 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:38.383650 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:38.383650 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:38.383650 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:38.383650 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:38.383650 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:38.383650 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:38.383650 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:38.383650 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:07:38.383650 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:07:38.383650 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:07:38.383650 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:07:38.384808 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:38.384808 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:38.384808 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:07:38.384808 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:38.384808 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:07:38.384808 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:38.384808 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:38.384808 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:38.384808 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:38.384808 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:38.384808 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:38.384808 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:38.384808 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:38.384808 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:38.384808 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:38.384808 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:38.384808 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:38.384808 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:38.385977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:38.385977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:38.385977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:07:38.385977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:07:38.385977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:07:38.385977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:07:38.385977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:07:38.385977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:07:38.385977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 12:07:38.385977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:38.392098 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 302/597] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 29 12:07:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:38.392098 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b208c-997c-464f-ac9c-4374009c280b None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:38.392098 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b208c-997c-464f-ac9c-4374009c280b None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:38.392098 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b208c-997c-464f-ac9c-4374009c280b None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:38.392098 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 303/598] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:38.392098 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b208c-997c-464f-ac9c-4374009c280b None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:38.407941 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:38.408492 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:38.422864 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e85c2-8c87-4447-8e6c-afe7b85ebe3a None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:38.457840 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd0e89-9ae4-4ca7-9682-2283c9dd74b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:38.459377 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd0e89-9ae4-4ca7-9682-2283c9dd74b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:38.459574 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd0e89-9ae4-4ca7-9682-2283c9dd74b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:38.459853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd0e89-9ae4-4ca7-9682-2283c9dd74b0 None admin] PATH_INFO: `/v3/projects/489877ae137244c5b83291671c703c99/users/3fbcf547421b42e4b520f9246326bff8/roles/0be824a9ecd0492f984e3b3b991e3984` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:38.476000 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd0e89-9ae4-4ca7-9682-2283c9dd74b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=489877ae137244c5b83291671c703c99, user_id=3fbcf547421b42e4b520f9246326bff8, role_id=0be824a9ecd0492f984e3b3b991e3984)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:38.477470 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd0e89-9ae4-4ca7-9682-2283c9dd74b0 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:38.491895 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 296/599] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 29 12:07:38 2022] PUT /identity/v3/projects/489877ae137244c5b83291671c703c99/users/3fbcf547421b42e4b520f9246326bff8/roles/0be824a9ecd0492f984e3b3b991e3984 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:07:38.493584 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd0e89-9ae4-4ca7-9682-2283c9dd74b0 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:38.506502 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b208c-997c-464f-ac9c-4374009c280b None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:38.565386 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7cab2-6284-4f99-bf72-a8a0fb26646b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:38.566291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7cab2-6284-4f99-bf72-a8a0fb26646b None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:38.566578 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7cab2-6284-4f99-bf72-a8a0fb26646b None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:38.566886 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7cab2-6284-4f99-bf72-a8a0fb26646b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:38.577410 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7cab2-6284-4f99-bf72-a8a0fb26646b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:38.579201 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7cab2-6284-4f99-bf72-a8a0fb26646b None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:38.596866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-f4f7cab2-6284-4f99-bf72-a8a0fb26646b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:38.596866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:38.596866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:38.596866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:38.596866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:38.596866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:38.596866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:38.596866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:38.596866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:38.596866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:38.596866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:38.596866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:38.596866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:07:38.596866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:07:38.596866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:07:38.597820 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:07:38.597820 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:38.597820 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:38.597820 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:38.597820 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:38.597820 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:38.597820 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:38.597820 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:38.597820 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:38.597820 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:38.597820 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:38.597820 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:38.597820 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:38.597820 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:38.597820 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:38.597820 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:38.597820 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:38.598749 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:07:38.598749 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:07:38.598749 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:07:38.598749 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:07:38.598749 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:07:38.598749 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:07:38.598749 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:38.598749 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:38.602063 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 304/600] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:38.603691 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498a29f-6353-4627-9b21-723da3508eb6 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:38.604186 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498a29f-6353-4627-9b21-723da3508eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:38.604660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498a29f-6353-4627-9b21-723da3508eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:38.629610 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-c498a29f-6353-4627-9b21-723da3508eb6 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:38.632077 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-c498a29f-6353-4627-9b21-723da3508eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:38.638095 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd0e89-9ae4-4ca7-9682-2283c9dd74b0 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:38.679597 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14113d62-132a-4997-bd61-bddf3443e01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:38.680345 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14113d62-132a-4997-bd61-bddf3443e01e None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:38.680634 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14113d62-132a-4997-bd61-bddf3443e01e None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:38.680911 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14113d62-132a-4997-bd61-bddf3443e01e None admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:38.681752 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14113d62-132a-4997-bd61-bddf3443e01e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:38.682066 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14113d62-132a-4997-bd61-bddf3443e01e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:38.684143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14113d62-132a-4997-bd61-bddf3443e01e None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:38.694037 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:38.705746 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 297/601] 10.222.0.13 () {56 vars in 1139 bytes} [Wed Jun 29 12:07:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:38.706672 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14113d62-132a-4997-bd61-bddf3443e01e None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:38.711678 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 305/602] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:38.715559 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498a29f-6353-4627-9b21-723da3508eb6 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:38.719754 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:38.812039 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14113d62-132a-4997-bd61-bddf3443e01e None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:38.841540 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498a29f-6353-4627-9b21-723da3508eb6 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:38.847889 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740983e7-1be1-4670-9254-3ca5463750f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:38.848561 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740983e7-1be1-4670-9254-3ca5463750f0 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:38.848850 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740983e7-1be1-4670-9254-3ca5463750f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:38.849158 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740983e7-1be1-4670-9254-3ca5463750f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:38.849945 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740983e7-1be1-4670-9254-3ca5463750f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:38.850258 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740983e7-1be1-4670-9254-3ca5463750f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:38.851728 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740983e7-1be1-4670-9254-3ca5463750f0 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:38.864751 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 298/603] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:07:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:38.865962 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740983e7-1be1-4670-9254-3ca5463750f0 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:38.881782 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9069b8-c377-4852-8f94-12b38c5bc8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:38.883072 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9069b8-c377-4852-8f94-12b38c5bc8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:38.883565 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9069b8-c377-4852-8f94-12b38c5bc8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:38.884159 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9069b8-c377-4852-8f94-12b38c5bc8f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:38.896650 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9069b8-c377-4852-8f94-12b38c5bc8f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:38.898734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9069b8-c377-4852-8f94-12b38c5bc8f8 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:38.918733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-2d9069b8-c377-4852-8f94-12b38c5bc8f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:38.918733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:38.918733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:38.918733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:38.918733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:38.918733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:38.918733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:38.918733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:38.918733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:38.918733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:38.918733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:38.918733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:38.918733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:38.918733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:38.918733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:38.919728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:38.919728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:38.919728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:38.919728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:38.919728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:38.919728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:38.919728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:38.919728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:38.919728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:38.919728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:38.919728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:38.919728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:38.919728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:38.919728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:38.919728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:38.919728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:38.919728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:38.920635 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:38.920635 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:38.920635 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:38.920635 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:38.923232 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 306/604] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:38.928929 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9069b8-c377-4852-8f94-12b38c5bc8f8 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:38.932923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:38.980064 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740983e7-1be1-4670-9254-3ca5463750f0 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:38.993986 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:39.016474 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20781dc-a5cf-4ffe-aeb0-0a5c2f4ad2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:39.017278 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20781dc-a5cf-4ffe-aeb0-0a5c2f4ad2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:39.017564 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20781dc-a5cf-4ffe-aeb0-0a5c2f4ad2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:39.017840 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20781dc-a5cf-4ffe-aeb0-0a5c2f4ad2a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:39.029478 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20781dc-a5cf-4ffe-aeb0-0a5c2f4ad2a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:39.037859 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-c20781dc-a5cf-4ffe-aeb0-0a5c2f4ad2a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:07:39.037859 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:39.037859 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:39.037859 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:39.037859 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:39.037859 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:39.037859 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:39.037859 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:39.037859 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:39.037859 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:39.037859 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:39.037859 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:39.037859 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:39.037859 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:39.037859 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:39.037859 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:39.038853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:39.038853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:39.038853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:39.038853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:39.038853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:39.038853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:39.038853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:39.038853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:39.038853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:39.038853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:39.038853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:39.038853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:39.038853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:39.038853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:39.038853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:39.038853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:39.039721 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:39.039721 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:39.039721 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:39.039721 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:39.039721 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:39.039721 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:39.039721 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:39.039721 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:39.039721 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:39.039721 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:39.039721 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:07:39.039721 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:39.039721 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 299/605] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 29 12:07:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:39.040419 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20781dc-a5cf-4ffe-aeb0-0a5c2f4ad2a6 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:39.050092 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9069b8-c377-4852-8f94-12b38c5bc8f8 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:39.092939 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd8d4f-33c2-4d1a-9e5b-0863e4ce3709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:39.093865 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd8d4f-33c2-4d1a-9e5b-0863e4ce3709 None admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:39.094153 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd8d4f-33c2-4d1a-9e5b-0863e4ce3709 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:39.094435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd8d4f-33c2-4d1a-9e5b-0863e4ce3709 None admin] PATH_INFO: `/v3/projects/489877ae137244c5b83291671c703c99/users/4009947e15c347e19da8b4fbddfb2875/roles/0be824a9ecd0492f984e3b3b991e3984` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:39.115210 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd8d4f-33c2-4d1a-9e5b-0863e4ce3709 None admin] RBAC: Authorizing `identity:create_grant(project_id=489877ae137244c5b83291671c703c99, user_id=4009947e15c347e19da8b4fbddfb2875, role_id=0be824a9ecd0492f984e3b3b991e3984)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:39.117937 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd8d4f-33c2-4d1a-9e5b-0863e4ce3709 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:39.142675 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 307/606] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 29 12:07:38 2022] PUT /identity/v3/projects/489877ae137244c5b83291671c703c99/users/4009947e15c347e19da8b4fbddfb2875/roles/0be824a9ecd0492f984e3b3b991e3984 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:07:39.142675 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd8d4f-33c2-4d1a-9e5b-0863e4ce3709 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:39.179390 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20781dc-a5cf-4ffe-aeb0-0a5c2f4ad2a6 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:39.205689 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:39.256071 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babed730-7858-4a28-8978-174f1ad67e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:39.256953 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babed730-7858-4a28-8978-174f1ad67e2b None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:39.257342 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babed730-7858-4a28-8978-174f1ad67e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:39.257727 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babed730-7858-4a28-8978-174f1ad67e2b None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:39.258574 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babed730-7858-4a28-8978-174f1ad67e2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:39.259010 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babed730-7858-4a28-8978-174f1ad67e2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:39.260525 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babed730-7858-4a28-8978-174f1ad67e2b None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:39.262661 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd8d4f-33c2-4d1a-9e5b-0863e4ce3709 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:39.271596 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:39.280530 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 300/607] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:39.289134 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babed730-7858-4a28-8978-174f1ad67e2b None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:39.329911 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bb1f9-ab98-4d0e-b9e6-3b0bad742935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:39.330895 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bb1f9-ab98-4d0e-b9e6-3b0bad742935 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:39.331331 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bb1f9-ab98-4d0e-b9e6-3b0bad742935 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:39.331902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bb1f9-ab98-4d0e-b9e6-3b0bad742935 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:39.332844 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1bb1f9-ab98-4d0e-b9e6-3b0bad742935 None admin] RBAC: Adding query filter params (name=service) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:39.333405 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1bb1f9-ab98-4d0e-b9e6-3b0bad742935 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:39.335204 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1bb1f9-ab98-4d0e-b9e6-3b0bad742935 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:39.353968 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 308/608] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 29 12:07:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:39.359634 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bb1f9-ab98-4d0e-b9e6-3b0bad742935 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:39.417966 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babed730-7858-4a28-8978-174f1ad67e2b None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:39.453724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ced9b5-e474-46f1-8a3e-2eec71e31699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:39.454718 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ced9b5-e474-46f1-8a3e-2eec71e31699 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:39.455101 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ced9b5-e474-46f1-8a3e-2eec71e31699 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:39.455479 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ced9b5-e474-46f1-8a3e-2eec71e31699 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:39.462880 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ced9b5-e474-46f1-8a3e-2eec71e31699 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:39.464542 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ced9b5-e474-46f1-8a3e-2eec71e31699 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:39.479906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-83ced9b5-e474-46f1-8a3e-2eec71e31699 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:39.479906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:39.479906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:39.479906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:39.479906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:39.479906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:39.479906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:39.479906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:39.479906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:39.479906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:39.479906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:39.479906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:39.479906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:07:39.479906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:07:39.479906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:07:39.480940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:07:39.480940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:39.480940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:39.480940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:39.480940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:39.480940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:39.480940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:39.480940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:39.480940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:39.480940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:39.480940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:39.480940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:39.480940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:39.480940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:39.480940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:39.480940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:39.480940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:39.481850 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:07:39.481850 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:07:39.481850 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:07:39.481850 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:07:39.481850 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:07:39.481850 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:07:39.481850 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:39.481850 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:39.481850 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 301/609] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:39.488269 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ced9b5-e474-46f1-8a3e-2eec71e31699 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:39.507322 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bb1f9-ab98-4d0e-b9e6-3b0bad742935 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:39.528445 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:39.583426 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca57c01-5049-422d-83dc-3742ac3c90ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:39.584458 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca57c01-5049-422d-83dc-3742ac3c90ba None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:39.584842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca57c01-5049-422d-83dc-3742ac3c90ba None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:39.585120 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca57c01-5049-422d-83dc-3742ac3c90ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:39.605332 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ced9b5-e474-46f1-8a3e-2eec71e31699 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:39.608812 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca57c01-5049-422d-83dc-3742ac3c90ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:39.610291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca57c01-5049-422d-83dc-3742ac3c90ba None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:39.638339 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-aca57c01-5049-422d-83dc-3742ac3c90ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:39.638339 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:39.638339 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:39.638339 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:39.638339 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:39.638339 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:39.638339 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:39.638339 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:39.638339 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:39.638339 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:39.638339 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:39.638339 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:39.638339 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:39.638339 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:39.638339 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:39.639328 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:39.639328 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:39.639328 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:39.639328 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:39.639328 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:39.639328 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:39.639328 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:39.639328 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:39.639328 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:39.639328 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:39.639328 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:39.639328 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:39.639328 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:39.639328 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:39.639328 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:39.639328 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:39.639328 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:39.640211 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:39.640211 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:39.640211 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:39.640211 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:39.641855 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec31fb-01d7-46eb-9e40-f72b1d6f1677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:39.642817 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec31fb-01d7-46eb-9e40-f72b1d6f1677 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:39.643188 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec31fb-01d7-46eb-9e40-f72b1d6f1677 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:39.643369 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec31fb-01d7-46eb-9e40-f72b1d6f1677 None admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:39.643558 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 309/610] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:39.644141 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec31fb-01d7-46eb-9e40-f72b1d6f1677 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:39.644448 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec31fb-01d7-46eb-9e40-f72b1d6f1677 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:39.645523 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dc86a-4097-40d7-ace0-e3b10d025fbe None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:39.646052 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dc86a-4097-40d7-ace0-e3b10d025fbe None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:39.646167 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec31fb-01d7-46eb-9e40-f72b1d6f1677 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:39.646662 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dc86a-4097-40d7-ace0-e3b10d025fbe None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:39.652526 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 310/611] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:39.652526 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240dc86a-4097-40d7-ace0-e3b10d025fbe None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:39.666528 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 302/612] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:07:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:39.668441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca17a6-cceb-4f94-a7eb-f555d12bbbf5 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:39.668798 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca17a6-cceb-4f94-a7eb-f555d12bbbf5 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:39.669191 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca17a6-cceb-4f94-a7eb-f555d12bbbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:39.690664 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:39.692152 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-e0ca17a6-cceb-4f94-a7eb-f555d12bbbf5 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:39.693565 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-e0ca17a6-cceb-4f94-a7eb-f555d12bbbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:39.777118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240dc86a-4097-40d7-ace0-e3b10d025fbe None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:39.801741 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 303/613] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:39.801741 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca17a6-cceb-4f94-a7eb-f555d12bbbf5 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:39.832994 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a44939-e97a-46e5-a98f-724b09e229c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:39.834279 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a44939-e97a-46e5-a98f-724b09e229c4 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:39.834563 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a44939-e97a-46e5-a98f-724b09e229c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:39.834922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a44939-e97a-46e5-a98f-724b09e229c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:39.835651 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a44939-e97a-46e5-a98f-724b09e229c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:39.835953 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a44939-e97a-46e5-a98f-724b09e229c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:39.837330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a44939-e97a-46e5-a98f-724b09e229c4 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:39.845215 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:39.857654 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 311/614] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:39.858944 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a44939-e97a-46e5-a98f-724b09e229c4 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:39.937709 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca17a6-cceb-4f94-a7eb-f555d12bbbf5 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:39.967590 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:39.983677 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b621ace-39ea-4649-b681-6e7e4a3a7089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:39.984964 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b621ace-39ea-4649-b681-6e7e4a3a7089 None admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:39.985455 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b621ace-39ea-4649-b681-6e7e4a3a7089 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:39.985982 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b621ace-39ea-4649-b681-6e7e4a3a7089 None admin] PATH_INFO: `/v3/projects/489877ae137244c5b83291671c703c99/users/50f5cc247f6b445f81fc3715d7bce92d/roles/0be824a9ecd0492f984e3b3b991e3984` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:39.991933 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a44939-e97a-46e5-a98f-724b09e229c4 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:40.003558 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b621ace-39ea-4649-b681-6e7e4a3a7089 None admin] RBAC: Authorizing `identity:create_grant(project_id=489877ae137244c5b83291671c703c99, user_id=50f5cc247f6b445f81fc3715d7bce92d, role_id=0be824a9ecd0492f984e3b3b991e3984)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:40.005582 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b621ace-39ea-4649-b681-6e7e4a3a7089 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:40.022212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 304/615] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 29 12:07:39 2022] PUT /identity/v3/projects/489877ae137244c5b83291671c703c99/users/50f5cc247f6b445f81fc3715d7bce92d/roles/0be824a9ecd0492f984e3b3b991e3984 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:07:40.023476 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b621ace-39ea-4649-b681-6e7e4a3a7089 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:40.038805 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab241987-6e83-4ca5-a020-10fc57bd8017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:40.040489 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab241987-6e83-4ca5-a020-10fc57bd8017 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:40.042526 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab241987-6e83-4ca5-a020-10fc57bd8017 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:40.043105 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab241987-6e83-4ca5-a020-10fc57bd8017 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:40.074095 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab241987-6e83-4ca5-a020-10fc57bd8017 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:40.082096 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-ab241987-6e83-4ca5-a020-10fc57bd8017 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:07:40.082096 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:40.082096 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:40.082096 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:40.082096 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:40.082096 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:40.082096 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:40.082096 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:40.082096 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:40.082096 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:40.082096 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:40.082096 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:40.082096 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:40.082096 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:40.082096 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:40.082096 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:40.083195 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:40.083195 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:40.083195 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:40.083195 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:40.083195 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:40.083195 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:40.083195 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:40.083195 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:40.083195 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:40.083195 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:40.083195 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:40.083195 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:40.083195 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:40.083195 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:40.083195 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:40.083195 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:40.084592 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:40.084592 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:40.084592 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:40.084592 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:40.084592 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:40.084592 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:40.084592 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:40.084592 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:40.084592 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:40.084592 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:40.084592 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:07:40.084592 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:40.092012 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 312/616] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 29 12:07:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:40.101174 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab241987-6e83-4ca5-a020-10fc57bd8017 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:40.145314 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:40.200971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b621ace-39ea-4649-b681-6e7e4a3a7089 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:40.231319 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab241987-6e83-4ca5-a020-10fc57bd8017 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:40.264061 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120b750-ee9d-47ca-b5b9-8553bf1adcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:40.265322 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120b750-ee9d-47ca-b5b9-8553bf1adcbf None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:40.265814 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120b750-ee9d-47ca-b5b9-8553bf1adcbf None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:40.266368 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120b750-ee9d-47ca-b5b9-8553bf1adcbf None admin] PATH_INFO: `/v3/users/swift` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:40.273922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900dd69b-e740-4af4-82a8-8e7f3b33ad05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:40.274668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900dd69b-e740-4af4-82a8-8e7f3b33ad05 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:40.274894 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900dd69b-e740-4af4-82a8-8e7f3b33ad05 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:40.275169 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900dd69b-e740-4af4-82a8-8e7f3b33ad05 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:40.275971 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900dd69b-e740-4af4-82a8-8e7f3b33ad05 None admin] RBAC: Adding query filter params (name=service) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:40.276317 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900dd69b-e740-4af4-82a8-8e7f3b33ad05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:40.276760 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e120b750-ee9d-47ca-b5b9-8553bf1adcbf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:40.277850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900dd69b-e740-4af4-82a8-8e7f3b33ad05 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:40.279259 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e120b750-ee9d-47ca-b5b9-8553bf1adcbf None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:40.287825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 313/617] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 29 12:07:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:40.293081 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900dd69b-e740-4af4-82a8-8e7f3b33ad05 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:40.295965 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:40.298123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-e120b750-ee9d-47ca-b5b9-8553bf1adcbf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 12:07:40.298123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:40.298123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:40.298123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:40.298123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:40.298123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:40.298123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:40.298123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:40.298123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:40.298123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:40.298123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:40.298123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:40.298123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:07:40.298123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:07:40.298123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:07:40.298123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:07:40.299097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:40.299097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:40.299097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:07:40.299097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:40.299097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:07:40.299097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:40.299097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:40.299097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:40.299097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:40.299097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:40.299097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:40.299097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:40.299097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:40.299097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:40.299097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:40.299097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:40.299097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:40.299097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:40.300076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:40.300076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:40.300076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:07:40.300076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:07:40.300076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:07:40.300076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:07:40.300076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:07:40.300076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:07:40.300076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 12:07:40.300076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:40.303367 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 305/618] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:07:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:40.308804 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120b750-ee9d-47ca-b5b9-8553bf1adcbf None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:40.458855 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120b750-ee9d-47ca-b5b9-8553bf1adcbf None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:40.476055 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900dd69b-e740-4af4-82a8-8e7f3b33ad05 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:40.508606 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771add48-ea20-4435-9c54-5743509c0be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:40.509685 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771add48-ea20-4435-9c54-5743509c0be6 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:40.509967 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771add48-ea20-4435-9c54-5743509c0be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:40.510241 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771add48-ea20-4435-9c54-5743509c0be6 None admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:40.511117 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771add48-ea20-4435-9c54-5743509c0be6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:40.511427 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771add48-ea20-4435-9c54-5743509c0be6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:40.512884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771add48-ea20-4435-9c54-5743509c0be6 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:40.515808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:40.518629 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04163592-b499-473c-a90a-87bb6fcfce57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:40.519460 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04163592-b499-473c-a90a-87bb6fcfce57 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:40.519744 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04163592-b499-473c-a90a-87bb6fcfce57 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:40.520018 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04163592-b499-473c-a90a-87bb6fcfce57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:40.534482 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04163592-b499-473c-a90a-87bb6fcfce57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:40.536018 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04163592-b499-473c-a90a-87bb6fcfce57 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:40.554690 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-04163592-b499-473c-a90a-87bb6fcfce57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:40.554690 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:40.554690 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:40.554690 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:40.554690 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:40.554690 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:40.554690 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:40.554690 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:40.554690 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:40.554690 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:40.554690 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:40.554690 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:40.554690 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:40.554690 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:40.554690 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:40.555801 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:40.555801 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:40.555801 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:40.555801 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:40.555801 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:40.555801 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:40.555801 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:40.555801 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:40.555801 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:40.555801 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:40.555801 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:40.555801 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:40.555801 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:40.555801 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:40.555801 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:40.555801 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:40.555801 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:40.556706 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:40.556706 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:40.556706 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:40.556706 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:40.556706 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 314/619] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:07:40.558264 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 306/620] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Jun 29 12:07:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:40.563490 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04163592-b499-473c-a90a-87bb6fcfce57 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:40.567606 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771add48-ea20-4435-9c54-5743509c0be6 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:40.676417 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771add48-ea20-4435-9c54-5743509c0be6 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:40.703002 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:40.717227 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ba8da-e086-4492-8dee-dad2f5b9d780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:40.717961 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ba8da-e086-4492-8dee-dad2f5b9d780 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:40.718240 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ba8da-e086-4492-8dee-dad2f5b9d780 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:40.718510 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ba8da-e086-4492-8dee-dad2f5b9d780 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:40.743524 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ba8da-e086-4492-8dee-dad2f5b9d780 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:40.745388 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ba8da-e086-4492-8dee-dad2f5b9d780 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:40.764366 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-124ba8da-e086-4492-8dee-dad2f5b9d780 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:40.764366 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:40.764366 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:40.764366 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:40.764366 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:40.764366 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:40.764366 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:40.764366 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:40.764366 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:40.764366 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:40.764366 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:40.764366 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:40.764366 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:40.764366 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:40.764366 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:40.765291 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:40.765291 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:40.765291 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:40.765291 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:40.765291 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:40.765291 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:40.765291 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:40.765291 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:40.765291 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:40.765291 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:40.765291 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:40.765291 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:40.765291 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:40.765291 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:40.765291 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:40.765291 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:40.765291 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:40.766195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:40.766195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:40.766195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:40.766195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:40.768591 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 307/621] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:40.774660 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cc25d-6d96-4db8-ba10-196ff511dba9 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:40.774660 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cc25d-6d96-4db8-ba10-196ff511dba9 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:40.774660 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cc25d-6d96-4db8-ba10-196ff511dba9 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:40.775579 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 308/622] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:40.776280 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cc25d-6d96-4db8-ba10-196ff511dba9 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:40.796913 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04163592-b499-473c-a90a-87bb6fcfce57 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:40.831934 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75d5d9-d74b-41e6-909f-f628edbaeb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:40.832598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75d5d9-d74b-41e6-909f-f628edbaeb5f None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:40.832884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75d5d9-d74b-41e6-909f-f628edbaeb5f None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:40.833207 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75d5d9-d74b-41e6-909f-f628edbaeb5f None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:40.833955 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75d5d9-d74b-41e6-909f-f628edbaeb5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:40.834310 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75d5d9-d74b-41e6-909f-f628edbaeb5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:40.834736 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:40.835788 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75d5d9-d74b-41e6-909f-f628edbaeb5f None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:40.848670 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 315/623] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:40.850153 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6cacc-da3e-454f-bd6c-31d9bb09a2ff None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:40.850447 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6cacc-da3e-454f-bd6c-31d9bb09a2ff None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:40.850751 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6cacc-da3e-454f-bd6c-31d9bb09a2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:40.868356 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-aed6cacc-da3e-454f-bd6c-31d9bb09a2ff None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:40.869500 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-aed6cacc-da3e-454f-bd6c-31d9bb09a2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:40.893111 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cc25d-6d96-4db8-ba10-196ff511dba9 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:40.929729 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb12b80-a2c9-4859-851d-b2d301624baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:40.930804 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb12b80-a2c9-4859-851d-b2d301624baf None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:40.931301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb12b80-a2c9-4859-851d-b2d301624baf None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:40.931781 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb12b80-a2c9-4859-851d-b2d301624baf None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:40.932708 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb12b80-a2c9-4859-851d-b2d301624baf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:40.933263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb12b80-a2c9-4859-851d-b2d301624baf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:40.934886 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb12b80-a2c9-4859-851d-b2d301624baf None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:40.941040 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 316/624] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:40.942418 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed6cacc-da3e-454f-bd6c-31d9bb09a2ff None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:40.948075 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 309/625] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:40.959594 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb12b80-a2c9-4859-851d-b2d301624baf None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:40.998041 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:41.068451 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb12b80-a2c9-4859-851d-b2d301624baf None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:41.072734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed6cacc-da3e-454f-bd6c-31d9bb09a2ff None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:41.077478 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:41.107195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d9366-d880-4da5-aff2-0c392b14c0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:41.108372 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d9366-d880-4da5-aff2-0c392b14c0c4 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:41.108915 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d9366-d880-4da5-aff2-0c392b14c0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:41.109394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d9366-d880-4da5-aff2-0c392b14c0c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:41.116259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61de626-6ba8-4e31-91a6-ce8e06189c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:41.117329 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61de626-6ba8-4e31-91a6-ce8e06189c41 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:41.117611 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61de626-6ba8-4e31-91a6-ce8e06189c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:41.117887 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61de626-6ba8-4e31-91a6-ce8e06189c41 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:41.118278 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d9366-d880-4da5-aff2-0c392b14c0c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:41.119982 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d9366-d880-4da5-aff2-0c392b14c0c4 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:41.126160 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61de626-6ba8-4e31-91a6-ce8e06189c41 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:41.128641 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61de626-6ba8-4e31-91a6-ce8e06189c41 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:41.136573 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-7b6d9366-d880-4da5-aff2-0c392b14c0c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:41.136573 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:41.136573 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:41.136573 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:41.136573 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:41.136573 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:41.136573 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:41.136573 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:41.136573 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:41.136573 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:41.136573 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:41.136573 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:41.136573 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:07:41.136573 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:07:41.136573 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:07:41.137479 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:07:41.137479 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:41.137479 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:41.137479 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:41.137479 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:41.137479 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:41.137479 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:41.137479 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:41.137479 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:41.137479 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:41.137479 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:41.137479 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:41.137479 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:41.137479 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:41.137479 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:41.137479 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:41.137479 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:41.138394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:07:41.138394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:07:41.138394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:07:41.138394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:07:41.138394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:07:41.138394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:07:41.138394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:41.138394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:41.140883 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 310/626] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:41.141869 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d9366-d880-4da5-aff2-0c392b14c0c4 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:41.143841 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-c61de626-6ba8-4e31-91a6-ce8e06189c41 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 29 12:07:41.143841 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:41.143841 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:41.143841 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:41.143841 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:41.143841 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:41.143841 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:41.143841 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:41.143841 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:41.143841 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:41.143841 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:41.143841 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:41.143841 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:07:41.143841 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:07:41.143841 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:07:41.143841 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:07:41.144798 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:41.144798 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:41.144798 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:07:41.144798 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:41.144798 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:07:41.144798 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:41.144798 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:41.144798 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:41.144798 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:41.144798 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:41.144798 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:41.144798 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:41.144798 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:41.144798 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:41.144798 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:41.144798 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:41.144798 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:41.144798 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:41.146118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:41.146118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:41.146118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:07:41.146118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:07:41.146118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:07:41.146118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:07:41.146118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:07:41.146118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:07:41.146118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 29 12:07:41.146118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:41.146118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 317/627] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:41.146118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61de626-6ba8-4e31-91a6-ce8e06189c41 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:41.263588 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d9366-d880-4da5-aff2-0c392b14c0c4 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:41.290942 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61de626-6ba8-4e31-91a6-ce8e06189c41 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:41.294327 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:41.302804 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308be13-3fd7-4a91-94f4-c4e5ab41d9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:41.304159 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308be13-3fd7-4a91-94f4-c4e5ab41d9b9 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:41.304654 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308be13-3fd7-4a91-94f4-c4e5ab41d9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:41.305138 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308be13-3fd7-4a91-94f4-c4e5ab41d9b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:41.317002 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308be13-3fd7-4a91-94f4-c4e5ab41d9b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:41.326456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-6308be13-3fd7-4a91-94f4-c4e5ab41d9b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:07:41.326456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:41.326456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:41.326456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:41.326456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:41.326456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:41.326456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:41.326456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:41.326456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:41.326456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:41.326456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:41.326456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:41.326456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:41.326456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:41.326456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:41.326456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:41.327441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:41.327441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:41.327441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:41.327441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:41.327441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:41.327441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:41.327441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:41.327441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:41.327441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:41.327441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:41.327441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:41.327441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:41.327441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:41.327441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:41.327441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:41.327441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:41.328300 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:41.328300 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:41.328300 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:41.328300 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:41.328300 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:41.328300 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:41.328300 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:41.328300 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:41.328300 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:41.328300 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:41.328300 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:07:41.328300 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:41.330868 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 311/628] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 29 12:07:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:41.331922 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308be13-3fd7-4a91-94f4-c4e5ab41d9b9 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:41.339543 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed7577-a8f4-4cae-bb18-0762336bb095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:41.340225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed7577-a8f4-4cae-bb18-0762336bb095 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:41.340512 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed7577-a8f4-4cae-bb18-0762336bb095 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:41.340792 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed7577-a8f4-4cae-bb18-0762336bb095 None admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:41.341590 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed7577-a8f4-4cae-bb18-0762336bb095 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:41.341905 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed7577-a8f4-4cae-bb18-0762336bb095 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:41.343411 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed7577-a8f4-4cae-bb18-0762336bb095 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:41.362856 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 318/629] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:07:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:41.364097 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed7577-a8f4-4cae-bb18-0762336bb095 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:41.370521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:41.471140 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308be13-3fd7-4a91-94f4-c4e5ab41d9b9 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:41.488878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed7577-a8f4-4cae-bb18-0762336bb095 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:41.517792 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841ceca-a4b5-4483-a1ec-279e1b627acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:41.519107 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841ceca-a4b5-4483-a1ec-279e1b627acd None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:41.519402 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841ceca-a4b5-4483-a1ec-279e1b627acd None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:41.519683 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841ceca-a4b5-4483-a1ec-279e1b627acd None admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:41.520802 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841ceca-a4b5-4483-a1ec-279e1b627acd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:41.521255 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841ceca-a4b5-4483-a1ec-279e1b627acd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:41.523217 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841ceca-a4b5-4483-a1ec-279e1b627acd None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:41.529449 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac407dd-9e5f-450b-b474-a182b171eebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:41.530404 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac407dd-9e5f-450b-b474-a182b171eebc None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:41.530951 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac407dd-9e5f-450b-b474-a182b171eebc None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:41.531454 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac407dd-9e5f-450b-b474-a182b171eebc None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:41.532446 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac407dd-9e5f-450b-b474-a182b171eebc None admin] RBAC: Adding query filter params (name=service) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:41.532961 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac407dd-9e5f-450b-b474-a182b171eebc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:41.534558 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac407dd-9e5f-450b-b474-a182b171eebc None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:41.544014 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 319/630] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 29 12:07:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:41.545061 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac407dd-9e5f-450b-b474-a182b171eebc None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:41.546779 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 312/631] 10.222.0.13 () {56 vars in 1137 bytes} [Wed Jun 29 12:07:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:41.549709 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841ceca-a4b5-4483-a1ec-279e1b627acd None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:41.582065 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:41.673301 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac407dd-9e5f-450b-b474-a182b171eebc None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:41.678714 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:41.695775 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841ceca-a4b5-4483-a1ec-279e1b627acd None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:41.709454 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf7635-14bc-4dca-8591-df3a89c3bd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:41.710344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf7635-14bc-4dca-8591-df3a89c3bd42 None admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:41.710623 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf7635-14bc-4dca-8591-df3a89c3bd42 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:41.710922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf7635-14bc-4dca-8591-df3a89c3bd42 None admin] PATH_INFO: `/v3/projects/489877ae137244c5b83291671c703c99/users/11efdbeeaa5c428aa344f7f0f5b061ba/roles/0be824a9ecd0492f984e3b3b991e3984` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:41.733734 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205bacd-d190-44ed-8c8d-d03ff9a00468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:41.734533 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205bacd-d190-44ed-8c8d-d03ff9a00468 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:41.734844 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205bacd-d190-44ed-8c8d-d03ff9a00468 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:41.735114 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205bacd-d190-44ed-8c8d-d03ff9a00468 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:41.738027 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf7635-14bc-4dca-8591-df3a89c3bd42 None admin] RBAC: Authorizing `identity:create_grant(project_id=489877ae137244c5b83291671c703c99, user_id=11efdbeeaa5c428aa344f7f0f5b061ba, role_id=0be824a9ecd0492f984e3b3b991e3984)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:41.740332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf7635-14bc-4dca-8591-df3a89c3bd42 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:41.746487 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205bacd-d190-44ed-8c8d-d03ff9a00468 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:41.748141 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205bacd-d190-44ed-8c8d-d03ff9a00468 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:41.754131 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 320/632] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 29 12:07:41 2022] PUT /identity/v3/projects/489877ae137244c5b83291671c703c99/users/11efdbeeaa5c428aa344f7f0f5b061ba/roles/0be824a9ecd0492f984e3b3b991e3984 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:07:41.755286 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf7635-14bc-4dca-8591-df3a89c3bd42 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:41.776840 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-d205bacd-d190-44ed-8c8d-d03ff9a00468 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:41.776840 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:41.776840 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:41.776840 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:41.776840 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:41.776840 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:41.776840 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:41.776840 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:41.776840 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:41.776840 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:41.776840 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:41.776840 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:41.776840 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:41.776840 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:41.776840 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:41.777942 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:41.777942 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:41.777942 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:41.777942 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:41.777942 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:41.777942 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:41.777942 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:41.777942 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:41.777942 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:41.777942 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:41.777942 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:41.777942 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:41.777942 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:41.777942 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:41.777942 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:41.777942 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:41.777942 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:41.779104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:41.779104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:41.779104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:41.779104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:41.784662 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 313/633] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:41.784662 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a49148-b7b5-437b-9654-04403782d27f None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:41.784662 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a49148-b7b5-437b-9654-04403782d27f None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:41.784662 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a49148-b7b5-437b-9654-04403782d27f None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:41.784662 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 314/634] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:41.786140 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a49148-b7b5-437b-9654-04403782d27f None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:41.872660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:41.898764 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf7635-14bc-4dca-8591-df3a89c3bd42 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:41.931416 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a49148-b7b5-437b-9654-04403782d27f None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:41.941600 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30884707-0953-4eb2-bcda-b1debf978a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:41.942541 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30884707-0953-4eb2-bcda-b1debf978a9a None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:41.943108 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30884707-0953-4eb2-bcda-b1debf978a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:41.943559 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30884707-0953-4eb2-bcda-b1debf978a9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:41.977359 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0080f33-6d19-4b4f-947c-5de92e251e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:41.978195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0080f33-6d19-4b4f-947c-5de92e251e41 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:41.978482 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0080f33-6d19-4b4f-947c-5de92e251e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:41.979096 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0080f33-6d19-4b4f-947c-5de92e251e41 None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:41.980098 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0080f33-6d19-4b4f-947c-5de92e251e41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:41.980404 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0080f33-6d19-4b4f-947c-5de92e251e41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:41.982564 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0080f33-6d19-4b4f-947c-5de92e251e41 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:41.985407 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:41.998075 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 315/635] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:41.999848 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3127b19-2c42-4751-b6c9-2e1300d432dd None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:42.000138 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3127b19-2c42-4751-b6c9-2e1300d432dd None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:42.000420 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3127b19-2c42-4751-b6c9-2e1300d432dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:42.021581 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-e3127b19-2c42-4751-b6c9-2e1300d432dd None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:42.023005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30884707-0953-4eb2-bcda-b1debf978a9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:42.023153 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-e3127b19-2c42-4751-b6c9-2e1300d432dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:42.024998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30884707-0953-4eb2-bcda-b1debf978a9a None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:42.110812 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 316/636] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:42.111225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:42.112467 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3127b19-2c42-4751-b6c9-2e1300d432dd None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:42.152007 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 321/637] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:42.153203 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30884707-0953-4eb2-bcda-b1debf978a9a None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:42.258056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3127b19-2c42-4751-b6c9-2e1300d432dd None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:42.259340 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30884707-0953-4eb2-bcda-b1debf978a9a None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:42.292029 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:42.298165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9baf12-5b30-44f5-b53d-bf240409d91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:42.299330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9baf12-5b30-44f5-b53d-bf240409d91c None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:42.299771 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9baf12-5b30-44f5-b53d-bf240409d91c None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:42.300216 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9baf12-5b30-44f5-b53d-bf240409d91c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:42.302700 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95268ac7-5626-45a6-96b6-182ff1f2a57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:42.303797 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95268ac7-5626-45a6-96b6-182ff1f2a57f None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:42.304085 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95268ac7-5626-45a6-96b6-182ff1f2a57f None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:42.304358 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95268ac7-5626-45a6-96b6-182ff1f2a57f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:42.311431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9baf12-5b30-44f5-b53d-bf240409d91c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:42.311807 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95268ac7-5626-45a6-96b6-182ff1f2a57f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:42.313419 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95268ac7-5626-45a6-96b6-182ff1f2a57f None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:42.319846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-5a9baf12-5b30-44f5-b53d-bf240409d91c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:07:42.319846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:42.319846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:42.319846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:42.319846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:42.319846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:42.319846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:42.319846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:42.319846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:42.319846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:42.319846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:42.319846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:42.319846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:42.319846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:42.319846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:42.319846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:42.321472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:42.321472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:42.321472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:42.321472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:42.321472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:42.321472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:42.321472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:42.321472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:42.321472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:42.321472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:42.321472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:42.321472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:42.321472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:42.321472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:42.321472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:42.321472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:42.322716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:42.322716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:42.322716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:42.322716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:42.322716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:42.322716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:42.322716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:42.322716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:42.322716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:42.322716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:42.322716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:07:42.322716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:42.322716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 322/638] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 29 12:07:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:42.322716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9baf12-5b30-44f5-b53d-bf240409d91c None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:42.335007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-95268ac7-5626-45a6-96b6-182ff1f2a57f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:07:42.335007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:42.335007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:42.335007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:42.335007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:42.335007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:42.335007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:42.335007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:42.335007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:42.335007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:42.335007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:42.335007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:42.335007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:07:42.335007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:07:42.335007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:07:42.335007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:07:42.336161 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:42.336161 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:42.336161 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:07:42.336161 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:42.336161 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:07:42.336161 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:42.336161 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:42.336161 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:42.336161 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:42.336161 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:42.336161 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:42.336161 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:42.336161 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:42.336161 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:42.336161 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:42.336161 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:42.336161 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:42.336161 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:42.337148 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:42.337148 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:42.337148 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:07:42.337148 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:07:42.337148 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:07:42.337148 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:07:42.337148 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:07:42.337148 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:07:42.337148 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:07:42.337148 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:42.337148 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 317/639] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Jun 29 12:07:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:42.337812 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16197cc8-f793-4e4b-9595-64eb81e15ce4 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:42.338105 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16197cc8-f793-4e4b-9595-64eb81e15ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:42.338384 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16197cc8-f793-4e4b-9595-64eb81e15ce4 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:42.342678 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 318/640] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:42.342678 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16197cc8-f793-4e4b-9595-64eb81e15ce4 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:42.371009 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:42.446924 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9baf12-5b30-44f5-b53d-bf240409d91c None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:42.450969 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16197cc8-f793-4e4b-9595-64eb81e15ce4 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:42.484501 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3fb57-cc0d-47f2-aca4-5413c4aaac2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:42.485390 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3fb57-cc0d-47f2-aca4-5413c4aaac2c None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:42.485731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3fb57-cc0d-47f2-aca4-5413c4aaac2c None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:42.486087 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3fb57-cc0d-47f2-aca4-5413c4aaac2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:42.487636 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5b234-41aa-4461-9d58-4f638da560be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:42.488377 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5b234-41aa-4461-9d58-4f638da560be None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:42.488743 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5b234-41aa-4461-9d58-4f638da560be None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:42.489085 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5b234-41aa-4461-9d58-4f638da560be None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:42.489936 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f5b234-41aa-4461-9d58-4f638da560be None admin] RBAC: Adding query filter params (name=service) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:42.490345 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f5b234-41aa-4461-9d58-4f638da560be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:42.491811 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f5b234-41aa-4461-9d58-4f638da560be None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:42.497460 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3fb57-cc0d-47f2-aca4-5413c4aaac2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:42.499038 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3fb57-cc0d-47f2-aca4-5413c4aaac2c None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:42.500196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 319/641] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 29 12:07:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:42.505710 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5b234-41aa-4461-9d58-4f638da560be None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:42.518668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-f0f3fb57-cc0d-47f2-aca4-5413c4aaac2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:42.518668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:42.518668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:42.518668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:42.518668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:42.518668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:42.518668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:42.518668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:42.518668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:42.518668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:42.518668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:42.518668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:42.518668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:42.518668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:42.518668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:42.521519 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:42.521519 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:42.521519 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:42.521519 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:42.521519 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:42.521519 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:42.521519 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:42.521519 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:42.521519 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:42.521519 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:42.521519 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:42.521519 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:42.521519 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:42.521519 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:42.521519 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:42.521519 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:42.521519 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:42.522554 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:42.522554 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:42.522554 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:42.522554 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:42.522554 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 323/642] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:42.522554 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657bf9a-d3e2-4d99-85f9-021effb39e8b None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:42.523708 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657bf9a-d3e2-4d99-85f9-021effb39e8b None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:42.523708 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657bf9a-d3e2-4d99-85f9-021effb39e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:42.540395 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-7657bf9a-d3e2-4d99-85f9-021effb39e8b None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:42.541638 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-7657bf9a-d3e2-4d99-85f9-021effb39e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:42.564651 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:42.614799 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 324/643] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:42.615805 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657bf9a-d3e2-4d99-85f9-021effb39e8b None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:42.629799 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5b234-41aa-4461-9d58-4f638da560be None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:42.634882 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:42.670017 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b3c50-9cd8-4332-a08d-21d560b1681c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:42.670720 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b3c50-9cd8-4332-a08d-21d560b1681c None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:42.671005 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b3c50-9cd8-4332-a08d-21d560b1681c None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:42.671683 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b3c50-9cd8-4332-a08d-21d560b1681c None admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:42.672518 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b3c50-9cd8-4332-a08d-21d560b1681c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:42.672828 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b3c50-9cd8-4332-a08d-21d560b1681c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:42.674278 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b3c50-9cd8-4332-a08d-21d560b1681c None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:42.696020 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 320/644] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Jun 29 12:07:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:42.696020 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b3c50-9cd8-4332-a08d-21d560b1681c None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:42.729952 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657bf9a-d3e2-4d99-85f9-021effb39e8b None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:42.766559 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd977be-f2c9-4719-8430-f305616a250c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:42.767386 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd977be-f2c9-4719-8430-f305616a250c None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:42.767665 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd977be-f2c9-4719-8430-f305616a250c None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:42.767946 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd977be-f2c9-4719-8430-f305616a250c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:42.778475 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd977be-f2c9-4719-8430-f305616a250c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:42.780128 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd977be-f2c9-4719-8430-f305616a250c None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:42.798020 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-2bd977be-f2c9-4719-8430-f305616a250c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:42.798020 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:42.798020 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:42.798020 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:42.798020 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:42.798020 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:42.798020 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:42.798020 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:42.798020 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:42.798020 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:42.798020 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:42.798020 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:42.798020 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:42.798020 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:42.798020 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:42.799257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:42.799257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:42.799257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:42.799257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:42.799257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:42.799257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:42.799257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:42.799257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:42.799257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:42.799257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:42.799257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:42.799257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:42.799257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:42.799257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:42.799257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:42.799257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:42.799257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:42.800321 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:42.800321 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:42.800321 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:42.800321 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:42.800321 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 325/645] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:42.800608 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd977be-f2c9-4719-8430-f305616a250c None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:42.808039 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b3c50-9cd8-4332-a08d-21d560b1681c None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:42.815562 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:42.844936 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f4e31-3ba6-443c-8941-f121cbc3c75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:42.845604 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f4e31-3ba6-443c-8941-f121cbc3c75d None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:42.845894 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f4e31-3ba6-443c-8941-f121cbc3c75d None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:42.846173 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f4e31-3ba6-443c-8941-f121cbc3c75d None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:42.846937 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f4e31-3ba6-443c-8941-f121cbc3c75d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:42.847251 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f4e31-3ba6-443c-8941-f121cbc3c75d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:42.848638 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f4e31-3ba6-443c-8941-f121cbc3c75d None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:42.861531 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 321/646] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:42.866984 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f4e31-3ba6-443c-8941-f121cbc3c75d None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:42.876344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:42.910065 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd977be-f2c9-4719-8430-f305616a250c None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:42.949265 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0df914-7ada-491a-a26c-eb09af86569f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:42.950456 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0df914-7ada-491a-a26c-eb09af86569f None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:42.950770 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0df914-7ada-491a-a26c-eb09af86569f None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:42.951043 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0df914-7ada-491a-a26c-eb09af86569f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:42.962296 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0df914-7ada-491a-a26c-eb09af86569f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:42.970009 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-9c0df914-7ada-491a-a26c-eb09af86569f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:07:42.970009 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:42.970009 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:42.970009 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:42.970009 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:42.970009 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:42.970009 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:42.970009 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:42.970009 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:42.970009 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:42.970009 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:42.970009 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:42.970009 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:42.970009 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:42.970009 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:42.970009 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:42.970995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:42.970995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:42.970995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:42.970995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:42.970995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:42.970995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:42.970995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:42.970995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:42.970995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:42.970995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:42.970995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:42.970995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:42.970995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:42.970995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:42.970995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:42.970995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:42.971850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:42.971850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:42.971850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:42.971850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:42.971850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:42.971850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:42.971850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:42.971850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:42.971850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:42.971850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:42.971850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:07:42.971850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:42.971850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 326/647] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 29 12:07:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:42.972566 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0df914-7ada-491a-a26c-eb09af86569f None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:42.984168 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f4e31-3ba6-443c-8941-f121cbc3c75d None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:43.023694 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d2062-b3aa-49f3-b7e5-db563b93e865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:43.024345 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d2062-b3aa-49f3-b7e5-db563b93e865 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:43.024632 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d2062-b3aa-49f3-b7e5-db563b93e865 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:43.024910 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d2062-b3aa-49f3-b7e5-db563b93e865 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:43.063547 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:43.079249 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0df914-7ada-491a-a26c-eb09af86569f None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:43.100143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d2062-b3aa-49f3-b7e5-db563b93e865 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:43.101602 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d2062-b3aa-49f3-b7e5-db563b93e865 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:43.108759 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:43.116793 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d229a-0dee-4236-9008-9380576bd619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:43.118012 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d229a-0dee-4236-9008-9380576bd619 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:43.118364 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d229a-0dee-4236-9008-9380576bd619 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:43.118743 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d229a-0dee-4236-9008-9380576bd619 None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:43.119468 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d229a-0dee-4236-9008-9380576bd619 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:43.119776 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d229a-0dee-4236-9008-9380576bd619 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:43.121154 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d229a-0dee-4236-9008-9380576bd619 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:43.134412 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 327/648] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:43.135228 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d229a-0dee-4236-9008-9380576bd619 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:43.208750 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 322/649] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:43.209574 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d2062-b3aa-49f3-b7e5-db563b93e865 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:43.249331 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d229a-0dee-4236-9008-9380576bd619 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:43.280827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:43.291777 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc77d3-d0cd-4cba-b568-8e1a4b38780e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:43.292655 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc77d3-d0cd-4cba-b568-8e1a4b38780e None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:43.292940 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc77d3-d0cd-4cba-b568-8e1a4b38780e None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:43.293217 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc77d3-d0cd-4cba-b568-8e1a4b38780e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:43.300440 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc77d3-d0cd-4cba-b568-8e1a4b38780e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:43.302706 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc77d3-d0cd-4cba-b568-8e1a4b38780e None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:43.317352 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-b9cc77d3-d0cd-4cba-b568-8e1a4b38780e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:43.317352 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:43.317352 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:43.317352 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:43.317352 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:43.317352 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:43.317352 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:43.317352 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:43.317352 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:43.317352 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:43.317352 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:43.317352 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:43.317352 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:07:43.317352 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:07:43.317352 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:07:43.318441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:07:43.318441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:43.318441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:43.318441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:43.318441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:43.318441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:43.318441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:43.318441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:43.318441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:43.318441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:43.318441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:43.318441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:43.318441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:43.318441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:43.318441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:43.318441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:43.318441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:43.319673 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:07:43.319673 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:07:43.319673 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:07:43.319673 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:07:43.319673 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:07:43.319673 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:07:43.319673 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:43.319673 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:43.320196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d2062-b3aa-49f3-b7e5-db563b93e865 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:43.323021 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 328/650] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:43.323734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc77d3-d0cd-4cba-b568-8e1a4b38780e None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:43.356384 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37427a-c27d-4eb8-a38e-8e9fc372984b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:43.357050 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37427a-c27d-4eb8-a38e-8e9fc372984b None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:43.357332 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37427a-c27d-4eb8-a38e-8e9fc372984b None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:43.357608 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37427a-c27d-4eb8-a38e-8e9fc372984b None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:43.358356 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37427a-c27d-4eb8-a38e-8e9fc372984b None admin] RBAC: Adding query filter params (name=service) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:43.358694 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37427a-c27d-4eb8-a38e-8e9fc372984b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:43.360079 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37427a-c27d-4eb8-a38e-8e9fc372984b None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:43.370197 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 323/651] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 29 12:07:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:43.371160 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37427a-c27d-4eb8-a38e-8e9fc372984b None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:43.380197 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:43.432625 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc77d3-d0cd-4cba-b568-8e1a4b38780e None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:43.468177 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f095b-b0fa-44b0-95d8-8856f2139fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:43.468892 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f095b-b0fa-44b0-95d8-8856f2139fbc None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:43.469174 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f095b-b0fa-44b0-95d8-8856f2139fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:43.469448 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f095b-b0fa-44b0-95d8-8856f2139fbc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:43.477803 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f095b-b0fa-44b0-95d8-8856f2139fbc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:43.479297 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f095b-b0fa-44b0-95d8-8856f2139fbc None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:43.479699 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37427a-c27d-4eb8-a38e-8e9fc372984b None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:43.494930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-d94f095b-b0fa-44b0-95d8-8856f2139fbc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 12:07:43.494930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:43.494930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:43.494930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:43.494930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:43.494930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:43.494930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:43.494930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:43.494930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:43.494930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:43.494930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:43.494930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:43.494930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:07:43.494930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:07:43.494930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:07:43.494930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:07:43.495920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:43.495920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:43.495920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:07:43.495920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:43.495920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:07:43.495920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:43.495920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:43.495920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:43.495920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:43.495920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:43.495920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:43.495920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:43.495920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:43.495920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:43.495920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:43.495920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:43.495920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:43.495920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:43.496860 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:43.496860 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:43.496860 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:07:43.496860 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:07:43.496860 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:07:43.496860 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:07:43.496860 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:07:43.496860 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:07:43.496860 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 12:07:43.496860 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:43.496860 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 329/652] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:43.496860 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f095b-b0fa-44b0-95d8-8856f2139fbc None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:43.514157 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:43.523495 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d3758-eb81-4890-926b-827f5c975104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:43.524292 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d3758-eb81-4890-926b-827f5c975104 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:43.524580 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d3758-eb81-4890-926b-827f5c975104 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:43.524845 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d3758-eb81-4890-926b-827f5c975104 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:43.536123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d3758-eb81-4890-926b-827f5c975104 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:43.538405 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d3758-eb81-4890-926b-827f5c975104 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:43.559196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-557d3758-eb81-4890-926b-827f5c975104 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:43.559196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:43.559196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:43.559196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:43.559196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:43.559196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:43.559196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:43.559196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:43.559196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:43.559196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:43.559196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:43.559196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:43.559196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:43.559196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:43.559196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:43.560128 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:43.560128 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:43.560128 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:43.560128 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:43.560128 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:43.560128 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:43.560128 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:43.560128 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:43.560128 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:43.560128 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:43.560128 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:43.560128 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:43.560128 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:43.560128 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:43.560128 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:43.560128 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:43.560128 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:43.561033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:43.561033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:43.561033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:43.561033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:43.561033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 324/653] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:43.561306 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d3758-eb81-4890-926b-827f5c975104 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:43.610917 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f095b-b0fa-44b0-95d8-8856f2139fbc None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:43.624845 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:43.656367 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d02f82-a771-4f35-b506-0461b5cff109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:43.657134 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d02f82-a771-4f35-b506-0461b5cff109 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:43.657424 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d02f82-a771-4f35-b506-0461b5cff109 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:43.657744 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d02f82-a771-4f35-b506-0461b5cff109 None admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:43.658527 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d02f82-a771-4f35-b506-0461b5cff109 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:43.658883 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d02f82-a771-4f35-b506-0461b5cff109 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:43.660327 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d02f82-a771-4f35-b506-0461b5cff109 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:43.665288 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d3758-eb81-4890-926b-827f5c975104 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:43.677466 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 330/654] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:07:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:43.678300 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d02f82-a771-4f35-b506-0461b5cff109 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:43.711575 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8196aa-5389-41ab-b782-fbc14414483e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:43.712376 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8196aa-5389-41ab-b782-fbc14414483e None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:43.712658 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8196aa-5389-41ab-b782-fbc14414483e None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:43.712933 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8196aa-5389-41ab-b782-fbc14414483e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:43.724535 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8196aa-5389-41ab-b782-fbc14414483e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:43.726260 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8196aa-5389-41ab-b782-fbc14414483e None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:43.744715 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-6f8196aa-5389-41ab-b782-fbc14414483e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:43.744715 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:43.744715 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:43.744715 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:43.744715 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:43.744715 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:43.744715 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:43.744715 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:43.744715 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:43.744715 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:43.744715 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:43.744715 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:43.744715 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:43.744715 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:43.744715 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:43.745672 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:43.745672 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:43.745672 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:43.745672 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:43.745672 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:43.745672 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:43.745672 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:43.745672 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:43.745672 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:43.745672 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:43.745672 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:43.745672 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:43.745672 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:43.745672 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:43.745672 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:43.745672 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:43.745672 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:43.746620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:43.746620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:43.746620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:43.746620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:43.746620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 325/655] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:43.747542 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8196aa-5389-41ab-b782-fbc14414483e None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:43.779844 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:43.795236 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d02f82-a771-4f35-b506-0461b5cff109 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:43.833414 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5ff85-f8b8-426d-af0e-797a32a6efb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:43.834100 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5ff85-f8b8-426d-af0e-797a32a6efb8 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:43.834744 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5ff85-f8b8-426d-af0e-797a32a6efb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:43.835032 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5ff85-f8b8-426d-af0e-797a32a6efb8 None admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:43.835870 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5ff85-f8b8-426d-af0e-797a32a6efb8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:43.836182 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5ff85-f8b8-426d-af0e-797a32a6efb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:43.837627 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5ff85-f8b8-426d-af0e-797a32a6efb8 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:43.855419 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 331/656] 10.222.0.13 () {56 vars in 1137 bytes} [Wed Jun 29 12:07:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:43.859254 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8196aa-5389-41ab-b782-fbc14414483e None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:43.860670 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5ff85-f8b8-426d-af0e-797a32a6efb8 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:43.892246 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:43.895911 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ab010-b60b-43eb-b4c4-7bbcec1f830a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:43.896583 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ab010-b60b-43eb-b4c4-7bbcec1f830a None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:43.896872 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ab010-b60b-43eb-b4c4-7bbcec1f830a None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:43.897149 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ab010-b60b-43eb-b4c4-7bbcec1f830a None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:43.897879 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ab010-b60b-43eb-b4c4-7bbcec1f830a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:43.898186 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ab010-b60b-43eb-b4c4-7bbcec1f830a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:43.899602 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ab010-b60b-43eb-b4c4-7bbcec1f830a None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:43.912247 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 326/657] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:43.913192 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ab010-b60b-43eb-b4c4-7bbcec1f830a None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:43.967593 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5ff85-f8b8-426d-af0e-797a32a6efb8 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:44.001870 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061c9cb-a043-4207-ab4b-074e24cecc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:44.002445 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061c9cb-a043-4207-ab4b-074e24cecc80 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:44.002759 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061c9cb-a043-4207-ab4b-074e24cecc80 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:44.003036 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061c9cb-a043-4207-ab4b-074e24cecc80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:44.003857 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061c9cb-a043-4207-ab4b-074e24cecc80 None admin] RBAC: Adding query filter params (role.id=0be824a9ecd0492f984e3b3b991e3984, scope.project.id=489877ae137244c5b83291671c703c99, user.id=09d603d756a9484bbf48cfd6d56bdb0b) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:44.004167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061c9cb-a043-4207-ab4b-074e24cecc80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:44.005653 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061c9cb-a043-4207-ab4b-074e24cecc80 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:44.011363 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 332/658] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:07:43 2022] GET /identity/v3/role_assignments?user.id=09d603d756a9484bbf48cfd6d56bdb0b&scope.project.id=489877ae137244c5b83291671c703c99&role.id=0be824a9ecd0492f984e3b3b991e3984 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:44.011722 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:44.012132 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061c9cb-a043-4207-ab4b-074e24cecc80 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:44.020981 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ab010-b60b-43eb-b4c4-7bbcec1f830a None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:44.065377 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767c355-717f-4117-bae9-4e431069e364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:44.066066 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767c355-717f-4117-bae9-4e431069e364 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:44.066347 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767c355-717f-4117-bae9-4e431069e364 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:44.066620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767c355-717f-4117-bae9-4e431069e364 None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:44.067390 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767c355-717f-4117-bae9-4e431069e364 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:44.067739 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767c355-717f-4117-bae9-4e431069e364 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:44.069362 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767c355-717f-4117-bae9-4e431069e364 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:44.082365 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 327/659] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:44.084179 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9a8a7-d35e-4523-87b8-7c74eb00a33e None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:44.084577 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9a8a7-d35e-4523-87b8-7c74eb00a33e None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:44.084957 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9a8a7-d35e-4523-87b8-7c74eb00a33e None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:44.086721 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 328/660] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:44.091412 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9a8a7-d35e-4523-87b8-7c74eb00a33e None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:44.139017 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:44.151640 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061c9cb-a043-4207-ab4b-074e24cecc80 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:44.193107 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733e480-05f6-4f42-ad2b-634c2433a97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:44.193918 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733e480-05f6-4f42-ad2b-634c2433a97f None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:44.194982 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733e480-05f6-4f42-ad2b-634c2433a97f None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:44.194982 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733e480-05f6-4f42-ad2b-634c2433a97f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:44.212980 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9a8a7-d35e-4523-87b8-7c74eb00a33e None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:44.252109 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba42ad-4a54-4ee7-ac82-f8b3895ae34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:44.252832 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba42ad-4a54-4ee7-ac82-f8b3895ae34b None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:44.253112 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba42ad-4a54-4ee7-ac82-f8b3895ae34b None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:44.253383 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba42ad-4a54-4ee7-ac82-f8b3895ae34b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:44.262021 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba42ad-4a54-4ee7-ac82-f8b3895ae34b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:44.263538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba42ad-4a54-4ee7-ac82-f8b3895ae34b None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:44.276077 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3733e480-05f6-4f42-ad2b-634c2433a97f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:44.277744 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3733e480-05f6-4f42-ad2b-634c2433a97f None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:44.278202 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-0fba42ad-4a54-4ee7-ac82-f8b3895ae34b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:44.278202 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:44.278202 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:44.278202 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:44.278202 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:44.278202 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:44.278202 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:44.278202 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:44.278202 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:44.278202 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:44.278202 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:44.278202 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:44.278202 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:07:44.278202 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:07:44.278202 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:07:44.279281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:07:44.279281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:44.279281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:44.279281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:44.279281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:44.279281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:44.279281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:44.279281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:44.279281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:44.279281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:44.279281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:44.279281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:44.279281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:44.279281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:44.279281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:44.279281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:44.279281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:44.280217 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:07:44.280217 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:07:44.280217 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:07:44.280217 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:07:44.280217 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:07:44.280217 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:07:44.280217 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:44.280217 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:44.280217 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 329/661] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:44.280714 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba42ad-4a54-4ee7-ac82-f8b3895ae34b None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:44.299710 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:44.390145 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:44.405917 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 333/662] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:44.405917 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26107214-3989-4cab-97a3-fbf5aab0b9b4 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:44.405917 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26107214-3989-4cab-97a3-fbf5aab0b9b4 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:44.405917 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26107214-3989-4cab-97a3-fbf5aab0b9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:44.409770 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba42ad-4a54-4ee7-ac82-f8b3895ae34b None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:44.420178 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-26107214-3989-4cab-97a3-fbf5aab0b9b4 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:44.421384 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-26107214-3989-4cab-97a3-fbf5aab0b9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:44.451924 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea80e0-26a4-448b-97de-0a8780a36d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:44.452729 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea80e0-26a4-448b-97de-0a8780a36d16 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:44.453054 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea80e0-26a4-448b-97de-0a8780a36d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:44.453280 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea80e0-26a4-448b-97de-0a8780a36d16 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:44.462123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea80e0-26a4-448b-97de-0a8780a36d16 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:44.463617 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea80e0-26a4-448b-97de-0a8780a36d16 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:44.478956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-14ea80e0-26a4-448b-97de-0a8780a36d16 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 12:07:44.478956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:44.478956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:44.478956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:44.478956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:44.478956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:44.478956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:44.478956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:44.478956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:44.478956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:44.478956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:44.478956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:44.478956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:07:44.478956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:07:44.478956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:07:44.478956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:07:44.480029 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:44.480029 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:44.480029 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:07:44.480029 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:44.480029 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:07:44.480029 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:44.480029 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:44.480029 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:44.480029 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:44.480029 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:44.480029 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:44.480029 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:44.480029 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:44.480029 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:44.480029 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:44.480029 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:44.480029 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:44.480029 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:44.481011 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:44.481011 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:44.481011 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:07:44.481011 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:07:44.481011 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:07:44.481011 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:07:44.481011 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:07:44.481011 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:07:44.481011 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 12:07:44.481011 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:44.481011 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 330/663] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 29 12:07:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:44.481011 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea80e0-26a4-448b-97de-0a8780a36d16 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:44.501167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 334/664] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:44.502030 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26107214-3989-4cab-97a3-fbf5aab0b9b4 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:44.572149 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:44.605437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea80e0-26a4-448b-97de-0a8780a36d16 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:44.618024 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26107214-3989-4cab-97a3-fbf5aab0b9b4 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:44.643810 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:44.644007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfbbab-71a6-44e6-b1f9-f26ca19a4940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:44.644494 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfbbab-71a6-44e6-b1f9-f26ca19a4940 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:44.644851 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfbbab-71a6-44e6-b1f9-f26ca19a4940 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:44.645142 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfbbab-71a6-44e6-b1f9-f26ca19a4940 None admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:44.646490 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bfbbab-71a6-44e6-b1f9-f26ca19a4940 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:44.646839 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bfbbab-71a6-44e6-b1f9-f26ca19a4940 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:44.648279 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bfbbab-71a6-44e6-b1f9-f26ca19a4940 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:44.662374 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa0518-73ad-4eed-9c57-e1bafca7abfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:44.668226 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa0518-73ad-4eed-9c57-e1bafca7abfe None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:44.668377 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 331/665] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:07:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:44.668480 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa0518-73ad-4eed-9c57-e1bafca7abfe None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:44.668480 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa0518-73ad-4eed-9c57-e1bafca7abfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:44.668650 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfbbab-71a6-44e6-b1f9-f26ca19a4940 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:44.681205 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa0518-73ad-4eed-9c57-e1bafca7abfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:44.683104 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa0518-73ad-4eed-9c57-e1bafca7abfe None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:44.701294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-c4aa0518-73ad-4eed-9c57-e1bafca7abfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:44.701294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:44.701294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:44.701294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:44.701294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:44.701294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:44.701294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:44.701294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:44.701294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:44.701294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:44.701294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:44.701294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:44.701294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:44.701294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:44.701294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:44.702243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:44.702243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:44.702243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:44.702243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:44.702243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:44.702243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:44.702243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:44.702243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:44.702243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:44.702243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:44.702243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:44.702243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:44.702243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:44.702243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:44.702243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:44.702243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:44.702243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:44.703190 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:44.703190 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:44.703190 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:44.703190 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:44.703190 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 335/666] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:44.703974 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa0518-73ad-4eed-9c57-e1bafca7abfe None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:44.797279 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfbbab-71a6-44e6-b1f9-f26ca19a4940 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:44.810751 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa0518-73ad-4eed-9c57-e1bafca7abfe None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:44.830901 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:44.838296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd743f-c508-486e-bb81-2ffa7f243adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:44.839085 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd743f-c508-486e-bb81-2ffa7f243adc None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:44.839370 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd743f-c508-486e-bb81-2ffa7f243adc None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:44.839664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd743f-c508-486e-bb81-2ffa7f243adc None admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:44.840517 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd743f-c508-486e-bb81-2ffa7f243adc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:44.840812 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd743f-c508-486e-bb81-2ffa7f243adc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:44.842246 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd743f-c508-486e-bb81-2ffa7f243adc None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:44.853405 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f99902-3dab-4a0b-a258-07dbd693a6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:44.854368 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f99902-3dab-4a0b-a258-07dbd693a6bd None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:44.854860 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f99902-3dab-4a0b-a258-07dbd693a6bd None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:44.855307 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f99902-3dab-4a0b-a258-07dbd693a6bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:44.859613 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 332/667] 10.222.0.13 () {56 vars in 1139 bytes} [Wed Jun 29 12:07:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:44.860405 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd743f-c508-486e-bb81-2ffa7f243adc None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:44.870128 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f99902-3dab-4a0b-a258-07dbd693a6bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:44.880842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-d0f99902-3dab-4a0b-a258-07dbd693a6bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:07:44.880842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:44.880842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:44.880842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:44.880842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:44.880842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:44.880842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:44.880842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:44.880842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:44.880842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:44.880842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:44.880842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:44.880842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:44.880842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:44.880842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:44.880842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:44.881902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:44.881902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:44.881902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:44.881902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:44.881902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:44.881902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:44.881902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:44.881902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:44.881902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:44.881902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:44.881902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:44.881902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:44.881902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:44.881902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:44.881902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:44.881902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:44.882784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:44.882784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:44.882784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:44.882784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:44.882784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:44.882784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:44.882784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:44.882784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:44.882784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:44.882784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:44.882784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:07:44.882784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:44.889116 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 336/668] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 29 12:07:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:44.889116 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f99902-3dab-4a0b-a258-07dbd693a6bd None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:44.925783 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:44.965832 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd743f-c508-486e-bb81-2ffa7f243adc None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:45.004064 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f99902-3dab-4a0b-a258-07dbd693a6bd None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:45.006533 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96c16b-10e3-4486-8936-efc63668023d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:45.007289 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96c16b-10e3-4486-8936-efc63668023d None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:45.007571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96c16b-10e3-4486-8936-efc63668023d None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:45.007848 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96c16b-10e3-4486-8936-efc63668023d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:45.008690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96c16b-10e3-4486-8936-efc63668023d None admin] RBAC: Adding query filter params (role.id=0be824a9ecd0492f984e3b3b991e3984, scope.project.id=489877ae137244c5b83291671c703c99, user.id=3fbcf547421b42e4b520f9246326bff8) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:45.009007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96c16b-10e3-4486-8936-efc63668023d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:45.010457 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96c16b-10e3-4486-8936-efc63668023d None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:45.016695 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 333/669] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:07:44 2022] GET /identity/v3/role_assignments?user.id=3fbcf547421b42e4b520f9246326bff8&scope.project.id=489877ae137244c5b83291671c703c99&role.id=0be824a9ecd0492f984e3b3b991e3984 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:45.027745 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96c16b-10e3-4486-8936-efc63668023d None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:45.046510 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b1bf7-629c-4d45-b866-c5a963133d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:45.047321 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b1bf7-629c-4d45-b866-c5a963133d5e None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:45.047670 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b1bf7-629c-4d45-b866-c5a963133d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:45.048025 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b1bf7-629c-4d45-b866-c5a963133d5e None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:45.048853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b1bf7-629c-4d45-b866-c5a963133d5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:45.049234 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b1bf7-629c-4d45-b866-c5a963133d5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:45.050806 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b1bf7-629c-4d45-b866-c5a963133d5e None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:45.064918 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 337/670] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:45.065882 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b1bf7-629c-4d45-b866-c5a963133d5e None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:45.118983 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:45.183272 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:45.186882 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96c16b-10e3-4486-8936-efc63668023d None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:45.190081 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b1bf7-629c-4d45-b866-c5a963133d5e None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:45.230940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177bb9a0-b47d-40bc-8ac4-b7684b523e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:45.231621 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bb9a0-b47d-40bc-8ac4-b7684b523e40 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:45.231893 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bb9a0-b47d-40bc-8ac4-b7684b523e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:45.232173 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bb9a0-b47d-40bc-8ac4-b7684b523e40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:45.237486 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b7078-6e91-4a90-89fe-cb302c089b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:45.238477 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b7078-6e91-4a90-89fe-cb302c089b25 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:45.238889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b7078-6e91-4a90-89fe-cb302c089b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:45.239776 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b7078-6e91-4a90-89fe-cb302c089b25 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:45.240804 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b7078-6e91-4a90-89fe-cb302c089b25 None admin] RBAC: Adding query filter params (name=service) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:45.241117 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b7078-6e91-4a90-89fe-cb302c089b25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:45.243470 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b7078-6e91-4a90-89fe-cb302c089b25 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:45.257484 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 338/671] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 29 12:07:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:45.257484 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b7078-6e91-4a90-89fe-cb302c089b25 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:45.331554 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177bb9a0-b47d-40bc-8ac4-b7684b523e40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:45.332842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177bb9a0-b47d-40bc-8ac4-b7684b523e40 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:45.391498 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b7078-6e91-4a90-89fe-cb302c089b25 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:45.393292 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:45.430862 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78674c-84cc-4a52-bc27-1b096d59f7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:45.432066 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78674c-84cc-4a52-bc27-1b096d59f7fc None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:45.432571 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78674c-84cc-4a52-bc27-1b096d59f7fc None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:45.433165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78674c-84cc-4a52-bc27-1b096d59f7fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:45.441074 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78674c-84cc-4a52-bc27-1b096d59f7fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:45.442832 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78674c-84cc-4a52-bc27-1b096d59f7fc None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:45.444134 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 334/672] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:45.449348 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177bb9a0-b47d-40bc-8ac4-b7684b523e40 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:45.458833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-4d78674c-84cc-4a52-bc27-1b096d59f7fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:45.458833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:45.458833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:45.458833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:45.458833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:45.458833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:45.458833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:45.458833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:45.458833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:45.458833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:45.458833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:45.458833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:45.458833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:07:45.458833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:07:45.458833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:07:45.459827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:07:45.459827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:45.459827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:45.459827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:45.459827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:45.459827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:45.459827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:45.459827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:45.459827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:45.459827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:45.459827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:45.459827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:45.459827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:45.459827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:45.459827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:45.459827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:45.459827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:45.460747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:07:45.460747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:07:45.460747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:07:45.460747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:07:45.460747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:07:45.460747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:07:45.460747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:45.460747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:45.463480 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 339/673] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:45.464602 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78674c-84cc-4a52-bc27-1b096d59f7fc None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:45.484743 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:45.560934 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177bb9a0-b47d-40bc-8ac4-b7684b523e40 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:45.582006 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78674c-84cc-4a52-bc27-1b096d59f7fc None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:45.597356 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110042b3-f73f-488e-9e2e-9f2e4215cc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:45.598256 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110042b3-f73f-488e-9e2e-9f2e4215cc4e None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:45.598546 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110042b3-f73f-488e-9e2e-9f2e4215cc4e None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:45.599486 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110042b3-f73f-488e-9e2e-9f2e4215cc4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:45.610534 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110042b3-f73f-488e-9e2e-9f2e4215cc4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:45.612466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110042b3-f73f-488e-9e2e-9f2e4215cc4e None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:45.621150 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d7fe2-f8fe-43bd-8197-fa6fcb79c8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:45.622165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d7fe2-f8fe-43bd-8197-fa6fcb79c8f3 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:45.624529 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d7fe2-f8fe-43bd-8197-fa6fcb79c8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:45.624988 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d7fe2-f8fe-43bd-8197-fa6fcb79c8f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:45.635198 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-110042b3-f73f-488e-9e2e-9f2e4215cc4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:45.635198 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:45.635198 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:45.635198 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:45.635198 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:45.635198 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:45.635198 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:45.635198 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:45.635198 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:45.635198 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:45.635198 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:45.635198 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:45.635198 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:45.635198 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:45.635198 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:45.636130 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:45.636130 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:45.636130 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:45.636130 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:45.636130 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:45.636130 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:45.636130 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:45.636130 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:45.636130 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:45.636130 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:45.636130 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:45.636130 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:45.636130 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:45.636130 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:45.636130 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:45.636130 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:45.636130 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:45.637263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:45.637263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:45.637263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:45.637263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:45.637263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 335/674] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:45.639029 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d7fe2-f8fe-43bd-8197-fa6fcb79c8f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:45.640804 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d7fe2-f8fe-43bd-8197-fa6fcb79c8f3 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:45.642488 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110042b3-f73f-488e-9e2e-9f2e4215cc4e None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:45.651718 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:45.666825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-fd5d7fe2-f8fe-43bd-8197-fa6fcb79c8f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:45.666825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:45.666825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:45.666825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:45.666825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:45.666825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:45.666825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:45.666825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:45.666825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:45.666825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:45.666825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:45.666825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:45.666825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:45.666825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:45.666825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:45.667794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:45.667794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:45.667794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:45.667794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:45.667794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:45.667794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:45.667794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:45.667794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:45.667794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:45.667794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:45.667794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:45.667794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:45.667794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:45.667794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:45.667794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:45.667794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:45.667794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:45.668724 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:45.668724 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:45.668724 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:45.668724 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:45.671143 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 340/675] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:45.672215 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d7fe2-f8fe-43bd-8197-fa6fcb79c8f3 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:45.758180 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110042b3-f73f-488e-9e2e-9f2e4215cc4e None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:45.763025 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:45.782898 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d7fe2-f8fe-43bd-8197-fa6fcb79c8f3 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:45.794266 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4902e8d-07e3-41df-b59c-05b2441aab69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:45.794953 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4902e8d-07e3-41df-b59c-05b2441aab69 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:45.795237 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4902e8d-07e3-41df-b59c-05b2441aab69 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:45.795513 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4902e8d-07e3-41df-b59c-05b2441aab69 None admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:45.796298 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4902e8d-07e3-41df-b59c-05b2441aab69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:45.796838 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4902e8d-07e3-41df-b59c-05b2441aab69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:45.798044 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4902e8d-07e3-41df-b59c-05b2441aab69 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:45.815450 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 336/676] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:07:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:45.815450 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4902e8d-07e3-41df-b59c-05b2441aab69 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:45.829478 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3447fd9-c50c-4fde-8b3c-4eabda33a968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:45.830550 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3447fd9-c50c-4fde-8b3c-4eabda33a968 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:45.831247 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3447fd9-c50c-4fde-8b3c-4eabda33a968 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:45.831755 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3447fd9-c50c-4fde-8b3c-4eabda33a968 None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:45.832837 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3447fd9-c50c-4fde-8b3c-4eabda33a968 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:45.833385 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3447fd9-c50c-4fde-8b3c-4eabda33a968 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:45.835027 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3447fd9-c50c-4fde-8b3c-4eabda33a968 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:45.848562 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 341/677] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:45.849874 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3447fd9-c50c-4fde-8b3c-4eabda33a968 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:45.885352 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:45.921232 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4902e8d-07e3-41df-b59c-05b2441aab69 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:45.956676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719034e-4995-46fd-9c7b-8e488f924030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:45.957348 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719034e-4995-46fd-9c7b-8e488f924030 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:45.957633 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719034e-4995-46fd-9c7b-8e488f924030 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:45.957919 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719034e-4995-46fd-9c7b-8e488f924030 None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:45.958681 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719034e-4995-46fd-9c7b-8e488f924030 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:45.959000 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719034e-4995-46fd-9c7b-8e488f924030 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:45.960401 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719034e-4995-46fd-9c7b-8e488f924030 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:45.962664 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3447fd9-c50c-4fde-8b3c-4eabda33a968 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:45.976895 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 337/678] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:45.977995 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719034e-4995-46fd-9c7b-8e488f924030 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:45.995110 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:46.003663 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955dcf1-5b14-47f2-91b4-4d0bbebba54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:46.004977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955dcf1-5b14-47f2-91b4-4d0bbebba54b None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:46.006037 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955dcf1-5b14-47f2-91b4-4d0bbebba54b None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:46.006791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955dcf1-5b14-47f2-91b4-4d0bbebba54b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:46.008659 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c955dcf1-5b14-47f2-91b4-4d0bbebba54b None admin] RBAC: Adding query filter params (role.id=0be824a9ecd0492f984e3b3b991e3984, scope.project.id=489877ae137244c5b83291671c703c99, user.id=4009947e15c347e19da8b4fbddfb2875) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:46.009207 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c955dcf1-5b14-47f2-91b4-4d0bbebba54b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:46.011825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c955dcf1-5b14-47f2-91b4-4d0bbebba54b None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:46.029478 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 342/679] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:07:45 2022] GET /identity/v3/role_assignments?user.id=4009947e15c347e19da8b4fbddfb2875&scope.project.id=489877ae137244c5b83291671c703c99&role.id=0be824a9ecd0492f984e3b3b991e3984 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:46.029478 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955dcf1-5b14-47f2-91b4-4d0bbebba54b None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:46.142925 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719034e-4995-46fd-9c7b-8e488f924030 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:46.173607 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:46.184417 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8eaef-65fc-4424-820c-3f0850247a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:46.185403 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8eaef-65fc-4424-820c-3f0850247a8a None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:46.185789 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8eaef-65fc-4424-820c-3f0850247a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:46.186164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8eaef-65fc-4424-820c-3f0850247a8a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:46.194558 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8eaef-65fc-4424-820c-3f0850247a8a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:46.196237 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8eaef-65fc-4424-820c-3f0850247a8a None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:46.200952 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955dcf1-5b14-47f2-91b4-4d0bbebba54b None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:46.212971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-cfe8eaef-65fc-4424-820c-3f0850247a8a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 12:07:46.212971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:46.212971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:46.212971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:46.212971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:46.212971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:46.212971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:46.212971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:46.212971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:46.212971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:46.212971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:46.212971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:46.212971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:07:46.212971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:07:46.212971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:07:46.212971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:07:46.214149 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:46.214149 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:46.214149 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:07:46.214149 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:46.214149 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:07:46.214149 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:46.214149 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:46.214149 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:46.214149 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:46.214149 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:46.214149 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:46.214149 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:46.214149 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:46.214149 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:46.214149 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:46.214149 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:46.214149 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:46.214149 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:46.215318 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:46.215318 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:46.215318 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:07:46.215318 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:07:46.215318 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:07:46.215318 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:07:46.215318 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:07:46.215318 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:07:46.215318 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 12:07:46.215318 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:46.217309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 338/680] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:07:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:46.218783 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa18546-30d9-4442-9ad9-b138c682339a None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:46.219239 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa18546-30d9-4442-9ad9-b138c682339a None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:46.219652 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa18546-30d9-4442-9ad9-b138c682339a None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:46.226481 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 339/681] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:46.227461 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa18546-30d9-4442-9ad9-b138c682339a None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:46.251958 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00aaa0b-f139-4fd3-8475-c50587011b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:46.253219 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00aaa0b-f139-4fd3-8475-c50587011b8c None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:46.253645 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00aaa0b-f139-4fd3-8475-c50587011b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:46.253926 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00aaa0b-f139-4fd3-8475-c50587011b8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:46.263341 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00aaa0b-f139-4fd3-8475-c50587011b8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:46.265041 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00aaa0b-f139-4fd3-8475-c50587011b8c None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:46.280637 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-b00aaa0b-f139-4fd3-8475-c50587011b8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:46.280637 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:46.280637 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:46.280637 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:46.280637 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:46.280637 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:46.280637 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:46.280637 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:46.280637 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:46.280637 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:46.280637 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:46.280637 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:46.280637 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:07:46.280637 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:07:46.280637 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:07:46.281825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:07:46.281825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:46.281825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:46.281825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:46.281825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:46.281825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:46.281825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:46.281825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:46.281825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:46.281825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:46.281825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:46.281825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:46.281825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:46.281825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:46.281825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:46.281825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:46.281825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:46.282842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:07:46.282842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:07:46.282842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:07:46.282842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:07:46.282842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:07:46.282842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:07:46.282842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:46.282842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:46.285152 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 343/682] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:46.287486 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc06fa7-bbc8-44fa-bb71-f42efb2d8fd5 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:46.287779 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc06fa7-bbc8-44fa-bb71-f42efb2d8fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:46.288059 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc06fa7-bbc8-44fa-bb71-f42efb2d8fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:46.306784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-edc06fa7-bbc8-44fa-bb71-f42efb2d8fd5 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:46.307926 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-edc06fa7-bbc8-44fa-bb71-f42efb2d8fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:46.349749 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa18546-30d9-4442-9ad9-b138c682339a None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:46.369115 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:46.387770 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b9583-4a8a-4a35-a661-638bcc779450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:46.388842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b9583-4a8a-4a35-a661-638bcc779450 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:46.389348 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b9583-4a8a-4a35-a661-638bcc779450 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:46.389836 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b9583-4a8a-4a35-a661-638bcc779450 None admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:46.394666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 344/683] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:46.394666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc06fa7-bbc8-44fa-bb71-f42efb2d8fd5 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:46.395313 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b9583-4a8a-4a35-a661-638bcc779450 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:46.395909 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b9583-4a8a-4a35-a661-638bcc779450 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:46.397578 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b9583-4a8a-4a35-a661-638bcc779450 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:46.430470 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 340/684] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Jun 29 12:07:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:46.435724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b9583-4a8a-4a35-a661-638bcc779450 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:46.485829 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:46.501721 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc06fa7-bbc8-44fa-bb71-f42efb2d8fd5 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:46.539800 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fc54f-cf97-456b-b266-3a0e6d61a738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:46.540432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fc54f-cf97-456b-b266-3a0e6d61a738 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:46.540715 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fc54f-cf97-456b-b266-3a0e6d61a738 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:46.540985 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fc54f-cf97-456b-b266-3a0e6d61a738 None admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:46.541897 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7fc54f-cf97-456b-b266-3a0e6d61a738 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:46.542205 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7fc54f-cf97-456b-b266-3a0e6d61a738 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:46.543686 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7fc54f-cf97-456b-b266-3a0e6d61a738 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:46.545091 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b9583-4a8a-4a35-a661-638bcc779450 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:46.556391 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 345/685] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:07:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:46.557346 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fc54f-cf97-456b-b266-3a0e6d61a738 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:46.580582 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e6d0a-7841-4315-95d9-be1637c02075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:46.581650 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e6d0a-7841-4315-95d9-be1637c02075 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:46.582168 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e6d0a-7841-4315-95d9-be1637c02075 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:46.582679 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e6d0a-7841-4315-95d9-be1637c02075 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:46.603555 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:46.658298 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e6d0a-7841-4315-95d9-be1637c02075 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:46.660112 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e6d0a-7841-4315-95d9-be1637c02075 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:46.665246 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fc54f-cf97-456b-b266-3a0e6d61a738 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:46.701214 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8debb9c-bb51-4bd3-b59f-5f376eed23db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:46.701703 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8debb9c-bb51-4bd3-b59f-5f376eed23db None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:46.701988 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8debb9c-bb51-4bd3-b59f-5f376eed23db None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:46.702262 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8debb9c-bb51-4bd3-b59f-5f376eed23db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:46.708847 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:46.715488 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8debb9c-bb51-4bd3-b59f-5f376eed23db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:46.717060 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8debb9c-bb51-4bd3-b59f-5f376eed23db None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:46.738408 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-e8debb9c-bb51-4bd3-b59f-5f376eed23db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:46.738408 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:46.738408 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:46.738408 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:46.738408 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:46.738408 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:46.738408 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:46.738408 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:46.738408 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:46.738408 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:46.738408 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:46.738408 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:46.738408 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:46.738408 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:46.738408 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:46.739470 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:46.739470 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:46.739470 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:46.739470 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:46.739470 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:46.739470 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:46.739470 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:46.739470 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:46.739470 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:46.739470 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:46.739470 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:46.739470 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:46.739470 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:46.739470 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:46.739470 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:46.739470 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:46.739470 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:46.740348 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:46.740348 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:46.740348 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:46.740348 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:46.744545 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 346/686] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:46.745554 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8debb9c-bb51-4bd3-b59f-5f376eed23db None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:46.769795 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 341/687] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 12:07:46.771542 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e6d0a-7841-4315-95d9-be1637c02075 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:46.848180 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:46.856226 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8debb9c-bb51-4bd3-b59f-5f376eed23db None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:46.874031 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e6d0a-7841-4315-95d9-be1637c02075 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:46.894107 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa524afb-bf99-431e-9973-ba8088f9e5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:46.894789 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa524afb-bf99-431e-9973-ba8088f9e5be None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:46.895073 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa524afb-bf99-431e-9973-ba8088f9e5be None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:46.895344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa524afb-bf99-431e-9973-ba8088f9e5be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:46.896895 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa524afb-bf99-431e-9973-ba8088f9e5be None admin] RBAC: Adding query filter params (role.id=0be824a9ecd0492f984e3b3b991e3984, scope.project.id=489877ae137244c5b83291671c703c99, user.id=50f5cc247f6b445f81fc3715d7bce92d) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:46.897205 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa524afb-bf99-431e-9973-ba8088f9e5be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:46.898875 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa524afb-bf99-431e-9973-ba8088f9e5be None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:46.905798 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 347/688] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:07:46 2022] GET /identity/v3/role_assignments?user.id=50f5cc247f6b445f81fc3715d7bce92d&scope.project.id=489877ae137244c5b83291671c703c99&role.id=0be824a9ecd0492f984e3b3b991e3984 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:46.906749 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa524afb-bf99-431e-9973-ba8088f9e5be None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:46.913417 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4806e80-d206-4ca6-aa47-82e33a028f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:46.914495 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4806e80-d206-4ca6-aa47-82e33a028f7d None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:46.915035 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4806e80-d206-4ca6-aa47-82e33a028f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:46.915539 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4806e80-d206-4ca6-aa47-82e33a028f7d None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:46.916480 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4806e80-d206-4ca6-aa47-82e33a028f7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:46.916993 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4806e80-d206-4ca6-aa47-82e33a028f7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:46.918590 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4806e80-d206-4ca6-aa47-82e33a028f7d None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:46.932296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 342/689] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:46.945942 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4806e80-d206-4ca6-aa47-82e33a028f7d None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:46.954798 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:47.030268 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa524afb-bf99-431e-9973-ba8088f9e5be None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:47.071759 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b982df-addc-4c96-8b3e-88f2dbff9970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:47.072115 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b982df-addc-4c96-8b3e-88f2dbff9970 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:47.072441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b982df-addc-4c96-8b3e-88f2dbff9970 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:47.072757 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b982df-addc-4c96-8b3e-88f2dbff9970 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:47.086542 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b982df-addc-4c96-8b3e-88f2dbff9970 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:47.087689 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b982df-addc-4c96-8b3e-88f2dbff9970 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:47.105878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-28b982df-addc-4c96-8b3e-88f2dbff9970 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:47.105878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:47.105878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:47.105878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:47.105878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:47.105878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:47.105878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:47.105878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:47.105878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:47.105878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:47.105878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:47.105878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:47.105878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:47.105878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:47.105878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:47.106867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:47.106867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:47.106867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:47.106867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:47.106867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:47.106867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:47.106867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:47.106867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:47.106867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:47.106867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:47.106867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:47.106867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:47.106867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:47.106867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:47.106867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:47.106867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:47.106867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:47.107766 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:47.107766 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:47.107766 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:47.107766 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:47.107766 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 348/690] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:47.112476 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b982df-addc-4c96-8b3e-88f2dbff9970 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:47.120900 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4806e80-d206-4ca6-aa47-82e33a028f7d None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:47.126847 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:47.172964 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffa13c-8fdf-4c14-9dea-6134f92d33d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:47.174207 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffa13c-8fdf-4c14-9dea-6134f92d33d0 None admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:47.174692 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffa13c-8fdf-4c14-9dea-6134f92d33d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:47.175168 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffa13c-8fdf-4c14-9dea-6134f92d33d0 None admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:47.176488 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffa13c-8fdf-4c14-9dea-6134f92d33d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:47.179096 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffa13c-8fdf-4c14-9dea-6134f92d33d0 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:47.217061 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 343/691] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 29 12:07:46 2022] POST /identity/v3/users => generated 254 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:07:47.238511 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b982df-addc-4c96-8b3e-88f2dbff9970 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:47.280468 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d57b4-8608-4bd5-ac06-7d748fc693ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:47.281148 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d57b4-8608-4bd5-ac06-7d748fc693ae None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:47.281483 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d57b4-8608-4bd5-ac06-7d748fc693ae None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:47.281763 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d57b4-8608-4bd5-ac06-7d748fc693ae None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:47.282495 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d57b4-8608-4bd5-ac06-7d748fc693ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:47.282832 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d57b4-8608-4bd5-ac06-7d748fc693ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:47.284350 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d57b4-8608-4bd5-ac06-7d748fc693ae None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:47.297872 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 349/692] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:47.304664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffa13c-8fdf-4c14-9dea-6134f92d33d0 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:47.347591 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a51751-fd68-4a0c-a952-8b7446097bf3 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:47.347899 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a51751-fd68-4a0c-a952-8b7446097bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:47.348141 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a51751-fd68-4a0c-a952-8b7446097bf3 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:47.351025 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 350/693] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:07:47.356090 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4c257-079f-416b-bcb5-b213e1d00b39 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:47.356382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4c257-079f-416b-bcb5-b213e1d00b39 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:47.356660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4c257-079f-416b-bcb5-b213e1d00b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:47.387023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-bfb4c257-079f-416b-bcb5-b213e1d00b39 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:47.392102 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-bfb4c257-079f-416b-bcb5-b213e1d00b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:47.403117 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:47.477490 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffa13c-8fdf-4c14-9dea-6134f92d33d0 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:47.501823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 351/694] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:07:47.502512 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:47.516785 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45622f-1590-428f-9ecf-e33ac4200adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:47.517593 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45622f-1590-428f-9ecf-e33ac4200adf None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:47.517884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45622f-1590-428f-9ecf-e33ac4200adf None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:47.518166 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45622f-1590-428f-9ecf-e33ac4200adf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:47.525501 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45622f-1590-428f-9ecf-e33ac4200adf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:47.527072 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45622f-1590-428f-9ecf-e33ac4200adf None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:47.528171 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4c257-079f-416b-bcb5-b213e1d00b39 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:47.544581 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-5b45622f-1590-428f-9ecf-e33ac4200adf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:47.544581 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:47.544581 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:47.544581 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:47.544581 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:47.544581 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:47.544581 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:47.544581 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:47.544581 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:47.544581 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:47.544581 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:47.544581 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:47.544581 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:07:47.544581 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:07:47.544581 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:07:47.545505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:07:47.545505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:47.545505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:47.545505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:47.545505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:47.545505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:47.545505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:47.545505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:47.545505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:47.545505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:47.545505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:47.545505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:47.545505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:47.545505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:47.545505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:47.545505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:47.545505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:47.546405 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:07:47.546405 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:07:47.546405 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:07:47.546405 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:07:47.546405 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:07:47.546405 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:07:47.546405 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:47.546405 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:47.547023 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 344/695] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:47.553431 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45622f-1590-428f-9ecf-e33ac4200adf None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:47.655699 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4c257-079f-416b-bcb5-b213e1d00b39 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:47.697433 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45622f-1590-428f-9ecf-e33ac4200adf None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:47.704167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34b4f4-e04e-4d68-9e8c-69158ab9f9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:47.704976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34b4f4-e04e-4d68-9e8c-69158ab9f9fa None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:47.705303 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34b4f4-e04e-4d68-9e8c-69158ab9f9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:47.705538 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34b4f4-e04e-4d68-9e8c-69158ab9f9fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:47.718319 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34b4f4-e04e-4d68-9e8c-69158ab9f9fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:47.723007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:47.738386 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38154b2f-d67d-477f-8594-c330fa9411e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:47.739269 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38154b2f-d67d-477f-8594-c330fa9411e7 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:47.739965 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38154b2f-d67d-477f-8594-c330fa9411e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:47.740248 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38154b2f-d67d-477f-8594-c330fa9411e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:47.741038 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38154b2f-d67d-477f-8594-c330fa9411e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:47.741350 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38154b2f-d67d-477f-8594-c330fa9411e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:47.742330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-5d34b4f4-e04e-4d68-9e8c-69158ab9f9fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:07:47.742330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:47.742330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:47.742330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:47.742330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:47.742330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:47.742330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:47.742330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:47.742330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:47.742330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:47.742330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:47.742330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:47.742330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:47.742330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:47.742330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:47.742330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:47.743326 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:47.743326 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:47.743326 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:47.743326 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:47.743326 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:47.743326 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:47.743326 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:47.743326 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:47.743326 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:47.743326 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:47.743326 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:47.743326 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:47.743326 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:47.743326 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:47.743326 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:47.743326 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:47.744186 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:47.744186 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:47.744186 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:47.744186 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:47.744186 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:47.744186 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:47.744186 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:47.744186 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:47.744186 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:47.744186 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:47.744186 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:07:47.744186 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:47.744831 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38154b2f-d67d-477f-8594-c330fa9411e7 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:47.747161 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 352/696] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:07:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:07:47.753126 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34b4f4-e04e-4d68-9e8c-69158ab9f9fa None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:47.755316 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 345/697] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:07:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:47.771693 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38154b2f-d67d-477f-8594-c330fa9411e7 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:47.830810 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:47.880938 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38154b2f-d67d-477f-8594-c330fa9411e7 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:47.902477 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34b4f4-e04e-4d68-9e8c-69158ab9f9fa None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:47.917463 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeca5e6-bce6-4a1a-86e2-f38f499c9951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:47.918320 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeca5e6-bce6-4a1a-86e2-f38f499c9951 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:47.918686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeca5e6-bce6-4a1a-86e2-f38f499c9951 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:47.919235 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeca5e6-bce6-4a1a-86e2-f38f499c9951 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:47.926465 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeca5e6-bce6-4a1a-86e2-f38f499c9951 None admin] RBAC: Adding query filter params (role.id=0be824a9ecd0492f984e3b3b991e3984, scope.project.id=489877ae137244c5b83291671c703c99, user.id=11efdbeeaa5c428aa344f7f0f5b061ba) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:47.926465 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeca5e6-bce6-4a1a-86e2-f38f499c9951 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:47.926465 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeca5e6-bce6-4a1a-86e2-f38f499c9951 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:47.929324 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 346/698] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:07:47 2022] GET /identity/v3/role_assignments?user.id=11efdbeeaa5c428aa344f7f0f5b061ba&scope.project.id=489877ae137244c5b83291671c703c99&role.id=0be824a9ecd0492f984e3b3b991e3984 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:47.953449 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70354442-bc18-40a4-a25e-f1f7f0637e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:47.954733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70354442-bc18-40a4-a25e-f1f7f0637e08 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:47.962670 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70354442-bc18-40a4-a25e-f1f7f0637e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:47.963508 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70354442-bc18-40a4-a25e-f1f7f0637e08 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:47.964541 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70354442-bc18-40a4-a25e-f1f7f0637e08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:47.965074 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70354442-bc18-40a4-a25e-f1f7f0637e08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:47.966749 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70354442-bc18-40a4-a25e-f1f7f0637e08 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:47.983324 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 353/699] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:07:47.990085 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeca5e6-bce6-4a1a-86e2-f38f499c9951 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:48.075064 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:48.140111 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeca5e6-bce6-4a1a-86e2-f38f499c9951 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:48.180183 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997d014-65fd-4bbc-94c9-6d7f0e7fcb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:48.181041 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997d014-65fd-4bbc-94c9-6d7f0e7fcb3b None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:48.181322 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997d014-65fd-4bbc-94c9-6d7f0e7fcb3b None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:48.181642 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997d014-65fd-4bbc-94c9-6d7f0e7fcb3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:48.193317 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6997d014-65fd-4bbc-94c9-6d7f0e7fcb3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:48.194819 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6997d014-65fd-4bbc-94c9-6d7f0e7fcb3b None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:48.212827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-6997d014-65fd-4bbc-94c9-6d7f0e7fcb3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:48.212827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:48.212827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:48.212827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:48.212827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:48.212827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:48.212827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:48.212827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:48.212827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:48.212827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:48.212827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:48.212827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:48.212827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:48.212827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:48.212827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:48.213742 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:48.213742 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:48.213742 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:48.213742 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:48.213742 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:48.213742 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:48.213742 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:48.213742 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:48.213742 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:48.213742 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:48.213742 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:48.213742 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:48.213742 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:48.213742 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:48.213742 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:48.213742 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:48.213742 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:48.214664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:48.214664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:48.214664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:48.214664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:48.214664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 347/700] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:48.220310 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70354442-bc18-40a4-a25e-f1f7f0637e08 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:48.332475 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70354442-bc18-40a4-a25e-f1f7f0637e08 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:48.356861 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:48.369140 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901aaa3-0c43-42d0-9eff-75979363163a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:48.369810 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901aaa3-0c43-42d0-9eff-75979363163a None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:48.370097 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901aaa3-0c43-42d0-9eff-75979363163a None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:48.370376 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901aaa3-0c43-42d0-9eff-75979363163a None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:48.371145 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901aaa3-0c43-42d0-9eff-75979363163a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:48.371457 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901aaa3-0c43-42d0-9eff-75979363163a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:48.372845 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901aaa3-0c43-42d0-9eff-75979363163a None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:48.386969 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 354/701] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:48.392315 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997d014-65fd-4bbc-94c9-6d7f0e7fcb3b None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:48.536391 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1b74c-176a-4c5f-8e3a-3edf9b644db4 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:48.536946 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1b74c-176a-4c5f-8e3a-3edf9b644db4 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:48.537269 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1b74c-176a-4c5f-8e3a-3edf9b644db4 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:48.540770 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 355/702] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:07:48.551674 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7aae1-b572-4eda-ae98-efa4c872f9f7 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:48.551957 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7aae1-b572-4eda-ae98-efa4c872f9f7 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:48.552234 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7aae1-b572-4eda-ae98-efa4c872f9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:48.560199 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:48.574096 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997d014-65fd-4bbc-94c9-6d7f0e7fcb3b None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:48.580238 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-99a7aae1-b572-4eda-ae98-efa4c872f9f7 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:48.581437 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-99a7aae1-b572-4eda-ae98-efa4c872f9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:48.641696 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae8933-f975-4e60-a6fb-1eb5764223de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:48.642423 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae8933-f975-4e60-a6fb-1eb5764223de None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:48.642733 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae8933-f975-4e60-a6fb-1eb5764223de None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:48.643015 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae8933-f975-4e60-a6fb-1eb5764223de None admin] PATH_INFO: `/v3/users/nova` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:48.664493 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae8933-f975-4e60-a6fb-1eb5764223de None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:48.665977 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae8933-f975-4e60-a6fb-1eb5764223de None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:48.685819 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-86ae8933-f975-4e60-a6fb-1eb5764223de None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:07:48.685819 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:48.685819 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:48.685819 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:48.685819 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:48.685819 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:48.685819 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:48.685819 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:48.685819 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:48.685819 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:48.685819 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:48.685819 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:48.685819 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:07:48.685819 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:07:48.685819 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:07:48.685819 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:07:48.686842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:48.686842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:48.686842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:07:48.686842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:48.686842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:07:48.686842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:48.686842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:48.686842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:48.686842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:48.686842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:48.686842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:48.686842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:48.686842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:48.686842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:48.686842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:48.686842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:48.686842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:48.686842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:48.687870 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:48.687870 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:48.687870 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:07:48.687870 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:07:48.687870 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:07:48.687870 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:07:48.687870 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:07:48.687870 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:07:48.687870 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:07:48.687870 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:48.687870 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 348/703] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Jun 29 12:07:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:48.697782 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae8933-f975-4e60-a6fb-1eb5764223de None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:48.717730 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 356/704] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:07:48.756572 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7aae1-b572-4eda-ae98-efa4c872f9f7 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:48.883177 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae8933-f975-4e60-a6fb-1eb5764223de None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:48.898730 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7aae1-b572-4eda-ae98-efa4c872f9f7 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:48.909343 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:48.932512 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfd749-5296-4b95-84fa-4fe8a8ec54bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:48.933323 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfd749-5296-4b95-84fa-4fe8a8ec54bc None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:48.933603 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfd749-5296-4b95-84fa-4fe8a8ec54bc None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:48.933873 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfd749-5296-4b95-84fa-4fe8a8ec54bc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:48.934520 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbfd749-5296-4b95-84fa-4fe8a8ec54bc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:48.936220 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbfd749-5296-4b95-84fa-4fe8a8ec54bc None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:48.950553 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-4cbfd749-5296-4b95-84fa-4fe8a8ec54bc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 12:07:48.950553 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:48.950553 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:07:48.950553 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:07:48.950553 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:07:48.950553 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:07:48.950553 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:07:48.950553 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:07:48.950553 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 12:07:48.950553 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:48.950553 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:07:48.950553 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:48.950553 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:48.950553 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:48.950553 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:48.950553 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:48.951785 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:48.951785 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:48.951785 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:48.951785 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:48.951785 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:48.951785 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:48.951785 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:48.951785 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:07:48.951785 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:07:48.951785 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:07:48.951785 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:07:48.951785 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:48.951785 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:48.951785 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:48.951785 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:48.951785 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:48.952866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:48.952866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:48.952866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:48.952866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:48.952866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:48.952866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:48.952866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:48.952866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:48.952866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:48.952866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:48.952866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:48.952866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:07:48.952866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:07:48.952866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 12:07:48.952866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:48.955047 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 357/705] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Jun 29 12:07:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:48.959507 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6548e-40d7-44da-b24d-618d60b69828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:48.960212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6548e-40d7-44da-b24d-618d60b69828 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:48.960498 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6548e-40d7-44da-b24d-618d60b69828 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:48.960782 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6548e-40d7-44da-b24d-618d60b69828 None admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:48.961629 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6548e-40d7-44da-b24d-618d60b69828 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:48.961947 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6548e-40d7-44da-b24d-618d60b69828 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:48.963534 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfd749-5296-4b95-84fa-4fe8a8ec54bc None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:48.965054 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6548e-40d7-44da-b24d-618d60b69828 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:49.003259 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 349/706] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Jun 29 12:07:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:49.004477 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6548e-40d7-44da-b24d-618d60b69828 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:49.022487 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:49.124690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6548e-40d7-44da-b24d-618d60b69828 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:49.172661 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfd749-5296-4b95-84fa-4fe8a8ec54bc None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:49.193352 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ad9b9-675b-4358-8ef2-56d88fc2ddb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:49.194069 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ad9b9-675b-4358-8ef2-56d88fc2ddb9 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:49.194353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ad9b9-675b-4358-8ef2-56d88fc2ddb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:49.194627 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ad9b9-675b-4358-8ef2-56d88fc2ddb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:49.245523 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7a770-cecc-46f6-ab2b-6505859c53c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:49.246199 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7a770-cecc-46f6-ab2b-6505859c53c0 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:49.246539 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7a770-cecc-46f6-ab2b-6505859c53c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:49.246815 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7a770-cecc-46f6-ab2b-6505859c53c0 None admin] PATH_INFO: `/v3/services` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:49.247520 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7a770-cecc-46f6-ab2b-6505859c53c0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:49.247823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7a770-cecc-46f6-ab2b-6505859c53c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:49.249370 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7a770-cecc-46f6-ab2b-6505859c53c0 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:49.259996 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 358/707] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Jun 29 12:07:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:49.261434 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7a770-cecc-46f6-ab2b-6505859c53c0 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:49.305590 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:49.330196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ad9b9-675b-4358-8ef2-56d88fc2ddb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:49.331706 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ad9b9-675b-4358-8ef2-56d88fc2ddb9 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:49.363024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:49.370546 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7a770-cecc-46f6-ab2b-6505859c53c0 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:49.407294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4fe4b-89d6-4499-98f1-a49f3241d580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:49.407957 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4fe4b-89d6-4499-98f1-a49f3241d580 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:49.408237 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4fe4b-89d6-4499-98f1-a49f3241d580 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:49.408514 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4fe4b-89d6-4499-98f1-a49f3241d580 None admin] PATH_INFO: `/v3/services` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:49.409215 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4fe4b-89d6-4499-98f1-a49f3241d580 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:49.409521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4fe4b-89d6-4499-98f1-a49f3241d580 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:49.410945 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4fe4b-89d6-4499-98f1-a49f3241d580 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:49.422875 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 359/708] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Jun 29 12:07:49 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:49.533057 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 350/709] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:49.539972 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4fe4b-89d6-4499-98f1-a49f3241d580 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:49.562587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676abab-e834-41f2-8433-22a38d1ce3d8 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:49.563129 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676abab-e834-41f2-8433-22a38d1ce3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:49.563429 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676abab-e834-41f2-8433-22a38d1ce3d8 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:49.565123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 351/710] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:07:49.571228 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51499fb-6685-4d08-984d-7612dd24a467 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:49.571524 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51499fb-6685-4d08-984d-7612dd24a467 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:49.571789 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51499fb-6685-4d08-984d-7612dd24a467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:49.589343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-c51499fb-6685-4d08-984d-7612dd24a467 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:49.590686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-c51499fb-6685-4d08-984d-7612dd24a467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:49.689924 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 352/711] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:07:49.700127 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4fe4b-89d6-4499-98f1-a49f3241d580 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:49.702924 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:49.722521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51499fb-6685-4d08-984d-7612dd24a467 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:49.744589 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8b64e-e9e5-465f-8d32-0ef02e77207f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:49.745443 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8b64e-e9e5-465f-8d32-0ef02e77207f None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:49.745724 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8b64e-e9e5-465f-8d32-0ef02e77207f None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:49.745997 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8b64e-e9e5-465f-8d32-0ef02e77207f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:49.763716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8b64e-e9e5-465f-8d32-0ef02e77207f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:49.765177 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8b64e-e9e5-465f-8d32-0ef02e77207f None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:49.799751 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-e5c8b64e-e9e5-465f-8d32-0ef02e77207f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:49.799751 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:49.799751 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:49.799751 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:49.799751 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:49.799751 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:49.799751 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:49.799751 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:49.799751 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:49.799751 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:49.799751 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:49.799751 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:49.799751 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:49.799751 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:49.799751 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:49.800734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:49.800734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:49.800734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:49.800734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:49.800734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:49.800734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:49.800734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:49.800734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:49.800734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:49.800734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:49.800734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:49.800734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:49.800734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:49.800734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:49.800734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:49.800734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:49.800734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:49.802233 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:49.802233 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:49.802233 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:49.802233 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:49.807449 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 360/712] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:49.810998 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:49.811425 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8b64e-e9e5-465f-8d32-0ef02e77207f None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:49.916422 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51499fb-6685-4d08-984d-7612dd24a467 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:49.964914 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8b64e-e9e5-465f-8d32-0ef02e77207f None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:49.980697 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65145451-c5cb-4ddd-8de4-583050ed04b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:49.981842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65145451-c5cb-4ddd-8de4-583050ed04b6 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:49.982377 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65145451-c5cb-4ddd-8de4-583050ed04b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:49.982904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65145451-c5cb-4ddd-8de4-583050ed04b6 None admin] PATH_INFO: `/v3/services/network` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:49.983780 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65145451-c5cb-4ddd-8de4-583050ed04b6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:49.985357 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65145451-c5cb-4ddd-8de4-583050ed04b6 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:50.007380 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64c6b8-f47f-43a9-964c-575d8d7d9ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:50.008036 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64c6b8-f47f-43a9-964c-575d8d7d9ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:50.008320 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64c6b8-f47f-43a9-964c-575d8d7d9ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:50.008587 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64c6b8-f47f-43a9-964c-575d8d7d9ed5 None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:50.009305 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64c6b8-f47f-43a9-964c-575d8d7d9ed5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:50.009613 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64c6b8-f47f-43a9-964c-575d8d7d9ed5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:50.011077 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64c6b8-f47f-43a9-964c-575d8d7d9ed5 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:50.013587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-65145451-c5cb-4ddd-8de4-583050ed04b6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 12:07:50.013587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:50.013587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:07:50.013587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:07:50.013587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:07:50.013587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:07:50.013587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:07:50.013587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:07:50.013587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 12:07:50.013587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:50.013587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:07:50.013587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:50.013587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:50.013587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:50.013587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:50.013587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:50.013587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:50.014679 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:50.014679 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:50.014679 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:50.014679 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:50.014679 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:50.014679 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:50.014679 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:07:50.014679 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:07:50.014679 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:07:50.014679 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:07:50.014679 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:50.014679 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:50.014679 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:50.014679 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:50.014679 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:50.014679 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:50.015544 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:50.015544 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:50.015544 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:50.015544 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:50.015544 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:50.015544 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:50.015544 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:50.015544 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:50.015544 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:50.015544 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:50.015544 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:07:50.015544 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:07:50.015544 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 12:07:50.015544 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:50.022992 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 353/713] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:49 2022] GET /identity/v3/services/network => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:07:50.023922 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65145451-c5cb-4ddd-8de4-583050ed04b6 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:50.032594 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 361/714] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:50.040073 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64c6b8-f47f-43a9-964c-575d8d7d9ed5 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:50.060748 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:50.160811 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65145451-c5cb-4ddd-8de4-583050ed04b6 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:50.162236 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64c6b8-f47f-43a9-964c-575d8d7d9ed5 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:50.172902 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:50.199847 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb797c7-9102-4177-abc0-35ea65e95aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:50.200538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb797c7-9102-4177-abc0-35ea65e95aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:50.200817 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb797c7-9102-4177-abc0-35ea65e95aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:50.201089 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb797c7-9102-4177-abc0-35ea65e95aa1 None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:50.201790 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb797c7-9102-4177-abc0-35ea65e95aa1 None admin] RBAC: Adding query filter params (name=network) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:50.202094 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb797c7-9102-4177-abc0-35ea65e95aa1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:50.203502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb797c7-9102-4177-abc0-35ea65e95aa1 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:50.207580 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bf451-ac97-4468-80e5-054c7ea4a5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:50.208494 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 354/715] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Jun 29 12:07:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:50.209015 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bf451-ac97-4468-80e5-054c7ea4a5d7 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:50.209500 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bf451-ac97-4468-80e5-054c7ea4a5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:50.209960 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af824ab0-032f-4e3d-b650-9a9f11eabb70 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:50.210207 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bf451-ac97-4468-80e5-054c7ea4a5d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:50.210309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af824ab0-032f-4e3d-b650-9a9f11eabb70 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:50.210577 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af824ab0-032f-4e3d-b650-9a9f11eabb70 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:50.215983 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 355/716] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:50.215983 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af824ab0-032f-4e3d-b650-9a9f11eabb70 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:50.222263 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bf451-ac97-4468-80e5-054c7ea4a5d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:50.224544 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bf451-ac97-4468-80e5-054c7ea4a5d7 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:50.240977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-da6bf451-ac97-4468-80e5-054c7ea4a5d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:50.240977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:50.240977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:50.240977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:50.240977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:50.240977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:50.240977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:50.240977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:50.240977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:50.240977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:50.240977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:50.240977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:50.240977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:07:50.240977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:07:50.240977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:07:50.242106 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:07:50.242106 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:50.242106 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:50.242106 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:50.242106 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:50.242106 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:50.242106 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:50.242106 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:50.242106 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:50.242106 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:50.242106 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:50.242106 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:50.242106 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:50.242106 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:50.242106 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:50.242106 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:50.242106 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:50.243291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:07:50.243291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:07:50.243291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:07:50.243291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:07:50.243291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:07:50.243291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:07:50.243291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:50.243291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:50.249778 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 362/717] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:07:50.251543 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76ba2d-aa21-48bc-98c3-0deda8b67544 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:50.251933 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76ba2d-aa21-48bc-98c3-0deda8b67544 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:50.252306 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76ba2d-aa21-48bc-98c3-0deda8b67544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:50.272471 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-3d76ba2d-aa21-48bc-98c3-0deda8b67544 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:50.273814 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-3d76ba2d-aa21-48bc-98c3-0deda8b67544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:50.347350 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af824ab0-032f-4e3d-b650-9a9f11eabb70 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:50.354656 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 363/718] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:50.354656 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76ba2d-aa21-48bc-98c3-0deda8b67544 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:50.368468 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:50.408024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187744a-9493-4cd0-ab9a-f7cb4c0ae447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:50.408755 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187744a-9493-4cd0-ab9a-f7cb4c0ae447 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:50.409041 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187744a-9493-4cd0-ab9a-f7cb4c0ae447 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:50.409311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187744a-9493-4cd0-ab9a-f7cb4c0ae447 None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:50.410005 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187744a-9493-4cd0-ab9a-f7cb4c0ae447 None admin] RBAC: Adding query filter params (type=network) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:50.410309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187744a-9493-4cd0-ab9a-f7cb4c0ae447 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:50.412690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187744a-9493-4cd0-ab9a-f7cb4c0ae447 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:50.419774 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 356/719] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Jun 29 12:07:50 2022] GET /identity/v3/services?type=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:50.420556 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187744a-9493-4cd0-ab9a-f7cb4c0ae447 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:50.464936 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:50.503110 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76ba2d-aa21-48bc-98c3-0deda8b67544 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:50.543262 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187744a-9493-4cd0-ab9a-f7cb4c0ae447 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:50.561847 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1c20f-3235-45d1-bf82-6eb5e24b40c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:50.562524 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1c20f-3235-45d1-bf82-6eb5e24b40c7 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:50.564366 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1c20f-3235-45d1-bf82-6eb5e24b40c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:50.564554 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1c20f-3235-45d1-bf82-6eb5e24b40c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:50.565355 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1c20f-3235-45d1-bf82-6eb5e24b40c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:50.565663 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1c20f-3235-45d1-bf82-6eb5e24b40c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:50.567218 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1c20f-3235-45d1-bf82-6eb5e24b40c7 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:50.601087 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 364/720] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:07:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:50.605262 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1c20f-3235-45d1-bf82-6eb5e24b40c7 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:50.632953 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e17912-f755-410c-83ad-8ce15788ad19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:50.633753 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e17912-f755-410c-83ad-8ce15788ad19 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:50.634086 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e17912-f755-410c-83ad-8ce15788ad19 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:50.634408 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e17912-f755-410c-83ad-8ce15788ad19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:50.649554 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e17912-f755-410c-83ad-8ce15788ad19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:50.657263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-38e17912-f755-410c-83ad-8ce15788ad19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:07:50.657263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:50.657263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:50.657263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:50.657263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:50.657263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:50.657263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:50.657263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:50.657263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:50.657263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:50.657263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:50.657263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:50.657263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:50.657263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:50.657263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:50.657263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:50.658277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:50.658277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:50.658277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:50.658277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:50.658277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:50.658277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:50.658277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:50.658277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:50.658277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:50.658277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:50.658277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:50.658277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:50.658277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:50.658277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:50.658277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:50.658277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:50.659157 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:50.659157 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:50.659157 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:50.659157 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:50.659157 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:50.659157 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:50.659157 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:50.659157 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:50.659157 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:50.659157 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:50.659157 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:07:50.659157 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:50.659157 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 357/721] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 29 12:07:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:50.660321 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec850255-0b16-421c-b700-0216cb9cf648 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:50.660670 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec850255-0b16-421c-b700-0216cb9cf648 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:50.661018 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec850255-0b16-421c-b700-0216cb9cf648 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:50.663071 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 358/722] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:50.668035 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec850255-0b16-421c-b700-0216cb9cf648 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:50.695949 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:50.748140 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1c20f-3235-45d1-bf82-6eb5e24b40c7 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:50.781673 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:50.791291 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec850255-0b16-421c-b700-0216cb9cf648 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:50.792547 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8f522-ef5e-424f-8141-05b351ae359d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:50.793424 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8f522-ef5e-424f-8141-05b351ae359d None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:50.793985 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8f522-ef5e-424f-8141-05b351ae359d None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:50.794556 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8f522-ef5e-424f-8141-05b351ae359d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:50.795667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8f522-ef5e-424f-8141-05b351ae359d None admin] RBAC: Adding query filter params (role.id=5ef3464f4436446b88430cdf7cc1a3d7, scope.project.id=489877ae137244c5b83291671c703c99, user.id=3fbcf547421b42e4b520f9246326bff8) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:50.796200 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8f522-ef5e-424f-8141-05b351ae359d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:50.797914 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8f522-ef5e-424f-8141-05b351ae359d None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:50.805521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 365/723] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:07:50 2022] GET /identity/v3/role_assignments?user.id=3fbcf547421b42e4b520f9246326bff8&scope.project.id=489877ae137244c5b83291671c703c99&role.id=5ef3464f4436446b88430cdf7cc1a3d7 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:50.807256 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247d928-6bee-415f-9763-fb9cd775a63c None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:50.807863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247d928-6bee-415f-9763-fb9cd775a63c None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:50.808351 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247d928-6bee-415f-9763-fb9cd775a63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:50.828052 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-5247d928-6bee-415f-9763-fb9cd775a63c None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:50.829726 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-5247d928-6bee-415f-9763-fb9cd775a63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:50.835075 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d9381-acf0-4f6e-83a8-ce3c92fcf2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:50.835774 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d9381-acf0-4f6e-83a8-ce3c92fcf2da None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:50.836059 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d9381-acf0-4f6e-83a8-ce3c92fcf2da None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:50.836336 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d9381-acf0-4f6e-83a8-ce3c92fcf2da None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:50.837114 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d9381-acf0-4f6e-83a8-ce3c92fcf2da None admin] RBAC: Adding query filter params (name=service) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:50.837425 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d9381-acf0-4f6e-83a8-ce3c92fcf2da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:50.838906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d9381-acf0-4f6e-83a8-ce3c92fcf2da None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:50.850891 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 359/724] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 29 12:07:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:50.863696 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d9381-acf0-4f6e-83a8-ce3c92fcf2da None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:50.913971 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 366/725] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:50.998485 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247d928-6bee-415f-9763-fb9cd775a63c None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:51.019324 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d9381-acf0-4f6e-83a8-ce3c92fcf2da None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:51.079440 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9ddc1-7c0d-4622-a490-e9b7d77131a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:51.080178 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9ddc1-7c0d-4622-a490-e9b7d77131a3 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:51.080463 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9ddc1-7c0d-4622-a490-e9b7d77131a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:51.080741 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9ddc1-7c0d-4622-a490-e9b7d77131a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:51.091962 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9ddc1-7c0d-4622-a490-e9b7d77131a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:51.092838 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:51.093627 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9ddc1-7c0d-4622-a490-e9b7d77131a3 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:51.127808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-73b9ddc1-7c0d-4622-a490-e9b7d77131a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:51.127808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:51.127808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:51.127808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:51.127808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:51.127808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:51.127808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:51.127808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:51.127808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:51.127808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:51.127808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:51.127808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:51.127808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:51.127808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:51.127808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:51.128765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:51.128765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:51.128765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:51.128765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:51.128765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:51.128765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:51.128765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:51.128765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:51.128765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:51.128765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:51.128765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:51.128765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:51.128765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:51.128765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:51.128765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:51.128765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:51.128765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:51.130283 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:51.130283 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:51.130283 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:51.130283 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:51.136480 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 360/726] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:51.140695 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247d928-6bee-415f-9763-fb9cd775a63c None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:51.143847 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9ddc1-7c0d-4622-a490-e9b7d77131a3 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:51.160548 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:51.179636 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e322c-6cf3-4afc-ba37-f9de923c52dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:51.180773 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e322c-6cf3-4afc-ba37-f9de923c52dd None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:51.181278 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e322c-6cf3-4afc-ba37-f9de923c52dd None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:51.181827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e322c-6cf3-4afc-ba37-f9de923c52dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:51.194123 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e322c-6cf3-4afc-ba37-f9de923c52dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:51.202304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-358e322c-6cf3-4afc-ba37-f9de923c52dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:07:51.202304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:51.202304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:51.202304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:51.202304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:51.202304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:51.202304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:51.202304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:51.202304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:51.202304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:51.202304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:51.202304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:51.202304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:51.202304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:51.202304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:51.202304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:51.203265 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:51.203265 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:51.203265 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:51.203265 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:51.203265 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:51.203265 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:51.203265 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:51.203265 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:51.203265 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:51.203265 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:51.203265 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:51.203265 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:51.203265 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:51.203265 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:51.203265 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:51.203265 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:51.204121 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:51.204121 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:51.204121 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:51.204121 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:51.204121 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:51.204121 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:51.204121 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:51.204121 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:51.204121 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:51.204121 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:51.204121 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:07:51.204121 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:51.206923 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 367/727] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:07:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:07:51.213016 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e322c-6cf3-4afc-ba37-f9de923c52dd None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:51.330531 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9ddc1-7c0d-4622-a490-e9b7d77131a3 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:51.406470 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700cae3-665b-4f44-af8d-33ade30deb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:51.408665 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700cae3-665b-4f44-af8d-33ade30deb4c None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:51.409239 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700cae3-665b-4f44-af8d-33ade30deb4c None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:51.410583 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700cae3-665b-4f44-af8d-33ade30deb4c None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:51.414887 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e322c-6cf3-4afc-ba37-f9de923c52dd None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:51.419482 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700cae3-665b-4f44-af8d-33ade30deb4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:51.419814 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700cae3-665b-4f44-af8d-33ade30deb4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:51.421246 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700cae3-665b-4f44-af8d-33ade30deb4c None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:51.442567 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:51.447388 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 361/728] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:51.454659 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700cae3-665b-4f44-af8d-33ade30deb4c None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:51.471953 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d517dc6-0861-4734-872a-8c47e7d1e581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:51.472630 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d517dc6-0861-4734-872a-8c47e7d1e581 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:51.472908 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d517dc6-0861-4734-872a-8c47e7d1e581 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:51.473181 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d517dc6-0861-4734-872a-8c47e7d1e581 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:51.474567 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d517dc6-0861-4734-872a-8c47e7d1e581 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:51.474964 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d517dc6-0861-4734-872a-8c47e7d1e581 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:51.476357 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d517dc6-0861-4734-872a-8c47e7d1e581 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:51.497920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 368/729] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:51.502888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d517dc6-0861-4734-872a-8c47e7d1e581 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:51.606857 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:51.652772 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d517dc6-0861-4734-872a-8c47e7d1e581 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:51.682329 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700cae3-665b-4f44-af8d-33ade30deb4c None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:51.693213 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf502876-6d65-4e7b-9a9d-153c07812374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:51.694142 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf502876-6d65-4e7b-9a9d-153c07812374 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:51.694471 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf502876-6d65-4e7b-9a9d-153c07812374 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:51.694832 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf502876-6d65-4e7b-9a9d-153c07812374 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:51.708481 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf502876-6d65-4e7b-9a9d-153c07812374 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:51.709987 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf502876-6d65-4e7b-9a9d-153c07812374 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:51.730353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-cf502876-6d65-4e7b-9a9d-153c07812374 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:51.730353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:51.730353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:51.730353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:51.730353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:51.730353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:51.730353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:51.730353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:51.730353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:51.730353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:51.730353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:51.730353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:51.730353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:51.730353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:51.730353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:51.731290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:51.731290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:51.731290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:51.731290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:51.731290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:51.731290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:51.731290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:51.731290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:51.731290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:51.731290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:51.731290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:51.731290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:51.731290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:51.731290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:51.731290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:51.731290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:51.731290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:51.732188 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:51.732188 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:51.732188 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:51.732188 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:51.732188 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 369/730] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:07:51.740314 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf502876-6d65-4e7b-9a9d-153c07812374 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:51.773572 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60edd1-9c45-422c-b766-f87beed558c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:51.774403 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60edd1-9c45-422c-b766-f87beed558c0 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:51.774710 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60edd1-9c45-422c-b766-f87beed558c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:51.774992 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60edd1-9c45-422c-b766-f87beed558c0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:51.783516 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c60edd1-9c45-422c-b766-f87beed558c0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:51.784977 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c60edd1-9c45-422c-b766-f87beed558c0 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:51.797708 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:51.812538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-8c60edd1-9c45-422c-b766-f87beed558c0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 12:07:51.812538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:51.812538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:51.812538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:51.812538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:51.812538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:51.812538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:51.812538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:51.812538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:51.812538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:51.812538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:51.812538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:51.812538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:07:51.812538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:07:51.812538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:07:51.812538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:07:51.813570 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:51.813570 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:51.813570 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:07:51.813570 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:51.813570 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:07:51.813570 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:51.813570 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:51.813570 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:51.813570 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:51.813570 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:51.813570 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:51.813570 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:51.813570 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:51.813570 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:51.813570 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:51.813570 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:51.813570 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:51.813570 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:51.814500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:51.814500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:51.814500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:07:51.814500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:07:51.814500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:07:51.814500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:07:51.814500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:07:51.814500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:07:51.814500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 12:07:51.814500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:51.814500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 362/731] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Jun 29 12:07:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:07:51.818665 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a5a52-bb6e-43b5-8336-6291798c27d9 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:51.818665 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a5a52-bb6e-43b5-8336-6291798c27d9 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:51.818665 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a5a52-bb6e-43b5-8336-6291798c27d9 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:51.818665 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 363/732] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:51.821598 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a5a52-bb6e-43b5-8336-6291798c27d9 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:51.878188 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf502876-6d65-4e7b-9a9d-153c07812374 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:51.922145 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a61c7-d9b4-4009-9e60-2f0806153a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:51.923041 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a61c7-d9b4-4009-9e60-2f0806153a7d None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:51.923323 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a61c7-d9b4-4009-9e60-2f0806153a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:51.923597 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a61c7-d9b4-4009-9e60-2f0806153a7d None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:51.924317 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a61c7-d9b4-4009-9e60-2f0806153a7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:51.924622 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a61c7-d9b4-4009-9e60-2f0806153a7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:51.925994 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a61c7-d9b4-4009-9e60-2f0806153a7d None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:51.942863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 370/733] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:51.944165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a0c1a-5043-4a7b-94cc-523710a380db None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:51.944458 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a0c1a-5043-4a7b-94cc-523710a380db None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:51.944732 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a0c1a-5043-4a7b-94cc-523710a380db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:51.960966 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a5a52-bb6e-43b5-8336-6291798c27d9 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:51.963131 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-c27a0c1a-5043-4a7b-94cc-523710a380db None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:51.964408 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-c27a0c1a-5043-4a7b-94cc-523710a380db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:51.998790 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:52.006615 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e6261-a0c8-4098-8445-df1ae174a62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:52.007659 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e6261-a0c8-4098-8445-df1ae174a62c None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:52.008556 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e6261-a0c8-4098-8445-df1ae174a62c None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:52.008979 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e6261-a0c8-4098-8445-df1ae174a62c None admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:52.010414 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e6261-a0c8-4098-8445-df1ae174a62c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:52.010898 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e6261-a0c8-4098-8445-df1ae174a62c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:52.013160 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e6261-a0c8-4098-8445-df1ae174a62c None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:52.043949 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 364/735] 10.222.0.13 () {56 vars in 1149 bytes} [Wed Jun 29 12:07:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:07:52.045491 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e6261-a0c8-4098-8445-df1ae174a62c None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:52.046870 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 371/735] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:52.056835 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a0c1a-5043-4a7b-94cc-523710a380db None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:52.088822 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:52.182546 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a0c1a-5043-4a7b-94cc-523710a380db None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:52.199103 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e6261-a0c8-4098-8445-df1ae174a62c None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:52.221716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd55f3d-a098-4f0d-99ad-5299e4ded823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:52.222686 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd55f3d-a098-4f0d-99ad-5299e4ded823 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:52.223055 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd55f3d-a098-4f0d-99ad-5299e4ded823 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:52.223383 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd55f3d-a098-4f0d-99ad-5299e4ded823 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:52.242469 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed30e4-915a-4174-b2d2-bc8ba375de36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:52.243572 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed30e4-915a-4174-b2d2-bc8ba375de36 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:52.243862 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed30e4-915a-4174-b2d2-bc8ba375de36 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:52.244140 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed30e4-915a-4174-b2d2-bc8ba375de36 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:52.255178 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed30e4-915a-4174-b2d2-bc8ba375de36 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:52.259320 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed30e4-915a-4174-b2d2-bc8ba375de36 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:52.280906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-8bed30e4-915a-4174-b2d2-bc8ba375de36 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 12:07:52.280906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:52.280906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:52.280906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:52.280906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:52.280906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:52.280906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:52.280906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:52.280906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:52.280906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:52.280906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:52.280906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:52.280906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:07:52.280906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:07:52.280906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:07:52.280906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:07:52.281865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:52.281865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:52.281865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:07:52.281865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:52.281865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:07:52.281865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:52.281865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:52.281865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:52.281865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:52.281865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:52.281865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:52.281865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:52.281865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:52.281865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:52.281865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:52.281865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:52.281865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:52.281865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:52.282828 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:52.282828 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:52.282828 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:07:52.282828 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:07:52.282828 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:07:52.282828 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:07:52.282828 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:07:52.282828 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:07:52.282828 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 12:07:52.282828 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:52.284774 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 365/736] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:07:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:52.284774 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed30e4-915a-4174-b2d2-bc8ba375de36 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:52.318111 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd55f3d-a098-4f0d-99ad-5299e4ded823 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:52.320114 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd55f3d-a098-4f0d-99ad-5299e4ded823 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:52.339725 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:52.350672 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:52.401005 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed30e4-915a-4174-b2d2-bc8ba375de36 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:52.444011 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec951f0-67da-437d-a0c4-2b3cd88ad35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:52.445003 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec951f0-67da-437d-a0c4-2b3cd88ad35f None admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:52.445478 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec951f0-67da-437d-a0c4-2b3cd88ad35f None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:52.446030 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec951f0-67da-437d-a0c4-2b3cd88ad35f None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:52.446996 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec951f0-67da-437d-a0c4-2b3cd88ad35f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:52.448730 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec951f0-67da-437d-a0c4-2b3cd88ad35f None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:52.449665 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 372/737] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 12:07:52.450534 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd55f3d-a098-4f0d-99ad-5299e4ded823 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:52.486856 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 366/738] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Jun 29 12:07:52 2022] POST /identity/v3/services => generated 251 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:07:52.488686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec951f0-67da-437d-a0c4-2b3cd88ad35f None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:52.621285 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec951f0-67da-437d-a0c4-2b3cd88ad35f None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:52.623508 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd55f3d-a098-4f0d-99ad-5299e4ded823 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:52.624606 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:52.666182 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad9e8c-ec6d-43e6-881d-77b321a025d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:52.667409 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad9e8c-ec6d-43e6-881d-77b321a025d9 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:52.667907 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad9e8c-ec6d-43e6-881d-77b321a025d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:52.668563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad9e8c-ec6d-43e6-881d-77b321a025d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:52.669288 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:52.684170 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad9e8c-ec6d-43e6-881d-77b321a025d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:52.686069 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad9e8c-ec6d-43e6-881d-77b321a025d9 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:52.696561 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b4cff-99dd-411b-8364-19a97b3b1dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:52.697163 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b4cff-99dd-411b-8364-19a97b3b1dab None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:52.697445 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b4cff-99dd-411b-8364-19a97b3b1dab None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:52.697718 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b4cff-99dd-411b-8364-19a97b3b1dab None admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:52.698562 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b4cff-99dd-411b-8364-19a97b3b1dab None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:52.698904 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b4cff-99dd-411b-8364-19a97b3b1dab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:52.700373 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b4cff-99dd-411b-8364-19a97b3b1dab None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:52.708601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-d9ad9e8c-ec6d-43e6-881d-77b321a025d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:52.708601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:52.708601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:52.708601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:52.708601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:52.708601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:52.708601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:52.708601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:52.708601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:52.708601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:52.708601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:52.708601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:52.708601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:52.708601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:52.708601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:52.709578 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:52.709578 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:52.709578 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:52.709578 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:52.709578 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:52.709578 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:52.709578 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:52.709578 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:52.709578 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:52.709578 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:52.709578 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:52.709578 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:52.709578 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:52.709578 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:52.709578 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:52.709578 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:52.709578 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:52.710506 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:52.710506 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:52.710506 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:52.710506 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:52.712897 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 367/739] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:52.726059 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad9e8c-ec6d-43e6-881d-77b321a025d9 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:52.737788 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 373/740] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Jun 29 12:07:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:52.747788 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b4cff-99dd-411b-8364-19a97b3b1dab None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:52.868167 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad9e8c-ec6d-43e6-881d-77b321a025d9 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:52.902932 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b4cff-99dd-411b-8364-19a97b3b1dab None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:52.908525 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d5b8a-50b8-42a7-bffb-530190d3f706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:52.909515 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d5b8a-50b8-42a7-bffb-530190d3f706 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:52.910043 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d5b8a-50b8-42a7-bffb-530190d3f706 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:52.910526 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d5b8a-50b8-42a7-bffb-530190d3f706 None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:52.912355 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d5b8a-50b8-42a7-bffb-530190d3f706 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:52.912881 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d5b8a-50b8-42a7-bffb-530190d3f706 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:52.914494 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d5b8a-50b8-42a7-bffb-530190d3f706 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:52.928088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 368/741] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:52.929675 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c6ab7-ba4e-40b7-9d85-4280d5362c61 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:52.930176 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c6ab7-ba4e-40b7-9d85-4280d5362c61 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:52.930686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c6ab7-ba4e-40b7-9d85-4280d5362c61 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:52.932397 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 369/742] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:52.938064 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5caa8-abb5-454f-8b97-d648d78c29ac None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:52.938742 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5caa8-abb5-454f-8b97-d648d78c29ac None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:52.939293 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5caa8-abb5-454f-8b97-d648d78c29ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:52.941908 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d7e54-94f3-47ab-88d2-cb7c94e03b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:52.942677 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d7e54-94f3-47ab-88d2-cb7c94e03b7e None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:52.943042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d7e54-94f3-47ab-88d2-cb7c94e03b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:52.943398 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d7e54-94f3-47ab-88d2-cb7c94e03b7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:52.960842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-99a5caa8-abb5-454f-8b97-d648d78c29ac None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:52.963132 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-99a5caa8-abb5-454f-8b97-d648d78c29ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:52.979167 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:53.008950 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:53.035401 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d7e54-94f3-47ab-88d2-cb7c94e03b7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:53.037684 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d7e54-94f3-47ab-88d2-cb7c94e03b7e None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:53.056973 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 370/743] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:52 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:53.058496 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5caa8-abb5-454f-8b97-d648d78c29ac None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:53.143135 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 374/744] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:52 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:53.143983 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d7e54-94f3-47ab-88d2-cb7c94e03b7e None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:53.165463 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5caa8-abb5-454f-8b97-d648d78c29ac None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:53.202096 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf7580-774a-4592-b22e-eef960ef3acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:53.202859 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf7580-774a-4592-b22e-eef960ef3acf None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:53.203148 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf7580-774a-4592-b22e-eef960ef3acf None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:53.203420 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf7580-774a-4592-b22e-eef960ef3acf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:53.210356 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf7580-774a-4592-b22e-eef960ef3acf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:53.211888 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf7580-774a-4592-b22e-eef960ef3acf None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:53.226372 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-89bf7580-774a-4592-b22e-eef960ef3acf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:53.226372 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:53.226372 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:53.226372 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:53.226372 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:53.226372 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:53.226372 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:53.226372 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:53.226372 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:53.226372 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:53.226372 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:53.226372 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:53.226372 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:07:53.226372 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:07:53.226372 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:07:53.227377 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:07:53.227377 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:53.227377 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:53.227377 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:53.227377 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:53.227377 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:53.227377 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:53.227377 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:53.227377 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:53.227377 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:53.227377 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:53.227377 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:53.227377 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:53.227377 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:53.227377 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:53.227377 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:53.227377 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:53.232212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:07:53.232212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:07:53.232212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:07:53.232212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:07:53.232212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:07:53.232212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:07:53.232212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:53.232212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:53.232212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 371/745] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:53.232212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf7580-774a-4592-b22e-eef960ef3acf None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:53.238595 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:53.240873 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:53.260221 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d7e54-94f3-47ab-88d2-cb7c94e03b7e None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:53.300634 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c40ab0-3501-4c21-b955-3dec90db881d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:53.301332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c40ab0-3501-4c21-b955-3dec90db881d None admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:53.301639 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c40ab0-3501-4c21-b955-3dec90db881d None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:53.301917 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c40ab0-3501-4c21-b955-3dec90db881d None admin] PATH_INFO: `/v3/services` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:53.302679 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c40ab0-3501-4c21-b955-3dec90db881d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:53.304071 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c40ab0-3501-4c21-b955-3dec90db881d None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:53.319972 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 375/746] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Jun 29 12:07:53 2022] POST /identity/v3/services => generated 240 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:07:53.321671 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14914584-d33c-42e2-a827-5979e04d514a None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:53.322034 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14914584-d33c-42e2-a827-5979e04d514a None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:53.322379 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14914584-d33c-42e2-a827-5979e04d514a None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:53.323996 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 376/747] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:53.327559 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14914584-d33c-42e2-a827-5979e04d514a None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:53.362473 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf7580-774a-4592-b22e-eef960ef3acf None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:53.424178 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00221a-7175-483b-9377-1919ae20b79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:53.425153 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00221a-7175-483b-9377-1919ae20b79b None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:53.425531 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00221a-7175-483b-9377-1919ae20b79b None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:53.425949 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00221a-7175-483b-9377-1919ae20b79b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:53.441283 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00221a-7175-483b-9377-1919ae20b79b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:53.443310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00221a-7175-483b-9377-1919ae20b79b None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:53.465502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-9e00221a-7175-483b-9377-1919ae20b79b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:53.465502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:53.465502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:53.465502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:53.465502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:53.465502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:53.465502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:53.465502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:53.465502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:53.465502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:53.465502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:53.465502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:53.465502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:53.465502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:53.465502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:53.466595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:53.466595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:53.466595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:53.466595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:53.466595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:53.466595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:53.466595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:53.466595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:53.466595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:53.466595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:53.466595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:53.466595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:53.466595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:53.466595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:53.466595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:53.466595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:53.466595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:53.467766 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:53.467766 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:53.467766 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:53.467766 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:53.468750 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 372/748] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:53.470073 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdeb3a2-a3ec-41e5-8173-d9c7172ff10f None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:53.470425 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdeb3a2-a3ec-41e5-8173-d9c7172ff10f None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:53.470804 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdeb3a2-a3ec-41e5-8173-d9c7172ff10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:53.475141 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14914584-d33c-42e2-a827-5979e04d514a None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:53.489731 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-1cdeb3a2-a3ec-41e5-8173-d9c7172ff10f None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:53.491066 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-1cdeb3a2-a3ec-41e5-8173-d9c7172ff10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:53.513609 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca965a39-eff9-401a-86dd-289ed3bf9474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:53.514296 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca965a39-eff9-401a-86dd-289ed3bf9474 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:53.514662 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca965a39-eff9-401a-86dd-289ed3bf9474 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:53.514950 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca965a39-eff9-401a-86dd-289ed3bf9474 None admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:53.515840 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca965a39-eff9-401a-86dd-289ed3bf9474 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:53.516142 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca965a39-eff9-401a-86dd-289ed3bf9474 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:53.517606 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca965a39-eff9-401a-86dd-289ed3bf9474 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:53.530701 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 377/749] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:07:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:53.531540 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca965a39-eff9-401a-86dd-289ed3bf9474 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:53.534203 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:53.555879 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:53.571240 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 373/750] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:07:53.572535 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdeb3a2-a3ec-41e5-8173-d9c7172ff10f None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:53.636413 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca965a39-eff9-401a-86dd-289ed3bf9474 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:53.673137 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd2bce-35e2-484e-95a5-92aac8a6b307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:53.673810 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd2bce-35e2-484e-95a5-92aac8a6b307 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:53.674079 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd2bce-35e2-484e-95a5-92aac8a6b307 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:53.674356 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd2bce-35e2-484e-95a5-92aac8a6b307 None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:53.675107 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd2bce-35e2-484e-95a5-92aac8a6b307 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:53.675416 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd2bce-35e2-484e-95a5-92aac8a6b307 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:53.677025 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd2bce-35e2-484e-95a5-92aac8a6b307 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:53.694682 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 378/751] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:53.694682 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd2bce-35e2-484e-95a5-92aac8a6b307 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:53.705140 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdeb3a2-a3ec-41e5-8173-d9c7172ff10f None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:53.753337 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970128df-e660-4f03-bdc4-aa8600bb941b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:53.754027 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970128df-e660-4f03-bdc4-aa8600bb941b None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:53.754311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970128df-e660-4f03-bdc4-aa8600bb941b None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:53.755185 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970128df-e660-4f03-bdc4-aa8600bb941b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:53.756302 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970128df-e660-4f03-bdc4-aa8600bb941b None admin] RBAC: Adding query filter params (role.id=0be824a9ecd0492f984e3b3b991e3984, scope.project.id=489877ae137244c5b83291671c703c99, user.id=2891b5a315b64f228f665e024b641629) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:53.756873 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970128df-e660-4f03-bdc4-aa8600bb941b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:53.759638 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970128df-e660-4f03-bdc4-aa8600bb941b None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:53.767670 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 374/752] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:07:53 2022] GET /identity/v3/role_assignments?user.id=2891b5a315b64f228f665e024b641629&scope.project.id=489877ae137244c5b83291671c703c99&role.id=0be824a9ecd0492f984e3b3b991e3984 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:53.767670 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970128df-e660-4f03-bdc4-aa8600bb941b None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:53.776774 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:53.869299 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd2bce-35e2-484e-95a5-92aac8a6b307 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:53.871077 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:53.943444 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1779b2e-31ca-4cc2-a3b2-f1d33b58da99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:53.944269 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1779b2e-31ca-4cc2-a3b2-f1d33b58da99 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:53.944546 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1779b2e-31ca-4cc2-a3b2-f1d33b58da99 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:53.944822 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1779b2e-31ca-4cc2-a3b2-f1d33b58da99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:53.955522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970128df-e660-4f03-bdc4-aa8600bb941b None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:53.980163 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1779b2e-31ca-4cc2-a3b2-f1d33b58da99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:53.995797 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff24f6b-77ce-412d-b779-c59a6d559d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:53.996601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff24f6b-77ce-412d-b779-c59a6d559d1d None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:53.996882 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff24f6b-77ce-412d-b779-c59a6d559d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:53.997158 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff24f6b-77ce-412d-b779-c59a6d559d1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:53.997262 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-e1779b2e-31ca-4cc2-a3b2-f1d33b58da99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:07:53.997262 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:53.997262 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:53.997262 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:53.997262 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:53.997262 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:53.997262 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:53.997262 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:53.997262 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:53.997262 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:53.997262 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:53.997262 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:53.997262 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:53.997262 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:53.997262 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:53.997262 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:53.998150 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:53.998150 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:53.998150 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:53.998150 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:53.998150 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:53.998150 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:53.998150 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:53.998150 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:53.998150 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:53.998150 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:53.998150 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:53.998150 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:53.998150 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:53.998150 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:53.998150 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:53.998150 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:53.999004 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:53.999004 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:53.999004 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:53.999004 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:53.999004 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:53.999004 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:53.999004 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:53.999004 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:53.999004 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:53.999004 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:53.999004 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:07:53.999004 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:54.000110 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 379/753] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:07:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:54.006411 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1779b2e-31ca-4cc2-a3b2-f1d33b58da99 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:54.021273 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff24f6b-77ce-412d-b779-c59a6d559d1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:54.031972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff24f6b-77ce-412d-b779-c59a6d559d1d None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:54.059034 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-5ff24f6b-77ce-412d-b779-c59a6d559d1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:54.059034 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:54.059034 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:54.059034 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:54.059034 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:54.059034 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:54.059034 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:54.059034 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:54.059034 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:54.059034 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:54.059034 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:54.059034 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:54.059034 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:07:54.059034 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:07:54.059034 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:07:54.060410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:07:54.060410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:54.060410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:54.060410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:54.060410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:54.060410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:54.060410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:54.060410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:54.060410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:54.060410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:54.060410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:54.060410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:54.060410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:54.060410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:54.060410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:54.060410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:54.060410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:54.061291 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:07:54.061291 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:07:54.061291 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:07:54.061291 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:07:54.061291 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:07:54.061291 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:07:54.061291 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:54.061291 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:54.062191 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 375/754] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:54.072128 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff24f6b-77ce-412d-b779-c59a6d559d1d None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:54.200203 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1779b2e-31ca-4cc2-a3b2-f1d33b58da99 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:54.249633 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:54.271998 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff24f6b-77ce-412d-b779-c59a6d559d1d None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:54.274882 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c80018-2486-4b60-a7b5-370c65f3ff6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:54.275560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c80018-2486-4b60-a7b5-370c65f3ff6d None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:54.275846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c80018-2486-4b60-a7b5-370c65f3ff6d None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:54.276124 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c80018-2486-4b60-a7b5-370c65f3ff6d None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:54.277174 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c80018-2486-4b60-a7b5-370c65f3ff6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:54.277489 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c80018-2486-4b60-a7b5-370c65f3ff6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:54.278915 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c80018-2486-4b60-a7b5-370c65f3ff6d None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:54.292663 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:54.301049 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 380/755] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:54.307414 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c80018-2486-4b60-a7b5-370c65f3ff6d None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:54.349511 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a1cb4-953e-4280-a118-2facb7d891b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:54.350972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a1cb4-953e-4280-a118-2facb7d891b2 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:54.351156 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a1cb4-953e-4280-a118-2facb7d891b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:54.351430 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a1cb4-953e-4280-a118-2facb7d891b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:54.352228 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a1cb4-953e-4280-a118-2facb7d891b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:54.352545 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a1cb4-953e-4280-a118-2facb7d891b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:54.356888 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a1cb4-953e-4280-a118-2facb7d891b2 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:54.388801 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 376/756] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:07:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:54.393221 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a1cb4-953e-4280-a118-2facb7d891b2 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:54.496499 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c80018-2486-4b60-a7b5-370c65f3ff6d None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:54.560555 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7d31e-5ffc-4796-9f97-86c2bb414788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:54.561268 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7d31e-5ffc-4796-9f97-86c2bb414788 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:54.561542 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7d31e-5ffc-4796-9f97-86c2bb414788 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:54.561817 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7d31e-5ffc-4796-9f97-86c2bb414788 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:54.582481 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7d31e-5ffc-4796-9f97-86c2bb414788 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:54.584006 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7d31e-5ffc-4796-9f97-86c2bb414788 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:54.586250 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a1cb4-953e-4280-a118-2facb7d891b2 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:54.619582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-88b7d31e-5ffc-4796-9f97-86c2bb414788 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:54.619582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:54.619582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:54.619582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:54.619582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:54.619582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:54.619582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:54.619582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:54.619582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:54.619582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:54.619582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:54.619582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:54.619582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:54.619582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:54.619582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:54.620615 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:54.620615 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:54.620615 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:54.620615 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:54.620615 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:54.620615 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:54.620615 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:54.620615 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:54.620615 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:54.620615 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:54.620615 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:54.620615 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:54.620615 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:54.620615 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:54.620615 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:54.620615 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:54.620615 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:54.621942 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:54.621942 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:54.621942 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:54.621942 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:54.621942 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 381/757] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:07:54.628143 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7d31e-5ffc-4796-9f97-86c2bb414788 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:54.631008 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2b60b-051b-44b0-9d21-920dc38d2154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:54.631673 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2b60b-051b-44b0-9d21-920dc38d2154 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:54.631954 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2b60b-051b-44b0-9d21-920dc38d2154 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:54.632225 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2b60b-051b-44b0-9d21-920dc38d2154 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:54.633184 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2b60b-051b-44b0-9d21-920dc38d2154 None admin] RBAC: Adding query filter params (role.id=5ef3464f4436446b88430cdf7cc1a3d7, scope.project.id=489877ae137244c5b83291671c703c99, user.id=11efdbeeaa5c428aa344f7f0f5b061ba) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:54.633500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2b60b-051b-44b0-9d21-920dc38d2154 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:54.634981 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2b60b-051b-44b0-9d21-920dc38d2154 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:54.641180 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 377/758] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:07:54 2022] GET /identity/v3/role_assignments?user.id=11efdbeeaa5c428aa344f7f0f5b061ba&scope.project.id=489877ae137244c5b83291671c703c99&role.id=5ef3464f4436446b88430cdf7cc1a3d7 => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:54.808275 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:54.896209 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7d31e-5ffc-4796-9f97-86c2bb414788 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:54.931148 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892831a9-2fe4-46ca-8191-1e4fc9abb26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:54.931812 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892831a9-2fe4-46ca-8191-1e4fc9abb26a None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:54.932143 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892831a9-2fe4-46ca-8191-1e4fc9abb26a None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:54.932413 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892831a9-2fe4-46ca-8191-1e4fc9abb26a None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:54.933178 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892831a9-2fe4-46ca-8191-1e4fc9abb26a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:54.933485 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892831a9-2fe4-46ca-8191-1e4fc9abb26a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:54.934874 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892831a9-2fe4-46ca-8191-1e4fc9abb26a None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:54.952323 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 382/759] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:07:54.958079 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2b60b-051b-44b0-9d21-920dc38d2154 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:54.995028 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:55.120730 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2b60b-051b-44b0-9d21-920dc38d2154 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:55.145873 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52cc7e-7841-4e82-9628-ba181f18faf6 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:55.146414 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52cc7e-7841-4e82-9628-ba181f18faf6 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:55.146860 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52cc7e-7841-4e82-9628-ba181f18faf6 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:55.149413 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 383/760] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:55.155544 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689d29f-cf42-4722-bb33-c3b2a356c09e None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:55.155544 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689d29f-cf42-4722-bb33-c3b2a356c09e None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:55.155544 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689d29f-cf42-4722-bb33-c3b2a356c09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:55.175419 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-d689d29f-cf42-4722-bb33-c3b2a356c09e None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:55.177520 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-d689d29f-cf42-4722-bb33-c3b2a356c09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:55.231416 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf387a5-4bfd-47d7-8db9-bd520c1e7116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:55.232269 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf387a5-4bfd-47d7-8db9-bd520c1e7116 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:55.232533 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf387a5-4bfd-47d7-8db9-bd520c1e7116 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:55.232817 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf387a5-4bfd-47d7-8db9-bd520c1e7116 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:55.248023 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf387a5-4bfd-47d7-8db9-bd520c1e7116 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:55.250327 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf387a5-4bfd-47d7-8db9-bd520c1e7116 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:55.256305 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 384/761] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:07:55.275050 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-bdf387a5-4bfd-47d7-8db9-bd520c1e7116 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:07:55.275050 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:55.275050 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:55.275050 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:55.275050 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:55.275050 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:55.275050 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:55.275050 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:55.275050 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:55.275050 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:55.275050 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:55.275050 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:55.275050 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:07:55.275050 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:07:55.275050 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:07:55.275050 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:07:55.276019 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:55.276019 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:55.276019 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:07:55.276019 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:55.276019 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:07:55.276019 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:55.276019 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:55.276019 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:55.276019 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:55.276019 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:55.276019 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:55.276019 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:55.276019 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:55.276019 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:55.276019 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:55.276019 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:55.276019 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:55.276019 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:55.276968 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:55.276968 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:55.276968 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:07:55.276968 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:07:55.276968 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:07:55.276968 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:07:55.276968 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:07:55.276968 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:07:55.276968 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:07:55.276968 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:55.282766 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 378/762] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Jun 29 12:07:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:55.286885 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689d29f-cf42-4722-bb33-c3b2a356c09e None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:55.308106 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf387a5-4bfd-47d7-8db9-bd520c1e7116 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:55.339046 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:55.470911 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689d29f-cf42-4722-bb33-c3b2a356c09e None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:55.490245 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:55.526029 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf387a5-4bfd-47d7-8db9-bd520c1e7116 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:55.527079 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbfc385-bc90-4cd8-9167-dd9d20f2b824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:55.528155 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfc385-bc90-4cd8-9167-dd9d20f2b824 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:55.528641 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfc385-bc90-4cd8-9167-dd9d20f2b824 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:55.530535 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfc385-bc90-4cd8-9167-dd9d20f2b824 None admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:55.531536 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbfc385-bc90-4cd8-9167-dd9d20f2b824 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:55.531990 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbfc385-bc90-4cd8-9167-dd9d20f2b824 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:55.534272 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbfc385-bc90-4cd8-9167-dd9d20f2b824 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:55.578759 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 385/763] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Jun 29 12:07:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:55.592944 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbfc385-bc90-4cd8-9167-dd9d20f2b824 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:55.609171 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d103e15-9c20-4269-a403-696b2d250500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:55.611499 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d103e15-9c20-4269-a403-696b2d250500 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:55.613445 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d103e15-9c20-4269-a403-696b2d250500 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:55.613936 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d103e15-9c20-4269-a403-696b2d250500 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:55.615104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d103e15-9c20-4269-a403-696b2d250500 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:55.617317 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d103e15-9c20-4269-a403-696b2d250500 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:55.643766 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-2d103e15-9c20-4269-a403-696b2d250500 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 12:07:55.643766 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:55.643766 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:07:55.643766 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:07:55.643766 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:07:55.643766 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:07:55.643766 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:07:55.643766 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:07:55.643766 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 12:07:55.643766 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:55.643766 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:07:55.643766 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:55.643766 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:55.643766 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:55.643766 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:55.643766 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:55.645500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:55.645500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:55.645500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:55.645500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:55.645500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:55.645500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:55.645500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:55.645500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:07:55.645500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:07:55.645500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:07:55.645500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:07:55.645500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:55.645500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:55.645500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:55.645500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:55.645500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:55.646379 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:55.646379 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:55.646379 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:55.646379 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:55.646379 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:55.646379 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:55.646379 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:55.646379 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:55.646379 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:55.646379 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:55.646379 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:55.646379 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:07:55.646379 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:07:55.646379 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 12:07:55.646379 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:55.655231 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 379/764] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Jun 29 12:07:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:55.658624 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d103e15-9c20-4269-a403-696b2d250500 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:55.817857 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d103e15-9c20-4269-a403-696b2d250500 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:55.831121 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:55.860763 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653a950-28a8-429f-acad-f46f627502fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:55.861695 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653a950-28a8-429f-acad-f46f627502fb None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:55.863119 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653a950-28a8-429f-acad-f46f627502fb None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:55.864835 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653a950-28a8-429f-acad-f46f627502fb None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:55.865703 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a653a950-28a8-429f-acad-f46f627502fb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:55.866157 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a653a950-28a8-429f-acad-f46f627502fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:55.869097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a653a950-28a8-429f-acad-f46f627502fb None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:55.875568 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 380/765] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Jun 29 12:07:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:55.878579 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbfc385-bc90-4cd8-9167-dd9d20f2b824 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:55.881414 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653a950-28a8-429f-acad-f46f627502fb None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:55.920258 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:55.975372 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76fda7-6505-4ece-9cb5-33ecda29bae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:55.977055 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76fda7-6505-4ece-9cb5-33ecda29bae5 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:55.977055 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76fda7-6505-4ece-9cb5-33ecda29bae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:55.977055 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76fda7-6505-4ece-9cb5-33ecda29bae5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:55.997077 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76fda7-6505-4ece-9cb5-33ecda29bae5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:55.998659 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76fda7-6505-4ece-9cb5-33ecda29bae5 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:56.012197 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653a950-28a8-429f-acad-f46f627502fb None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:56.017950 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-4c76fda7-6505-4ece-9cb5-33ecda29bae5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:56.017950 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:56.017950 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:56.017950 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:56.017950 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:56.017950 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:56.017950 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:56.017950 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:56.017950 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:56.017950 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:56.017950 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:56.017950 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:56.017950 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:56.017950 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:56.017950 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:56.018985 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:56.018985 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:56.018985 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:56.018985 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:56.018985 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:56.018985 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:56.018985 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:56.018985 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:56.018985 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:56.018985 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:56.018985 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:56.018985 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:56.018985 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:56.018985 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:56.018985 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:56.018985 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:56.018985 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:56.020734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:56.020734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:56.020734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:56.020734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:56.025857 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 386/766] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:07:56.025857 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad6343-fe1a-4316-b677-6d439bb43928 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:56.025857 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad6343-fe1a-4316-b677-6d439bb43928 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:56.025857 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad6343-fe1a-4316-b677-6d439bb43928 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:56.025857 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 387/767] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:56.033857 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4b3b2-c550-4cae-8626-46c95edade76 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:56.034309 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4b3b2-c550-4cae-8626-46c95edade76 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:56.034947 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4b3b2-c550-4cae-8626-46c95edade76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:56.055005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-1ea4b3b2-c550-4cae-8626-46c95edade76 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:56.056204 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-1ea4b3b2-c550-4cae-8626-46c95edade76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:56.070316 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f38a8-1d91-4cd2-909f-966488f809ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:56.071460 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f38a8-1d91-4cd2-909f-966488f809ef None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:56.072298 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f38a8-1d91-4cd2-909f-966488f809ef None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:56.073016 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f38a8-1d91-4cd2-909f-966488f809ef None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:56.073907 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f38a8-1d91-4cd2-909f-966488f809ef None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:56.074517 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f38a8-1d91-4cd2-909f-966488f809ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:56.076385 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f38a8-1d91-4cd2-909f-966488f809ef None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:56.084804 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 381/768] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Jun 29 12:07:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:56.086283 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f38a8-1d91-4cd2-909f-966488f809ef None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:56.132405 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 388/769] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:07:56.133348 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4b3b2-c550-4cae-8626-46c95edade76 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:56.196746 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:56.216446 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f38a8-1d91-4cd2-909f-966488f809ef None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:56.218814 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:56.255961 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64e1bf-9402-4f4d-9e44-4154b789341f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:56.256546 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64e1bf-9402-4f4d-9e44-4154b789341f None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:56.256851 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64e1bf-9402-4f4d-9e44-4154b789341f None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:56.257114 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64e1bf-9402-4f4d-9e44-4154b789341f None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:56.257841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64e1bf-9402-4f4d-9e44-4154b789341f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:56.258153 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64e1bf-9402-4f4d-9e44-4154b789341f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:56.259154 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4b3b2-c550-4cae-8626-46c95edade76 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:56.259577 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64e1bf-9402-4f4d-9e44-4154b789341f None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:56.277348 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 382/770] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:56.277348 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64e1bf-9402-4f4d-9e44-4154b789341f None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:56.302979 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfcd468-7568-41b2-9392-f56cc487644e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:56.304070 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfcd468-7568-41b2-9392-f56cc487644e None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:56.304586 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfcd468-7568-41b2-9392-f56cc487644e None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:56.305058 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfcd468-7568-41b2-9392-f56cc487644e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:56.306051 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfcd468-7568-41b2-9392-f56cc487644e None admin] RBAC: Adding query filter params (interface=public, service_id=1d8db9094b0a4951a31d6c943ede6fbd, region_id=RegionOne) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:56.306584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfcd468-7568-41b2-9392-f56cc487644e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:56.308240 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfcd468-7568-41b2-9392-f56cc487644e None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:56.316623 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 389/771] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Jun 29 12:07:56 2022] GET /identity/v3/endpoints?service_id=1d8db9094b0a4951a31d6c943ede6fbd&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:56.318422 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfcd468-7568-41b2-9392-f56cc487644e None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:56.382197 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64e1bf-9402-4f4d-9e44-4154b789341f None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:56.422188 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484f524-3c4d-43c1-9bab-51c2ab47acd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:56.423076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484f524-3c4d-43c1-9bab-51c2ab47acd5 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:56.423323 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484f524-3c4d-43c1-9bab-51c2ab47acd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:56.423669 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484f524-3c4d-43c1-9bab-51c2ab47acd5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:56.424317 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c484f524-3c4d-43c1-9bab-51c2ab47acd5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:56.425722 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c484f524-3c4d-43c1-9bab-51c2ab47acd5 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:56.426675 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfcd468-7568-41b2-9392-f56cc487644e None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:56.438585 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-c484f524-3c4d-43c1-9bab-51c2ab47acd5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 12:07:56.438585 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:56.438585 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:07:56.438585 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:07:56.438585 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:07:56.438585 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:07:56.438585 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:07:56.438585 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:07:56.438585 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 12:07:56.438585 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:56.438585 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:07:56.438585 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:56.438585 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:56.438585 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:56.438585 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:56.438585 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:56.438585 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:56.439620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:56.439620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:56.439620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:56.439620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:56.439620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:56.439620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:56.439620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:07:56.439620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:07:56.439620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:07:56.439620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:07:56.439620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:56.439620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:56.439620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:56.439620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:56.439620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:56.439620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:56.440902 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:56.440902 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:56.440902 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:56.440902 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:56.440902 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:56.440902 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:56.440902 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:56.440902 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:56.440902 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:56.440902 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:56.440902 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:07:56.440902 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:07:56.440902 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 12:07:56.440902 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:56.445597 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 383/772] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:56 2022] GET /identity/v3/services/network => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:56.446788 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484f524-3c4d-43c1-9bab-51c2ab47acd5 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:56.458438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:56.462423 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:56.469928 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa7ecb-b5d9-4ccf-bd5d-b719a3b8562a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:56.471091 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa7ecb-b5d9-4ccf-bd5d-b719a3b8562a None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:56.471584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa7ecb-b5d9-4ccf-bd5d-b719a3b8562a None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:56.472065 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa7ecb-b5d9-4ccf-bd5d-b719a3b8562a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:56.481113 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa7ecb-b5d9-4ccf-bd5d-b719a3b8562a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:56.482733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa7ecb-b5d9-4ccf-bd5d-b719a3b8562a None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:56.497619 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-96fa7ecb-b5d9-4ccf-bd5d-b719a3b8562a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:56.497619 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:56.497619 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:56.497619 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:56.497619 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:56.497619 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:56.497619 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:56.497619 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:56.497619 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:56.497619 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:56.497619 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:56.497619 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:56.497619 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:07:56.497619 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:07:56.497619 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:07:56.498579 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:07:56.498579 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:56.498579 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:56.498579 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:56.498579 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:56.498579 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:56.498579 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:56.498579 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:56.498579 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:56.498579 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:56.498579 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:56.498579 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:56.498579 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:56.498579 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:56.498579 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:56.498579 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:56.498579 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:56.499616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:07:56.499616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:07:56.499616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:07:56.499616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:07:56.499616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:07:56.499616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:07:56.499616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:56.499616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:56.499616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 390/773] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:56.499616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa7ecb-b5d9-4ccf-bd5d-b719a3b8562a None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:56.566460 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484f524-3c4d-43c1-9bab-51c2ab47acd5 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:56.603312 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479475b-aed0-4652-81fa-e694f867e52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:56.603982 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479475b-aed0-4652-81fa-e694f867e52c None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:56.604267 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479475b-aed0-4652-81fa-e694f867e52c None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:56.604535 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479475b-aed0-4652-81fa-e694f867e52c None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:56.605219 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479475b-aed0-4652-81fa-e694f867e52c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:56.606838 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479475b-aed0-4652-81fa-e694f867e52c None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:56.616157 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa7ecb-b5d9-4ccf-bd5d-b719a3b8562a None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:56.623070 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 384/774] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Jun 29 12:07:56 2022] GET /identity/v3/services => generated 772 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:56.624475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe24b0-a7a9-4805-8288-23b3c4048cd2 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:56.624773 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe24b0-a7a9-4805-8288-23b3c4048cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:56.625050 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe24b0-a7a9-4805-8288-23b3c4048cd2 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:56.626576 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 385/775] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:56.627166 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe24b0-a7a9-4805-8288-23b3c4048cd2 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:56.666378 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c573c4-e921-4264-9215-5c794d54a8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:56.666851 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c573c4-e921-4264-9215-5c794d54a8e6 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:56.667141 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c573c4-e921-4264-9215-5c794d54a8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:56.667465 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c573c4-e921-4264-9215-5c794d54a8e6 None admin] PATH_INFO: `/v3/services` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:56.668197 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c573c4-e921-4264-9215-5c794d54a8e6 None admin] RBAC: Adding query filter params (name=network) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:56.668555 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c573c4-e921-4264-9215-5c794d54a8e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:56.670087 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c573c4-e921-4264-9215-5c794d54a8e6 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:56.682052 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 391/776] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Jun 29 12:07:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:56.683200 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d77ae-6be3-44c4-99fe-62972ad6b4bf None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:56.683487 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d77ae-6be3-44c4-99fe-62972ad6b4bf None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:56.683762 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d77ae-6be3-44c4-99fe-62972ad6b4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:56.702623 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-255d77ae-6be3-44c4-99fe-62972ad6b4bf None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:56.703875 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-255d77ae-6be3-44c4-99fe-62972ad6b4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:56.772858 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:56.798822 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 392/777] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:07:56.799758 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d77ae-6be3-44c4-99fe-62972ad6b4bf None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:56.805817 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:56.861527 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe24b0-a7a9-4805-8288-23b3c4048cd2 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:56.908404 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497b6e1-8691-428a-9611-5c0e01102f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:56.909841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497b6e1-8691-428a-9611-5c0e01102f37 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:56.911119 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497b6e1-8691-428a-9611-5c0e01102f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:56.912130 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497b6e1-8691-428a-9611-5c0e01102f37 None admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:56.913225 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497b6e1-8691-428a-9611-5c0e01102f37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:56.913747 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497b6e1-8691-428a-9611-5c0e01102f37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:56.916018 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497b6e1-8691-428a-9611-5c0e01102f37 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:56.934788 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d77ae-6be3-44c4-99fe-62972ad6b4bf None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:56.942676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 386/778] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:07:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:56.944420 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497b6e1-8691-428a-9611-5c0e01102f37 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:56.975370 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22509b80-c045-478b-a530-22b605f43e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:56.976044 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22509b80-c045-478b-a530-22b605f43e82 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:56.976349 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22509b80-c045-478b-a530-22b605f43e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:56.976690 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22509b80-c045-478b-a530-22b605f43e82 None admin] PATH_INFO: `/v3/services` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:56.977782 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22509b80-c045-478b-a530-22b605f43e82 None admin] RBAC: Adding query filter params (type=network) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:56.978088 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22509b80-c045-478b-a530-22b605f43e82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:56.979498 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22509b80-c045-478b-a530-22b605f43e82 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:56.986213 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 393/779] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Jun 29 12:07:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:56.992784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22509b80-c045-478b-a530-22b605f43e82 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:57.045737 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:57.085026 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497b6e1-8691-428a-9611-5c0e01102f37 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:57.103940 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22509b80-c045-478b-a530-22b605f43e82 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:57.118552 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:57.125924 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d778232-01d4-4315-95fd-935d98b55857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:57.127070 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d778232-01d4-4315-95fd-935d98b55857 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:57.127799 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d778232-01d4-4315-95fd-935d98b55857 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:57.128277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d778232-01d4-4315-95fd-935d98b55857 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:57.140250 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d778232-01d4-4315-95fd-935d98b55857 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:57.140870 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ccc77b-b704-4c64-9414-c9180112e59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:57.141755 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccc77b-b704-4c64-9414-c9180112e59b None admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:57.142029 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccc77b-b704-4c64-9414-c9180112e59b None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:57.142301 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccc77b-b704-4c64-9414-c9180112e59b None admin] PATH_INFO: `/v3/projects/489877ae137244c5b83291671c703c99/users/3fbcf547421b42e4b520f9246326bff8/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:57.144344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ccc77b-b704-4c64-9414-c9180112e59b None admin] RBAC: Authorizing `identity:create_grant(project_id=489877ae137244c5b83291671c703c99, user_id=3fbcf547421b42e4b520f9246326bff8, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:57.146451 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ccc77b-b704-4c64-9414-c9180112e59b None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:57.150309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-9d778232-01d4-4315-95fd-935d98b55857 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:07:57.150309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:57.150309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:57.150309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:57.150309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:57.150309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:57.150309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:57.150309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:57.150309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:57.150309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:57.150309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:57.150309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:57.150309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:57.150309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:57.150309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:57.150309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:57.151323 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:57.151323 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:57.151323 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:57.151323 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:57.151323 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:57.151323 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:57.151323 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:57.151323 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:57.151323 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:57.151323 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:57.151323 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:57.151323 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:57.151323 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:57.151323 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:57.151323 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:57.151323 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:57.152212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:57.152212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:57.152212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:57.152212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:57.152212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:57.152212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:57.152212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:57.152212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:57.152212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:57.152212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:57.152212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:07:57.152212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:57.154708 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 387/780] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 29 12:07:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:57.156012 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d778232-01d4-4315-95fd-935d98b55857 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:57.174668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 394/781] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 29 12:07:56 2022] PUT /identity/v3/projects/489877ae137244c5b83291671c703c99/users/3fbcf547421b42e4b520f9246326bff8/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:07:57.174668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ccc77b-b704-4c64-9414-c9180112e59b None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:57.292349 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ccc77b-b704-4c64-9414-c9180112e59b None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:57.303079 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:57.307744 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d778232-01d4-4315-95fd-935d98b55857 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:57.335677 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3fa22-4a44-4823-b4c5-ee8be0033e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:57.336629 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3fa22-4a44-4823-b4c5-ee8be0033e07 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:57.337138 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3fa22-4a44-4823-b4c5-ee8be0033e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:57.337565 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3fa22-4a44-4823-b4c5-ee8be0033e07 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:57.338511 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3fa22-4a44-4823-b4c5-ee8be0033e07 None admin] RBAC: Adding query filter params (name=service) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:57.338994 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3fa22-4a44-4823-b4c5-ee8be0033e07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:57.340606 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3fa22-4a44-4823-b4c5-ee8be0033e07 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:57.351025 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c580dd-a29c-4a3d-99ca-48277a5aede2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:57.356341 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c580dd-a29c-4a3d-99ca-48277a5aede2 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:57.356341 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c580dd-a29c-4a3d-99ca-48277a5aede2 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:57.356341 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c580dd-a29c-4a3d-99ca-48277a5aede2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:57.356341 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c580dd-a29c-4a3d-99ca-48277a5aede2 None admin] RBAC: Adding query filter params (interface=public, service_id=1c0403bcafb2457e9a01b5878bc33168, region_id=RegionOne) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:57.356341 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c580dd-a29c-4a3d-99ca-48277a5aede2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:57.356341 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c580dd-a29c-4a3d-99ca-48277a5aede2 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:57.357111 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 395/782] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 29 12:07:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:57.358872 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a9b43-17b3-47e6-93a3-cf05b6128d5c None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:57.359358 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a9b43-17b3-47e6-93a3-cf05b6128d5c None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:57.359806 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a9b43-17b3-47e6-93a3-cf05b6128d5c None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:57.361712 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 396/783] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:57.362696 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a9b43-17b3-47e6-93a3-cf05b6128d5c None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:57.365511 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 388/784] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Jun 29 12:07:57 2022] GET /identity/v3/endpoints?service_id=1c0403bcafb2457e9a01b5878bc33168&interface=public®ion_id=RegionOne => generated 194 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:57.368447 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44f4db-835f-45e1-a9b0-0abc6f782824 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:57.369046 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44f4db-835f-45e1-a9b0-0abc6f782824 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:57.369368 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44f4db-835f-45e1-a9b0-0abc6f782824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:57.393334 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-cd44f4db-835f-45e1-a9b0-0abc6f782824 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:57.394563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-cd44f4db-835f-45e1-a9b0-0abc6f782824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:57.478386 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:57.505648 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a9b43-17b3-47e6-93a3-cf05b6128d5c None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:57.517103 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 389/785] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:07:57.519862 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44f4db-835f-45e1-a9b0-0abc6f782824 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:57.546554 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf36dd0-77a6-4a06-9534-d30b7b4f8096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:57.547431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf36dd0-77a6-4a06-9534-d30b7b4f8096 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:57.547719 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf36dd0-77a6-4a06-9534-d30b7b4f8096 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:57.548099 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf36dd0-77a6-4a06-9534-d30b7b4f8096 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:57.561458 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf36dd0-77a6-4a06-9534-d30b7b4f8096 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:57.563104 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf36dd0-77a6-4a06-9534-d30b7b4f8096 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:57.584884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-cbf36dd0-77a6-4a06-9534-d30b7b4f8096 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:57.584884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:57.584884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:57.584884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:57.584884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:57.584884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:57.584884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:57.584884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:57.584884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:57.584884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:57.584884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:57.584884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:57.584884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:57.584884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:57.584884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:57.586382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:57.586382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:57.586382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:57.586382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:57.586382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:57.586382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:57.586382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:57.586382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:57.586382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:57.586382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:57.586382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:57.586382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:57.586382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:57.586382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:57.586382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:57.586382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:57.586382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:57.589003 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:57.589003 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:57.589003 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:57.589003 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:57.589003 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 397/786] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:57.589003 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf36dd0-77a6-4a06-9534-d30b7b4f8096 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:57.614988 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:57.706317 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf36dd0-77a6-4a06-9534-d30b7b4f8096 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:57.714437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44f4db-835f-45e1-a9b0-0abc6f782824 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:57.752493 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcd605-2929-4ecf-9839-16b9af3a8a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:57.753715 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcd605-2929-4ecf-9839-16b9af3a8a2a None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:57.754758 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcd605-2929-4ecf-9839-16b9af3a8a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:57.755305 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcd605-2929-4ecf-9839-16b9af3a8a2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:57.766619 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bcd605-2929-4ecf-9839-16b9af3a8a2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:57.775575 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-57bcd605-2929-4ecf-9839-16b9af3a8a2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:07:57.775575 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:57.775575 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:57.775575 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:57.775575 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:57.775575 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:57.775575 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:57.775575 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:57.775575 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:57.775575 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:57.775575 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:57.775575 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:57.775575 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:57.775575 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:57.775575 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:57.775575 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:57.776516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:57.776516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:57.776516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:57.776516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:57.776516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:57.776516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:57.776516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:57.776516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:57.776516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:57.776516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:57.776516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:57.776516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:57.776516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:57.776516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:57.776516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:57.776516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:57.777382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:57.777382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:57.777382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:57.777382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:57.777382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:57.777382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:57.777382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:57.777382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:57.777382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:57.777382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:57.777382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:07:57.777382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:57.780053 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 398/787] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:07:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:57.780312 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a1d06-e285-46d6-ad90-b59b84ba6e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:57.781157 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a1d06-e285-46d6-ad90-b59b84ba6e65 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:57.781473 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcd605-2929-4ecf-9839-16b9af3a8a2a None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:57.781589 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a1d06-e285-46d6-ad90-b59b84ba6e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:57.781978 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a1d06-e285-46d6-ad90-b59b84ba6e65 None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:57.782997 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a1d06-e285-46d6-ad90-b59b84ba6e65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:57.784979 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a1d06-e285-46d6-ad90-b59b84ba6e65 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:57.802921 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 390/788] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Jun 29 12:07:57 2022] GET /identity/v3/services => generated 772 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:57.804183 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a1d06-e285-46d6-ad90-b59b84ba6e65 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:57.903279 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:57.947056 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:57.989594 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcd605-2929-4ecf-9839-16b9af3a8a2a None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:58.016243 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a1d06-e285-46d6-ad90-b59b84ba6e65 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:58.031574 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d98e3-bc4a-4d9b-9176-97406d8c26a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:58.032270 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d98e3-bc4a-4d9b-9176-97406d8c26a6 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:58.032554 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d98e3-bc4a-4d9b-9176-97406d8c26a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:58.032834 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d98e3-bc4a-4d9b-9176-97406d8c26a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:58.033583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d98e3-bc4a-4d9b-9176-97406d8c26a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:58.033892 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d98e3-bc4a-4d9b-9176-97406d8c26a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:58.035465 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d98e3-bc4a-4d9b-9176-97406d8c26a6 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:58.050435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 399/789] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:58.056577 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d98e3-bc4a-4d9b-9176-97406d8c26a6 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:58.077496 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efa7ad-d484-4999-8872-da9ef092b3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:58.078517 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efa7ad-d484-4999-8872-da9ef092b3c9 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:58.078982 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efa7ad-d484-4999-8872-da9ef092b3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:58.079413 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efa7ad-d484-4999-8872-da9ef092b3c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:58.080600 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efa7ad-d484-4999-8872-da9ef092b3c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:58.081079 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efa7ad-d484-4999-8872-da9ef092b3c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:58.084780 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efa7ad-d484-4999-8872-da9ef092b3c9 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:58.098383 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 391/790] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:58.104316 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efa7ad-d484-4999-8872-da9ef092b3c9 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:58.241709 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d98e3-bc4a-4d9b-9176-97406d8c26a6 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:58.300485 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efa7ad-d484-4999-8872-da9ef092b3c9 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:58.324895 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dac4b-cfea-4d05-89ff-2f5cb396af67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:58.326119 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dac4b-cfea-4d05-89ff-2f5cb396af67 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:58.326604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dac4b-cfea-4d05-89ff-2f5cb396af67 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:58.327046 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dac4b-cfea-4d05-89ff-2f5cb396af67 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:58.335025 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:58.347513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83dac4b-cfea-4d05-89ff-2f5cb396af67 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:58.350466 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83dac4b-cfea-4d05-89ff-2f5cb396af67 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:58.396805 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc214a79-db12-4eda-837e-59447b88b2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:58.398040 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc214a79-db12-4eda-837e-59447b88b2ec None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:58.398457 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc214a79-db12-4eda-837e-59447b88b2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:58.398948 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc214a79-db12-4eda-837e-59447b88b2ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:58.402472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-c83dac4b-cfea-4d05-89ff-2f5cb396af67 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 12:07:58.402472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:58.402472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:58.402472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:58.402472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:58.402472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:58.402472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:58.402472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:58.402472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:58.402472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:58.402472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:58.402472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:58.402472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:07:58.402472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:07:58.402472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:07:58.402472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:07:58.403459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:58.403459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:58.403459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:07:58.403459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:58.403459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:07:58.403459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:58.403459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:58.403459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:58.403459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:58.403459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:58.403459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:58.403459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:58.403459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:58.403459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:58.403459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:58.403459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:58.403459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:58.403459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:58.404435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:58.404435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:58.404435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:07:58.404435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:07:58.404435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:07:58.404435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:07:58.404435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:07:58.404435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:07:58.404435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 12:07:58.404435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:58.408049 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 400/791] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Jun 29 12:07:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:07:58.414764 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dac4b-cfea-4d05-89ff-2f5cb396af67 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:58.421524 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:58.424175 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc214a79-db12-4eda-837e-59447b88b2ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:58.425644 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc214a79-db12-4eda-837e-59447b88b2ec None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:58.459311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-dc214a79-db12-4eda-837e-59447b88b2ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:58.459311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:58.459311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:58.459311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:58.459311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:58.459311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:58.459311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:58.459311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:58.459311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:58.459311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:58.459311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:58.459311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:58.459311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:58.459311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:58.459311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:58.460296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:58.460296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:58.460296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:58.460296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:58.460296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:58.460296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:58.460296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:58.460296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:58.460296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:58.460296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:58.460296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:58.460296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:58.460296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:58.460296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:58.460296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:58.460296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:58.460296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:58.461203 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:58.461203 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:58.461203 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:58.461203 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:58.467432 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 392/792] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:58.472324 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc214a79-db12-4eda-837e-59447b88b2ec None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:58.575013 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dac4b-cfea-4d05-89ff-2f5cb396af67 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:58.622135 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc214a79-db12-4eda-837e-59447b88b2ec None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:58.635481 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211759f8-acc2-4849-9a07-ac9109432f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:58.636543 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211759f8-acc2-4849-9a07-ac9109432f41 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:58.637064 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211759f8-acc2-4849-9a07-ac9109432f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:58.637547 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211759f8-acc2-4849-9a07-ac9109432f41 None admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:58.638607 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211759f8-acc2-4849-9a07-ac9109432f41 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:58.639165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211759f8-acc2-4849-9a07-ac9109432f41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:58.643197 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211759f8-acc2-4849-9a07-ac9109432f41 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:58.680028 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 401/793] 10.222.0.13 () {56 vars in 1149 bytes} [Wed Jun 29 12:07:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:58.685900 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211759f8-acc2-4849-9a07-ac9109432f41 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:58.701103 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9b8de-d9a4-4859-a53b-7f589f70588d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:58.702164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9b8de-d9a4-4859-a53b-7f589f70588d None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:58.702706 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9b8de-d9a4-4859-a53b-7f589f70588d None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:58.703196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9b8de-d9a4-4859-a53b-7f589f70588d None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:58.704151 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d9b8de-d9a4-4859-a53b-7f589f70588d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:58.704679 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d9b8de-d9a4-4859-a53b-7f589f70588d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:58.706295 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d9b8de-d9a4-4859-a53b-7f589f70588d None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:58.737047 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 393/794] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:07:58.742603 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9b8de-d9a4-4859-a53b-7f589f70588d None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:58.790001 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:58.809603 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:58.888209 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211759f8-acc2-4849-9a07-ac9109432f41 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:58.940794 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9b8de-d9a4-4859-a53b-7f589f70588d None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:58.962515 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b135d35-8a03-4bd0-a9b1-e33f0cb9e2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:58.963339 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b135d35-8a03-4bd0-a9b1-e33f0cb9e2b1 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:58.963616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b135d35-8a03-4bd0-a9b1-e33f0cb9e2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:58.963883 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b135d35-8a03-4bd0-a9b1-e33f0cb9e2b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:58.983104 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b135d35-8a03-4bd0-a9b1-e33f0cb9e2b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:58.984576 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b135d35-8a03-4bd0-a9b1-e33f0cb9e2b1 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:59.000768 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed9e0f-29a1-413f-a951-26797c6aa668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:59.001567 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed9e0f-29a1-413f-a951-26797c6aa668 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:59.001846 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed9e0f-29a1-413f-a951-26797c6aa668 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:59.002118 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed9e0f-29a1-413f-a951-26797c6aa668 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:59.015354 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed9e0f-29a1-413f-a951-26797c6aa668 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:59.016026 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-0b135d35-8a03-4bd0-a9b1-e33f0cb9e2b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:59.016026 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:59.016026 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:59.016026 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:59.016026 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:59.016026 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:59.016026 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:59.016026 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:59.016026 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:59.016026 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:59.016026 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:59.016026 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:59.016026 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:59.016026 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:59.016026 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:59.016909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:59.016909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:59.016909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:59.016909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:59.016909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:59.016909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:59.016909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:59.016909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:59.016909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:59.016909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:59.016909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:59.016909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:59.016909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:59.016909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:59.016909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:59.016909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:59.016909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:59.017800 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:59.017800 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:59.017800 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:59.017800 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:59.018034 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed9e0f-29a1-413f-a951-26797c6aa668 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:59.018105 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 402/795] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:59.031652 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b135d35-8a03-4bd0-a9b1-e33f0cb9e2b1 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:59.041343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-c0ed9e0f-29a1-413f-a951-26797c6aa668 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 12:07:59.041343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:59.041343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:59.041343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:59.041343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:59.041343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:59.041343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:59.041343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:59.041343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:59.041343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:59.041343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:59.041343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:59.041343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:07:59.041343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:07:59.041343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:07:59.041343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:07:59.042312 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:59.042312 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:59.042312 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:07:59.042312 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:59.042312 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:07:59.042312 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:07:59.042312 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:59.042312 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:59.042312 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:59.042312 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:59.042312 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:59.042312 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:59.042312 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:59.042312 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:59.042312 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:59.042312 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:59.042312 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:59.042312 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:59.043309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:59.043309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:59.043309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:07:59.043309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:07:59.043309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:07:59.043309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:07:59.043309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:07:59.043309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:07:59.043309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 12:07:59.043309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:59.045929 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 394/796] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:07:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:59.051785 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed9e0f-29a1-413f-a951-26797c6aa668 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:59.182893 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:59.189362 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b135d35-8a03-4bd0-a9b1-e33f0cb9e2b1 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:59.200932 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed9e0f-29a1-413f-a951-26797c6aa668 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:59.205801 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:59.231178 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a4f14-1466-4bfb-a6fc-810def79cfd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:59.232247 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a4f14-1466-4bfb-a6fc-810def79cfd8 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:59.232743 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a4f14-1466-4bfb-a6fc-810def79cfd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:59.233232 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a4f14-1466-4bfb-a6fc-810def79cfd8 None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:59.234396 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a4f14-1466-4bfb-a6fc-810def79cfd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:59.234969 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a4f14-1466-4bfb-a6fc-810def79cfd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:59.236628 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a4f14-1466-4bfb-a6fc-810def79cfd8 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:59.243118 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84871f-730d-4c27-a530-192b314c3e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:59.243820 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84871f-730d-4c27-a530-192b314c3e11 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:59.244107 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84871f-730d-4c27-a530-192b314c3e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:59.244387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84871f-730d-4c27-a530-192b314c3e11 None admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:59.245291 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84871f-730d-4c27-a530-192b314c3e11 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:59.246228 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84871f-730d-4c27-a530-192b314c3e11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:59.247239 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84871f-730d-4c27-a530-192b314c3e11 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:59.257376 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 403/797] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:59.259393 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714650dd-90d5-4c4c-b51c-c28358923720 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:59.259891 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714650dd-90d5-4c4c-b51c-c28358923720 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:59.260370 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714650dd-90d5-4c4c-b51c-c28358923720 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:59.262211 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 404/798] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:07:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:59.263247 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714650dd-90d5-4c4c-b51c-c28358923720 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:59.273350 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 395/799] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Jun 29 12:07:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:59.273350 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157b9ad-bacd-4970-a5b3-5fc3553e99f6 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:59.273350 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157b9ad-bacd-4970-a5b3-5fc3553e99f6 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:59.273350 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157b9ad-bacd-4970-a5b3-5fc3553e99f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:59.288770 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-d157b9ad-bacd-4970-a5b3-5fc3553e99f6 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:59.289995 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-d157b9ad-bacd-4970-a5b3-5fc3553e99f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:59.366000 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 396/800] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:07:59.367191 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157b9ad-bacd-4970-a5b3-5fc3553e99f6 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:59.387440 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714650dd-90d5-4c4c-b51c-c28358923720 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:59.427173 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660dae1d-0d80-4655-bb91-63135d07bafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:59.428925 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660dae1d-0d80-4655-bb91-63135d07bafe None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:59.429781 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660dae1d-0d80-4655-bb91-63135d07bafe None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:59.430595 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660dae1d-0d80-4655-bb91-63135d07bafe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:59.440966 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660dae1d-0d80-4655-bb91-63135d07bafe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:59.443661 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660dae1d-0d80-4655-bb91-63135d07bafe None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:59.450331 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:59.462998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-660dae1d-0d80-4655-bb91-63135d07bafe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:59.462998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:59.462998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:59.462998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:59.462998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:59.462998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:59.462998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:59.462998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:59.462998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:59.462998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:59.462998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:59.462998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:59.462998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:07:59.462998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:07:59.462998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:07:59.463973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:07:59.463973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:59.463973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:59.463973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:59.463973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:59.463973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:59.463973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:59.463973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:59.463973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:59.463973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:59.463973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:59.463973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:59.463973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:59.463973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:59.463973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:59.463973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:59.463973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:59.464884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:07:59.464884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:07:59.464884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:07:59.464884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:07:59.464884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:07:59.464884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:07:59.464884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:07:59.464884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:59.467640 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 405/801] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:59.473332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660dae1d-0d80-4655-bb91-63135d07bafe None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:59.485280 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157b9ad-bacd-4970-a5b3-5fc3553e99f6 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:59.509971 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:59.526772 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400516cb-cef6-479c-9eaf-844c05c07282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:59.527584 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400516cb-cef6-479c-9eaf-844c05c07282 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:59.527915 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400516cb-cef6-479c-9eaf-844c05c07282 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:59.528198 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400516cb-cef6-479c-9eaf-844c05c07282 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:59.540615 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400516cb-cef6-479c-9eaf-844c05c07282 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:59.542103 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400516cb-cef6-479c-9eaf-844c05c07282 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:59.563005 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-400516cb-cef6-479c-9eaf-844c05c07282 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:59.563005 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:59.563005 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:59.563005 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:59.563005 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:59.563005 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:59.563005 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:59.563005 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:59.563005 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:59.563005 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:59.563005 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:59.563005 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:59.563005 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:59.563005 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:59.563005 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:59.563958 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:59.563958 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:59.563958 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:59.563958 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:59.563958 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:59.563958 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:59.563958 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:59.563958 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:59.563958 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:59.563958 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:59.563958 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:59.563958 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:59.563958 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:59.563958 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:59.563958 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:59.563958 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:59.563958 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:59.564852 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:59.564852 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:59.564852 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:59.564852 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:07:59.569268 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 397/802] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:59.570170 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400516cb-cef6-479c-9eaf-844c05c07282 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:59.591995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660dae1d-0d80-4655-bb91-63135d07bafe None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:59.630398 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c138507-e26f-4dcd-8a44-6977af9e3301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:59.631694 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c138507-e26f-4dcd-8a44-6977af9e3301 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:59.632200 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c138507-e26f-4dcd-8a44-6977af9e3301 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:59.632697 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c138507-e26f-4dcd-8a44-6977af9e3301 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:59.633661 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c138507-e26f-4dcd-8a44-6977af9e3301 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:59.635443 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c138507-e26f-4dcd-8a44-6977af9e3301 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:59.649288 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-3c138507-e26f-4dcd-8a44-6977af9e3301 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 12:07:59.649288 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:59.649288 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:07:59.649288 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:07:59.649288 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:07:59.649288 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:07:59.649288 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:07:59.649288 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:07:59.649288 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 12:07:59.649288 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:59.649288 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:07:59.649288 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:59.649288 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:59.649288 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:59.649288 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:59.649288 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:59.650279 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:59.650279 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:59.650279 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:59.650279 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:59.650279 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:59.650279 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:59.650279 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:59.650279 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:07:59.650279 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:07:59.650279 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:07:59.650279 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:07:59.650279 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:59.650279 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:59.650279 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:59.650279 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:59.650279 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:59.651144 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:59.651144 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:59.651144 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:59.651144 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:59.651144 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:59.651144 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:59.651144 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:59.651144 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:59.651144 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:59.651144 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:59.651144 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:59.651144 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:07:59.651144 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:07:59.651144 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 12:07:59.651144 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:07:59.654119 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 406/803] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Jun 29 12:07:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:59.655426 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c138507-e26f-4dcd-8a44-6977af9e3301 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:59.696715 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400516cb-cef6-479c-9eaf-844c05c07282 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:59.740345 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:59.758431 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c7e00-0e9f-4842-9ac4-0503ade74419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:59.759471 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c7e00-0e9f-4842-9ac4-0503ade74419 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:59.759902 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c7e00-0e9f-4842-9ac4-0503ade74419 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:59.760322 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c7e00-0e9f-4842-9ac4-0503ade74419 None admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:59.763585 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c7e00-0e9f-4842-9ac4-0503ade74419 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:59.764194 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c7e00-0e9f-4842-9ac4-0503ade74419 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:59.766810 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c7e00-0e9f-4842-9ac4-0503ade74419 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:59.768863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:59.776297 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c138507-e26f-4dcd-8a44-6977af9e3301 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:59.795951 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 398/804] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:07:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:59.795951 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c7e00-0e9f-4842-9ac4-0503ade74419 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:59.820625 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9382bdb-29d7-4b77-90fb-ec57c0e50825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:59.821697 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9382bdb-29d7-4b77-90fb-ec57c0e50825 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:59.822190 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9382bdb-29d7-4b77-90fb-ec57c0e50825 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:59.822718 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9382bdb-29d7-4b77-90fb-ec57c0e50825 None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:59.823661 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9382bdb-29d7-4b77-90fb-ec57c0e50825 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:59.824306 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9382bdb-29d7-4b77-90fb-ec57c0e50825 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:59.826035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9382bdb-29d7-4b77-90fb-ec57c0e50825 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:59.842352 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 407/805] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:59.844438 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9382bdb-29d7-4b77-90fb-ec57c0e50825 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:59.965460 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c7e00-0e9f-4842-9ac4-0503ade74419 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:59.970203 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9382bdb-29d7-4b77-90fb-ec57c0e50825 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:00.005463 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863640c-0bc2-48e9-a169-38f9b0a418c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:00.006139 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863640c-0bc2-48e9-a169-38f9b0a418c2 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:00.006419 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863640c-0bc2-48e9-a169-38f9b0a418c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:00.006721 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863640c-0bc2-48e9-a169-38f9b0a418c2 None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:00.007422 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863640c-0bc2-48e9-a169-38f9b0a418c2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:00.007731 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863640c-0bc2-48e9-a169-38f9b0a418c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:00.009130 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863640c-0bc2-48e9-a169-38f9b0a418c2 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:00.018853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 399/806] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Jun 29 12:07:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:00.018853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863640c-0bc2-48e9-a169-38f9b0a418c2 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:00.030407 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4582ccb-ad59-41ec-b73b-dc4fae804694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:00.031411 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4582ccb-ad59-41ec-b73b-dc4fae804694 None admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:00.031898 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4582ccb-ad59-41ec-b73b-dc4fae804694 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:00.032280 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4582ccb-ad59-41ec-b73b-dc4fae804694 None admin] PATH_INFO: `/v3/projects/489877ae137244c5b83291671c703c99/users/2891b5a315b64f228f665e024b641629/roles/0be824a9ecd0492f984e3b3b991e3984` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:00.050384 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4582ccb-ad59-41ec-b73b-dc4fae804694 None admin] RBAC: Authorizing `identity:create_grant(project_id=489877ae137244c5b83291671c703c99, user_id=2891b5a315b64f228f665e024b641629, role_id=0be824a9ecd0492f984e3b3b991e3984)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:00.051910 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4582ccb-ad59-41ec-b73b-dc4fae804694 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:00.068114 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 408/807] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 29 12:07:59 2022] PUT /identity/v3/projects/489877ae137244c5b83291671c703c99/users/2891b5a315b64f228f665e024b641629/roles/0be824a9ecd0492f984e3b3b991e3984 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:08:00.073856 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:00.077863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a10cd-aaf2-4a26-ace3-ae5c24b1a3fb None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:00.079624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a10cd-aaf2-4a26-ace3-ae5c24b1a3fb None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:00.080659 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a10cd-aaf2-4a26-ace3-ae5c24b1a3fb None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:00.086761 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 409/808] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:00 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:00.088498 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a10cd-aaf2-4a26-ace3-ae5c24b1a3fb None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:00.104495 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:00.179327 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863640c-0bc2-48e9-a169-38f9b0a418c2 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:00.227627 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a416ad-515b-40ea-b3b1-7ef920f339c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:00.228364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a416ad-515b-40ea-b3b1-7ef920f339c8 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:00.228715 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a416ad-515b-40ea-b3b1-7ef920f339c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:00.229131 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a416ad-515b-40ea-b3b1-7ef920f339c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:00.240490 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a416ad-515b-40ea-b3b1-7ef920f339c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:00.241977 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a416ad-515b-40ea-b3b1-7ef920f339c8 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:00.258223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-d1a416ad-515b-40ea-b3b1-7ef920f339c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:00.258223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:00.258223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:00.258223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:00.258223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:00.258223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:00.258223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:00.258223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:00.258223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:00.258223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:00.258223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:00.258223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:00.258223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:00.258223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:00.258223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:00.260109 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:00.260109 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:00.260109 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:00.260109 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:00.260109 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:00.260109 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:00.260109 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:00.260109 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:00.260109 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:00.260109 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:00.260109 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:00.260109 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:00.260109 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:00.260109 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:00.260109 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:00.260109 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:00.260109 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:00.261813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:00.261813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:00.261813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:00.261813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:00.261813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:00.261813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:00.261813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:00.261813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:00.261813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 400/809] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:00.261813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ccd0c-9ef5-49bb-9f05-5183580ed75d None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:00.261813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ccd0c-9ef5-49bb-9f05-5183580ed75d None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:00.263582 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ccd0c-9ef5-49bb-9f05-5183580ed75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:00.279767 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-c55ccd0c-9ef5-49bb-9f05-5183580ed75d None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:00.281036 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-c55ccd0c-9ef5-49bb-9f05-5183580ed75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:00.281641 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a10cd-aaf2-4a26-ace3-ae5c24b1a3fb None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:00.318750 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc98c79-38e5-4c30-b885-c0ce23905ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:00.319453 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc98c79-38e5-4c30-b885-c0ce23905ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:00.319739 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc98c79-38e5-4c30-b885-c0ce23905ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:00.320018 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc98c79-38e5-4c30-b885-c0ce23905ec9 None admin] PATH_INFO: `/v3/services` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:00.320735 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc98c79-38e5-4c30-b885-c0ce23905ec9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:00.321048 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc98c79-38e5-4c30-b885-c0ce23905ec9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:00.322442 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc98c79-38e5-4c30-b885-c0ce23905ec9 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:00.327927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 410/810] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Jun 29 12:08:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:00.329371 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fbeec-7baa-42f8-8e94-7a1909115a75 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:00.329664 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fbeec-7baa-42f8-8e94-7a1909115a75 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:00.329944 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fbeec-7baa-42f8-8e94-7a1909115a75 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:00.331374 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 411/811] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:00.336074 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fbeec-7baa-42f8-8e94-7a1909115a75 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:00.358482 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 401/812] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:00.359690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ccd0c-9ef5-49bb-9f05-5183580ed75d None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:00.405203 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:00.421537 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:00.459536 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fbeec-7baa-42f8-8e94-7a1909115a75 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:00.473632 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ccd0c-9ef5-49bb-9f05-5183580ed75d None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:00.497973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8452f9f-e7a6-42dd-997a-a60ff955d1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:00.498545 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8452f9f-e7a6-42dd-997a-a60ff955d1e4 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:00.498904 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8452f9f-e7a6-42dd-997a-a60ff955d1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:00.499168 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8452f9f-e7a6-42dd-997a-a60ff955d1e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:00.499920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8452f9f-e7a6-42dd-997a-a60ff955d1e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:00.500741 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8452f9f-e7a6-42dd-997a-a60ff955d1e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:00.502510 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8452f9f-e7a6-42dd-997a-a60ff955d1e4 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:00.522114 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53509f8d-7823-43d2-b7e5-9f31e5cc3e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:00.523372 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53509f8d-7823-43d2-b7e5-9f31e5cc3e81 None admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:00.523985 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53509f8d-7823-43d2-b7e5-9f31e5cc3e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:00.524374 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53509f8d-7823-43d2-b7e5-9f31e5cc3e81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:00.526062 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53509f8d-7823-43d2-b7e5-9f31e5cc3e81 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:00.528639 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53509f8d-7823-43d2-b7e5-9f31e5cc3e81 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:00.531232 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 412/813] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:08:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:00.532660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e2d72-33a5-4d51-a06f-6c91bfb1b268 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:00.533113 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e2d72-33a5-4d51-a06f-6c91bfb1b268 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:00.533559 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e2d72-33a5-4d51-a06f-6c91bfb1b268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:00.559709 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-484e2d72-33a5-4d51-a06f-6c91bfb1b268 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:00.561615 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-484e2d72-33a5-4d51-a06f-6c91bfb1b268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:00.571736 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 402/814] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Jun 29 12:08:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:08:00.571736 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53509f8d-7823-43d2-b7e5-9f31e5cc3e81 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:00.697748 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 413/815] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:00.699116 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e2d72-33a5-4d51-a06f-6c91bfb1b268 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:00.705162 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:00.717272 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53509f8d-7823-43d2-b7e5-9f31e5cc3e81 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:00.761802 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e40e82-bdf4-418f-953c-7f703a93e4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:00.762780 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e40e82-bdf4-418f-953c-7f703a93e4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:00.763164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e40e82-bdf4-418f-953c-7f703a93e4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:00.763535 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e40e82-bdf4-418f-953c-7f703a93e4d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:00.776709 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e40e82-bdf4-418f-953c-7f703a93e4d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:00.785026 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-c6e40e82-bdf4-418f-953c-7f703a93e4d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:08:00.785026 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:00.785026 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:00.785026 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:00.785026 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:00.785026 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:00.785026 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:00.785026 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:00.785026 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:00.785026 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:00.785026 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:00.785026 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:00.785026 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:00.785026 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:00.785026 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:00.785026 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:00.786529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:00.786529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:00.786529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:00.786529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:00.786529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:00.786529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:00.786529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:00.786529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:00.786529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:00.786529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:00.786529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:00.786529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:00.786529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:00.786529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:00.786529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:00.786529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:00.787441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:00.787441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:00.787441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:00.787441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:00.787441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:00.787441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:00.787441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:00.787441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:00.787441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:00.787441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:00.787441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:08:00.787441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:00.787441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 403/816] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:08:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:00.787441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e40e82-bdf4-418f-953c-7f703a93e4d7 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:00.798482 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:00.868681 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e2d72-33a5-4d51-a06f-6c91bfb1b268 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:00.922187 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e40e82-bdf4-418f-953c-7f703a93e4d7 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:00.928116 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2db39-3d49-4296-95d9-368e9bfc2f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:00.929522 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2db39-3d49-4296-95d9-368e9bfc2f71 None admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:00.929942 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2db39-3d49-4296-95d9-368e9bfc2f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:00.930392 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2db39-3d49-4296-95d9-368e9bfc2f71 None admin] PATH_INFO: `/v3/projects/489877ae137244c5b83291671c703c99/users/11efdbeeaa5c428aa344f7f0f5b061ba/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:00.934209 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2db39-3d49-4296-95d9-368e9bfc2f71 None admin] RBAC: Authorizing `identity:create_grant(project_id=489877ae137244c5b83291671c703c99, user_id=11efdbeeaa5c428aa344f7f0f5b061ba, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:00.937147 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2db39-3d49-4296-95d9-368e9bfc2f71 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:00.964930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 414/817] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 29 12:08:00 2022] PUT /identity/v3/projects/489877ae137244c5b83291671c703c99/users/11efdbeeaa5c428aa344f7f0f5b061ba/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:08:00.965912 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2db39-3d49-4296-95d9-368e9bfc2f71 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:00.979739 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28cc2bb-d138-4ba4-9f95-bb7e4d4ea1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:00.980789 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cc2bb-d138-4ba4-9f95-bb7e4d4ea1dc None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:00.981073 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cc2bb-d138-4ba4-9f95-bb7e4d4ea1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:00.981349 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cc2bb-d138-4ba4-9f95-bb7e4d4ea1dc None admin] PATH_INFO: `/v3/services/network` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:00.982088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cc2bb-d138-4ba4-9f95-bb7e4d4ea1dc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:00.983618 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cc2bb-d138-4ba4-9f95-bb7e4d4ea1dc None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:01.012345 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-a28cc2bb-d138-4ba4-9f95-bb7e4d4ea1dc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 12:08:01.012345 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:01.012345 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:08:01.012345 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:08:01.012345 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:08:01.012345 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:08:01.012345 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:08:01.012345 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:01.012345 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 12:08:01.012345 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:01.012345 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:08:01.012345 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:01.012345 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:01.012345 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:01.012345 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:01.012345 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:01.012345 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:01.013374 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:01.013374 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:01.013374 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:01.013374 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:01.013374 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:01.013374 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:01.013374 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:08:01.013374 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:08:01.013374 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:08:01.013374 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:08:01.013374 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:01.013374 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:01.013374 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:01.013374 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:01.013374 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:01.013374 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:01.014214 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:01.014214 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:01.014214 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:01.014214 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:01.014214 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:01.014214 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:01.014214 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:01.014214 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:01.014214 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:01.014214 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:01.014214 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:08:01.014214 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:01.014214 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 12:08:01.014214 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:01.021780 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 404/818] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:00 2022] GET /identity/v3/services/network => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:01.024580 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28cc2bb-d138-4ba4-9f95-bb7e4d4ea1dc None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:01.073533 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:01.158621 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2db39-3d49-4296-95d9-368e9bfc2f71 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:01.192821 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:01.229731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181fa32-b9d2-42ea-8ef6-36e2292ebaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:01.231220 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181fa32-b9d2-42ea-8ef6-36e2292ebaee None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:01.232104 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181fa32-b9d2-42ea-8ef6-36e2292ebaee None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:01.233274 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181fa32-b9d2-42ea-8ef6-36e2292ebaee None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:01.235324 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181fa32-b9d2-42ea-8ef6-36e2292ebaee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:01.236514 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181fa32-b9d2-42ea-8ef6-36e2292ebaee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:01.239768 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181fa32-b9d2-42ea-8ef6-36e2292ebaee None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:01.248027 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28cc2bb-d138-4ba4-9f95-bb7e4d4ea1dc None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:01.254373 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 415/819] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:08:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:01.255831 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181fa32-b9d2-42ea-8ef6-36e2292ebaee None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:01.324709 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41501ad8-fca0-4f8a-b8a7-5f7962cdb965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:01.325819 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41501ad8-fca0-4f8a-b8a7-5f7962cdb965 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:01.326138 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41501ad8-fca0-4f8a-b8a7-5f7962cdb965 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:01.326563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41501ad8-fca0-4f8a-b8a7-5f7962cdb965 None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:01.337722 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41501ad8-fca0-4f8a-b8a7-5f7962cdb965 None admin] RBAC: Adding query filter params (name=network) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:01.339738 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41501ad8-fca0-4f8a-b8a7-5f7962cdb965 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:01.345398 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41501ad8-fca0-4f8a-b8a7-5f7962cdb965 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:01.362220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 405/820] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Jun 29 12:08:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:01.370755 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41501ad8-fca0-4f8a-b8a7-5f7962cdb965 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:01.477662 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181fa32-b9d2-42ea-8ef6-36e2292ebaee None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:01.518727 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:01.553263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41501ad8-fca0-4f8a-b8a7-5f7962cdb965 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:01.583800 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b4744-bb8b-4615-b264-2e224db5f1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:01.584527 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b4744-bb8b-4615-b264-2e224db5f1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:01.584807 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b4744-bb8b-4615-b264-2e224db5f1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:01.585078 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b4744-bb8b-4615-b264-2e224db5f1e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:01.614997 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92936ebd-0e38-4a61-be0a-978137d93355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:01.615847 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b4744-bb8b-4615-b264-2e224db5f1e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:01.615986 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92936ebd-0e38-4a61-be0a-978137d93355 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:01.616416 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92936ebd-0e38-4a61-be0a-978137d93355 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:01.616832 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92936ebd-0e38-4a61-be0a-978137d93355 None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:01.617385 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b4744-bb8b-4615-b264-2e224db5f1e5 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:01.618046 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92936ebd-0e38-4a61-be0a-978137d93355 None admin] RBAC: Adding query filter params (type=network) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:01.618517 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92936ebd-0e38-4a61-be0a-978137d93355 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:01.620967 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92936ebd-0e38-4a61-be0a-978137d93355 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:01.635136 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 406/821] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Jun 29 12:08:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:01.639509 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92936ebd-0e38-4a61-be0a-978137d93355 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:01.658797 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-276b4744-bb8b-4615-b264-2e224db5f1e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:01.658797 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:01.658797 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:01.658797 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:01.658797 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:01.658797 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:01.658797 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:01.658797 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:01.658797 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:01.658797 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:01.658797 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:01.658797 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:01.658797 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:01.658797 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:01.658797 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:01.659776 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:01.659776 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:01.659776 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:01.659776 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:01.659776 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:01.659776 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:01.659776 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:01.659776 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:01.659776 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:01.659776 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:01.659776 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:01.659776 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:01.659776 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:01.659776 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:01.659776 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:01.659776 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:01.659776 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:01.661532 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:01.661532 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:01.661532 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:01.661532 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:01.661532 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 416/822] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:01.687718 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b4744-bb8b-4615-b264-2e224db5f1e5 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:01.796961 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:01.830664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92936ebd-0e38-4a61-be0a-978137d93355 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:01.889059 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d59d2-b0e1-4407-bb03-fcfcb2ed78f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:01.889966 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d59d2-b0e1-4407-bb03-fcfcb2ed78f9 None admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:01.890408 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d59d2-b0e1-4407-bb03-fcfcb2ed78f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:01.890866 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d59d2-b0e1-4407-bb03-fcfcb2ed78f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:01.892839 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d59d2-b0e1-4407-bb03-fcfcb2ed78f9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:01.895887 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d59d2-b0e1-4407-bb03-fcfcb2ed78f9 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:01.935261 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 407/823] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Jun 29 12:08:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:08:01.966986 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b4744-bb8b-4615-b264-2e224db5f1e5 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:02.013796 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b05d2-3be7-4e69-ac44-accb496e8ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:02.014473 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b05d2-3be7-4e69-ac44-accb496e8ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:02.014831 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b05d2-3be7-4e69-ac44-accb496e8ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:02.015106 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b05d2-3be7-4e69-ac44-accb496e8ad1 None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:02.015829 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b05d2-3be7-4e69-ac44-accb496e8ad1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:02.016133 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b05d2-3be7-4e69-ac44-accb496e8ad1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:02.017582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b05d2-3be7-4e69-ac44-accb496e8ad1 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:02.032562 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 417/824] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:02.040774 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d59d2-b0e1-4407-bb03-fcfcb2ed78f9 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:02.050404 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:02.210961 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d59d2-b0e1-4407-bb03-fcfcb2ed78f9 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:02.253376 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7cf69-2380-437c-9b6d-aac0f862505a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:02.254892 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7cf69-2380-437c-9b6d-aac0f862505a None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:02.255192 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7cf69-2380-437c-9b6d-aac0f862505a None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:02.255472 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7cf69-2380-437c-9b6d-aac0f862505a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:02.264011 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7cf69-2380-437c-9b6d-aac0f862505a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:02.265486 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7cf69-2380-437c-9b6d-aac0f862505a None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:02.283977 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-96c7cf69-2380-437c-9b6d-aac0f862505a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:08:02.283977 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:02.283977 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:02.283977 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:02.283977 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:02.283977 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:02.283977 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:02.283977 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:02.283977 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:02.283977 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:02.283977 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:02.283977 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:02.283977 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:08:02.283977 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:08:02.283977 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:08:02.283977 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:08:02.285009 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:02.285009 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:02.285009 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:02.285009 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:02.285009 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:02.285009 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:02.285009 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:02.285009 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:02.285009 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:02.285009 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:02.285009 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:02.285009 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:02.285009 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:02.285009 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:02.285009 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:02.285009 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:02.285009 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:02.285009 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:02.285997 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:02.285997 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:02.285997 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:08:02.285997 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:08:02.285997 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:08:02.285997 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:08:02.285997 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:08:02.285997 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:08:02.285997 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:08:02.285997 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:02.285997 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 408/825] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Jun 29 12:08:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:02.293909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b05d2-3be7-4e69-ac44-accb496e8ad1 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:02.412215 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:02.434496 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b05d2-3be7-4e69-ac44-accb496e8ad1 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:02.443168 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15256b8f-e85e-46a7-92ff-5a6d6f9a3ca9 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:02.443599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15256b8f-e85e-46a7-92ff-5a6d6f9a3ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:02.444068 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15256b8f-e85e-46a7-92ff-5a6d6f9a3ca9 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:02.450378 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 409/826] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:08:02.453606 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ada5bf-5c9c-4cc0-9726-342a1d3b6f69 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:02.453895 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ada5bf-5c9c-4cc0-9726-342a1d3b6f69 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:02.454173 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ada5bf-5c9c-4cc0-9726-342a1d3b6f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:02.476895 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-21ada5bf-5c9c-4cc0-9726-342a1d3b6f69 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:02.478087 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a837d96-3bea-4f32-8744-46d08766c1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:02.478791 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-21ada5bf-5c9c-4cc0-9726-342a1d3b6f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:02.478918 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a837d96-3bea-4f32-8744-46d08766c1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:02.479104 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a837d96-3bea-4f32-8744-46d08766c1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:02.479382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a837d96-3bea-4f32-8744-46d08766c1a8 None admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:02.480224 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a837d96-3bea-4f32-8744-46d08766c1a8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:02.480534 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a837d96-3bea-4f32-8744-46d08766c1a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:02.482076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a837d96-3bea-4f32-8744-46d08766c1a8 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:02.501489 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 418/827] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Jun 29 12:08:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:02.507663 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a837d96-3bea-4f32-8744-46d08766c1a8 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:02.563485 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:02.584707 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 410/828] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:08:02.608135 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ada5bf-5c9c-4cc0-9726-342a1d3b6f69 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:02.639307 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a837d96-3bea-4f32-8744-46d08766c1a8 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:02.688874 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dda8a0-b32a-49c1-aca2-bad52533d63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:02.689534 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dda8a0-b32a-49c1-aca2-bad52533d63a None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:02.689816 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dda8a0-b32a-49c1-aca2-bad52533d63a None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:02.690092 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dda8a0-b32a-49c1-aca2-bad52533d63a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:02.710454 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:02.750935 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ada5bf-5c9c-4cc0-9726-342a1d3b6f69 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:02.789307 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9acd426-d81f-4926-b24f-32a4ee23e00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:02.790123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acd426-d81f-4926-b24f-32a4ee23e00a None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:02.790409 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acd426-d81f-4926-b24f-32a4ee23e00a None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:02.790711 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acd426-d81f-4926-b24f-32a4ee23e00a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:02.792472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dda8a0-b32a-49c1-aca2-bad52533d63a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:02.794798 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dda8a0-b32a-49c1-aca2-bad52533d63a None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:02.804304 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9acd426-d81f-4926-b24f-32a4ee23e00a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:02.812524 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-d9acd426-d81f-4926-b24f-32a4ee23e00a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:02.812524 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:02.812524 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:02.812524 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:02.812524 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:02.812524 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:02.812524 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:02.812524 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:02.812524 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:02.812524 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:02.812524 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:02.812524 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:02.812524 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:02.812524 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:02.812524 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:02.812524 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:02.813542 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:02.813542 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:02.813542 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:02.813542 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:02.813542 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:02.813542 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:02.813542 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:02.813542 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:02.813542 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:02.813542 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:02.813542 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:02.813542 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:02.813542 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:02.813542 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:02.813542 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:02.813542 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:02.814387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:02.814387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:02.814387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:02.814387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:02.814387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:02.814387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:02.814387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:02.814387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:02.814387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:02.814387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:02.814387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:02.814387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:02.819813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 411/829] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 29 12:08:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:02.820969 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9acd426-d81f-4926-b24f-32a4ee23e00a None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:02.882365 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:02.909597 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 419/830] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:02 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:08:02.917677 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dda8a0-b32a-49c1-aca2-bad52533d63a None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:02.945270 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9acd426-d81f-4926-b24f-32a4ee23e00a None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:02.966301 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:02.986054 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17160f0f-6f85-4446-9ce1-33858606eafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:02.987142 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17160f0f-6f85-4446-9ce1-33858606eafb None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:02.987636 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17160f0f-6f85-4446-9ce1-33858606eafb None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:02.988117 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17160f0f-6f85-4446-9ce1-33858606eafb None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:02.989117 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17160f0f-6f85-4446-9ce1-33858606eafb None admin] RBAC: Adding query filter params (name=service) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:02.989629 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17160f0f-6f85-4446-9ce1-33858606eafb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:02.991259 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17160f0f-6f85-4446-9ce1-33858606eafb None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:03.006057 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 412/831] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 29 12:08:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:03.007780 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17160f0f-6f85-4446-9ce1-33858606eafb None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:03.026271 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dda8a0-b32a-49c1-aca2-bad52533d63a None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:03.069154 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01b576-f97f-498b-b86e-31e25f45dd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:03.070037 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01b576-f97f-498b-b86e-31e25f45dd3b None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:03.070327 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01b576-f97f-498b-b86e-31e25f45dd3b None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:03.070611 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01b576-f97f-498b-b86e-31e25f45dd3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:03.082788 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e01b576-f97f-498b-b86e-31e25f45dd3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:03.084353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e01b576-f97f-498b-b86e-31e25f45dd3b None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:03.104376 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-2e01b576-f97f-498b-b86e-31e25f45dd3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:03.104376 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:03.104376 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:03.104376 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:03.104376 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:03.104376 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:03.104376 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:03.104376 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:03.104376 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:03.104376 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:03.104376 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:03.104376 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:03.104376 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:03.104376 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:03.104376 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:03.105341 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:03.105341 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:03.105341 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:03.105341 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:03.105341 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:03.105341 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:03.105341 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:03.105341 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:03.105341 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:03.105341 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:03.105341 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:03.105341 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:03.105341 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:03.105341 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:03.105341 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:03.105341 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:03.105341 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:03.107069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:03.107069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:03.107069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:03.107069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:03.110376 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 420/832] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:03.111553 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01b576-f97f-498b-b86e-31e25f45dd3b None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:03.215961 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:03.223398 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01b576-f97f-498b-b86e-31e25f45dd3b None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:03.254738 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17160f0f-6f85-4446-9ce1-33858606eafb None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:03.265106 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7e2f7-ab94-48b1-b7e5-a64de7f0e219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:03.265774 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7e2f7-ab94-48b1-b7e5-a64de7f0e219 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:03.266058 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7e2f7-ab94-48b1-b7e5-a64de7f0e219 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:03.266333 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7e2f7-ab94-48b1-b7e5-a64de7f0e219 None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:03.267084 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7e2f7-ab94-48b1-b7e5-a64de7f0e219 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:03.267397 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7e2f7-ab94-48b1-b7e5-a64de7f0e219 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:03.268798 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7e2f7-ab94-48b1-b7e5-a64de7f0e219 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:03.272805 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:03.288145 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 421/833] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:03.288145 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e8f87-d3be-438f-ae02-7b2f6ea7ed70 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:03.288145 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e8f87-d3be-438f-ae02-7b2f6ea7ed70 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:03.288145 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e8f87-d3be-438f-ae02-7b2f6ea7ed70 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:03.288145 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 422/834] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:03.293822 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e8f87-d3be-438f-ae02-7b2f6ea7ed70 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:03.306168 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95470f01-c3fa-4cb7-bb01-45f41d8de721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:03.307353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95470f01-c3fa-4cb7-bb01-45f41d8de721 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:03.307801 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95470f01-c3fa-4cb7-bb01-45f41d8de721 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:03.308100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95470f01-c3fa-4cb7-bb01-45f41d8de721 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:03.320549 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95470f01-c3fa-4cb7-bb01-45f41d8de721 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:03.322015 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95470f01-c3fa-4cb7-bb01-45f41d8de721 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:03.341418 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-95470f01-c3fa-4cb7-bb01-45f41d8de721 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:03.341418 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:03.341418 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:03.341418 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:03.341418 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:03.341418 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:03.341418 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:03.341418 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:03.341418 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:03.341418 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:03.341418 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:03.341418 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:03.341418 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:03.341418 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:03.341418 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:03.342387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:03.342387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:03.342387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:03.342387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:03.342387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:03.342387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:03.342387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:03.342387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:03.342387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:03.342387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:03.342387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:03.342387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:03.342387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:03.342387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:03.342387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:03.342387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:03.342387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:03.347631 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:03.347631 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:03.347631 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:03.347631 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:03.347631 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 413/835] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:03.347631 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21127d-623a-4b55-826c-a9ef4b4e9f6d None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:03.347631 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21127d-623a-4b55-826c-a9ef4b4e9f6d None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:03.347631 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21127d-623a-4b55-826c-a9ef4b4e9f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:03.366004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-ac21127d-623a-4b55-826c-a9ef4b4e9f6d None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:03.367206 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-ac21127d-623a-4b55-826c-a9ef4b4e9f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:03.429559 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e8f87-d3be-438f-ae02-7b2f6ea7ed70 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:03.450680 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 414/836] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:03.450680 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21127d-623a-4b55-826c-a9ef4b4e9f6d None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:03.491844 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402299d-e27a-44c8-90b3-58a61d681c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:03.493123 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402299d-e27a-44c8-90b3-58a61d681c81 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:03.493405 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402299d-e27a-44c8-90b3-58a61d681c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:03.493678 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402299d-e27a-44c8-90b3-58a61d681c81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:03.505019 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402299d-e27a-44c8-90b3-58a61d681c81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:03.507451 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402299d-e27a-44c8-90b3-58a61d681c81 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:03.526407 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-f402299d-e27a-44c8-90b3-58a61d681c81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:03.526407 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:03.526407 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:03.526407 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:03.526407 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:03.526407 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:03.526407 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:03.526407 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:03.526407 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:03.526407 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:03.526407 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:03.526407 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:03.526407 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:03.526407 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:03.526407 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:03.528259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:03.528259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:03.528259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:03.528259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:03.528259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:03.528259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:03.528259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:03.528259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:03.528259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:03.528259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:03.528259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:03.528259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:03.528259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:03.528259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:03.528259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:03.528259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:03.528259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:03.529818 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:03.529818 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:03.529818 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:03.529818 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:03.529818 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:03.529818 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:03.529818 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:03.529818 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:03.532394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 423/837] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:03.533177 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402299d-e27a-44c8-90b3-58a61d681c81 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:03.556781 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:03.585394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:03.592710 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21127d-623a-4b55-826c-a9ef4b4e9f6d None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:03.638212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbcfef-bd4a-4654-97ea-773502d8705c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:03.638212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbcfef-bd4a-4654-97ea-773502d8705c None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:03.638212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbcfef-bd4a-4654-97ea-773502d8705c None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:03.638212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbcfef-bd4a-4654-97ea-773502d8705c None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:03.638901 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcbcfef-bd4a-4654-97ea-773502d8705c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:03.638901 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcbcfef-bd4a-4654-97ea-773502d8705c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:03.639787 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcbcfef-bd4a-4654-97ea-773502d8705c None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:03.658476 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 415/838] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:03.661002 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbcfef-bd4a-4654-97ea-773502d8705c None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:03.680967 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402299d-e27a-44c8-90b3-58a61d681c81 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:03.734069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5f028-c1ce-4393-af39-490fceca6cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:03.735928 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5f028-c1ce-4393-af39-490fceca6cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:03.736403 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5f028-c1ce-4393-af39-490fceca6cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:03.736880 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5f028-c1ce-4393-af39-490fceca6cd9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:03.737996 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5f028-c1ce-4393-af39-490fceca6cd9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:03.741087 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5f028-c1ce-4393-af39-490fceca6cd9 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:03.756612 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-81a5f028-c1ce-4393-af39-490fceca6cd9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 12:08:03.756612 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:03.756612 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:08:03.756612 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:08:03.756612 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:08:03.756612 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:08:03.756612 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:08:03.756612 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:03.756612 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 12:08:03.756612 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:03.756612 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:08:03.756612 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:03.756612 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:03.756612 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:03.756612 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:03.756612 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:03.756612 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:03.758521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:03.758521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:03.758521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:03.758521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:03.758521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:03.758521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:03.758521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:08:03.758521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:08:03.758521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:08:03.758521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:08:03.758521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:03.758521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:03.758521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:03.758521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:03.758521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:03.758521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:03.760223 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:03.760223 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:03.760223 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:03.760223 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:03.760223 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:03.760223 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:03.760223 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:03.760223 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:03.760223 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:03.760223 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:03.760223 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:08:03.760223 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:03.760223 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 12:08:03.760223 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:03.760223 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 424/839] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 29 12:08:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:03.761252 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5f028-c1ce-4393-af39-490fceca6cd9 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:03.804260 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbcfef-bd4a-4654-97ea-773502d8705c None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:03.843548 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93745373-28f1-48ce-88e4-ec8a4293184a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:03.844220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93745373-28f1-48ce-88e4-ec8a4293184a None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:03.844501 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93745373-28f1-48ce-88e4-ec8a4293184a None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:03.844779 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93745373-28f1-48ce-88e4-ec8a4293184a None admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:03.846385 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93745373-28f1-48ce-88e4-ec8a4293184a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:03.846942 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93745373-28f1-48ce-88e4-ec8a4293184a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:03.848515 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93745373-28f1-48ce-88e4-ec8a4293184a None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:03.861882 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 416/840] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:08:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:03.862746 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93745373-28f1-48ce-88e4-ec8a4293184a None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:03.864777 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:03.882760 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:03.889057 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5f028-c1ce-4393-af39-490fceca6cd9 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:03.924615 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38edc959-acb5-47b8-9737-8810e40ca9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:03.925432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edc959-acb5-47b8-9737-8810e40ca9a9 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:03.926418 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edc959-acb5-47b8-9737-8810e40ca9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:03.926764 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edc959-acb5-47b8-9737-8810e40ca9a9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:03.934511 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38edc959-acb5-47b8-9737-8810e40ca9a9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:03.936001 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38edc959-acb5-47b8-9737-8810e40ca9a9 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:03.953259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-38edc959-acb5-47b8-9737-8810e40ca9a9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 12:08:03.953259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:03.953259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:03.953259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:03.953259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:03.953259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:03.953259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:03.953259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:03.953259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:03.953259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:03.953259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:03.953259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:03.953259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:08:03.953259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:08:03.953259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:08:03.953259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:08:03.954401 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:03.954401 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:03.954401 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:03.954401 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:03.954401 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:03.954401 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:03.954401 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:03.954401 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:03.954401 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:03.954401 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:03.954401 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:03.954401 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:03.954401 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:03.954401 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:03.954401 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:03.954401 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:03.954401 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:03.954401 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:03.955628 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:03.955628 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:03.955628 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:08:03.955628 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:08:03.955628 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:08:03.955628 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:08:03.955628 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:08:03.955628 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:08:03.955628 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 12:08:03.955628 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:03.956161 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 425/841] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Jun 29 12:08:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:03.958080 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb1bae-4316-454b-bf25-dff0240a67e7 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:03.958568 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb1bae-4316-454b-bf25-dff0240a67e7 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:03.959094 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb1bae-4316-454b-bf25-dff0240a67e7 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:03.961422 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 426/842] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:03.962877 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb1bae-4316-454b-bf25-dff0240a67e7 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:03.985810 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93745373-28f1-48ce-88e4-ec8a4293184a None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:04.022585 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f095781-ae39-4020-954a-8d37749a3421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:04.023174 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f095781-ae39-4020-954a-8d37749a3421 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:04.023453 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f095781-ae39-4020-954a-8d37749a3421 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:04.023731 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f095781-ae39-4020-954a-8d37749a3421 None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:04.024431 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f095781-ae39-4020-954a-8d37749a3421 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:04.024732 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f095781-ae39-4020-954a-8d37749a3421 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:04.026813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f095781-ae39-4020-954a-8d37749a3421 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:04.032360 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 417/843] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 29 12:08:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:04.033159 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f095781-ae39-4020-954a-8d37749a3421 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:04.075394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb1bae-4316-454b-bf25-dff0240a67e7 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:04.110877 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e85d5-06c5-4434-82a7-368ecfe1b4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:04.111827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e85d5-06c5-4434-82a7-368ecfe1b4aa None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:04.112110 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e85d5-06c5-4434-82a7-368ecfe1b4aa None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:04.112380 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e85d5-06c5-4434-82a7-368ecfe1b4aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:04.113733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e85d5-06c5-4434-82a7-368ecfe1b4aa None admin] RBAC: Adding query filter params (role.id=5ef3464f4436446b88430cdf7cc1a3d7, scope.project.id=489877ae137244c5b83291671c703c99, user.id=3fbcf547421b42e4b520f9246326bff8) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:04.114043 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e85d5-06c5-4434-82a7-368ecfe1b4aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:04.115516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e85d5-06c5-4434-82a7-368ecfe1b4aa None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:04.121769 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 427/844] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:08:03 2022] GET /identity/v3/role_assignments?user.id=3fbcf547421b42e4b520f9246326bff8&scope.project.id=489877ae137244c5b83291671c703c99&role.id=5ef3464f4436446b88430cdf7cc1a3d7 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:04.126733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd646e7-8a38-44cb-adea-c5a521510435 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:04.126733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd646e7-8a38-44cb-adea-c5a521510435 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:04.126733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd646e7-8a38-44cb-adea-c5a521510435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:04.138390 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:04.140081 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:04.154888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-cdd646e7-8a38-44cb-adea-c5a521510435 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:04.156331 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-cdd646e7-8a38-44cb-adea-c5a521510435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:04.171351 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f095781-ae39-4020-954a-8d37749a3421 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:04.214532 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bb806-2321-40a1-8639-1efd764de4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:04.215259 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bb806-2321-40a1-8639-1efd764de4ab None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:04.216095 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bb806-2321-40a1-8639-1efd764de4ab None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:04.216095 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bb806-2321-40a1-8639-1efd764de4ab None admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:04.216654 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1bb806-2321-40a1-8639-1efd764de4ab None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:04.216972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1bb806-2321-40a1-8639-1efd764de4ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:04.218682 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1bb806-2321-40a1-8639-1efd764de4ab None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:04.243919 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 418/845] 10.222.0.13 () {56 vars in 1149 bytes} [Wed Jun 29 12:08:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:04.243919 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bb806-2321-40a1-8639-1efd764de4ab None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:04.263179 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 428/846] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:04.265087 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd646e7-8a38-44cb-adea-c5a521510435 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:04.399028 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bb806-2321-40a1-8639-1efd764de4ab None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:04.416072 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd646e7-8a38-44cb-adea-c5a521510435 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:04.443599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11603176-a35c-4608-93d6-080f92208d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:04.444720 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11603176-a35c-4608-93d6-080f92208d56 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:04.445199 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11603176-a35c-4608-93d6-080f92208d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:04.445576 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11603176-a35c-4608-93d6-080f92208d56 None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:04.446372 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11603176-a35c-4608-93d6-080f92208d56 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:04.446950 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11603176-a35c-4608-93d6-080f92208d56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:04.448728 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11603176-a35c-4608-93d6-080f92208d56 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:04.455637 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 419/847] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 29 12:08:04 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:04.457298 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11603176-a35c-4608-93d6-080f92208d56 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:04.461509 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:04.467000 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae20246-6a56-4fea-ad5e-6e84d3d6b830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:04.468353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae20246-6a56-4fea-ad5e-6e84d3d6b830 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:04.468807 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae20246-6a56-4fea-ad5e-6e84d3d6b830 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:04.471272 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae20246-6a56-4fea-ad5e-6e84d3d6b830 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:04.474562 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:04.568362 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae20246-6a56-4fea-ad5e-6e84d3d6b830 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:04.571304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae20246-6a56-4fea-ad5e-6e84d3d6b830 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:04.650239 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11603176-a35c-4608-93d6-080f92208d56 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:04.698706 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca373e26-1b69-4ab3-bbc4-1bcc590b183b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:04.699587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca373e26-1b69-4ab3-bbc4-1bcc590b183b None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:04.699957 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca373e26-1b69-4ab3-bbc4-1bcc590b183b None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:04.700371 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca373e26-1b69-4ab3-bbc4-1bcc590b183b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:04.713912 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca373e26-1b69-4ab3-bbc4-1bcc590b183b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:04.715487 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 429/848] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:04 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:08:04.722004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-ca373e26-1b69-4ab3-bbc4-1bcc590b183b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:08:04.722004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:04.722004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:04.722004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:04.722004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:04.722004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:04.722004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:04.722004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:04.722004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:04.722004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:04.722004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:04.722004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:04.722004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:04.722004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:04.722004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:04.722004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:04.724368 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:04.724368 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:04.724368 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:04.724368 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:04.724368 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:04.724368 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:04.724368 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:04.724368 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:04.724368 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:04.724368 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:04.724368 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:04.724368 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:04.724368 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:04.724368 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:04.724368 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:04.724368 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:04.725972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:04.725972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:04.725972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:04.725972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:04.725972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:04.725972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:04.725972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:04.725972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:04.725972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:04.725972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:04.725972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:08:04.725972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:04.725972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 420/849] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:08:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:04.728736 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae20246-6a56-4fea-ad5e-6e84d3d6b830 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:04.729664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca373e26-1b69-4ab3-bbc4-1bcc590b183b None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:04.783162 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:04.806179 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:04.850922 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca373e26-1b69-4ab3-bbc4-1bcc590b183b None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:04.888435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae20246-6a56-4fea-ad5e-6e84d3d6b830 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:04.888668 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25528915-cfe5-4736-bbe4-7fae229532e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:04.889220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25528915-cfe5-4736-bbe4-7fae229532e3 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:04.889505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25528915-cfe5-4736-bbe4-7fae229532e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:04.889785 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25528915-cfe5-4736-bbe4-7fae229532e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:04.890536 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25528915-cfe5-4736-bbe4-7fae229532e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:04.890991 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25528915-cfe5-4736-bbe4-7fae229532e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:04.892509 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25528915-cfe5-4736-bbe4-7fae229532e3 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:04.907417 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 421/850] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:08:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:04.908581 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25528915-cfe5-4736-bbe4-7fae229532e3 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:04.943622 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675fc3b-6a6f-4a41-b469-53bb68814436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:04.944862 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675fc3b-6a6f-4a41-b469-53bb68814436 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:04.945287 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675fc3b-6a6f-4a41-b469-53bb68814436 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:04.945706 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675fc3b-6a6f-4a41-b469-53bb68814436 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:04.963902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f675fc3b-6a6f-4a41-b469-53bb68814436 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:04.966308 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f675fc3b-6a6f-4a41-b469-53bb68814436 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:04.997759 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-f675fc3b-6a6f-4a41-b469-53bb68814436 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:04.997759 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:04.997759 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:04.997759 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:04.997759 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:04.997759 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:04.997759 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:04.997759 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:04.997759 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:04.997759 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:04.997759 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:04.997759 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:04.997759 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:04.997759 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:04.997759 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:04.999855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:04.999855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:04.999855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:04.999855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:04.999855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:04.999855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:04.999855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:04.999855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:04.999855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:04.999855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:04.999855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:04.999855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:04.999855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:04.999855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:04.999855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:04.999855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:04.999855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:05.001910 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:05.001910 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:05.001910 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:05.001910 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:05.001910 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 430/851] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:05.008520 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675fc3b-6a6f-4a41-b469-53bb68814436 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:05.016191 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25528915-cfe5-4736-bbe4-7fae229532e3 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:05.042237 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:05.054141 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fdb81-0c5d-49da-86c6-4c6786c3ceea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:05.055167 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fdb81-0c5d-49da-86c6-4c6786c3ceea None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:05.055455 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fdb81-0c5d-49da-86c6-4c6786c3ceea None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:05.055737 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fdb81-0c5d-49da-86c6-4c6786c3ceea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:05.069572 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fdb81-0c5d-49da-86c6-4c6786c3ceea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:05.071548 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fdb81-0c5d-49da-86c6-4c6786c3ceea None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:05.103394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-ee1fdb81-0c5d-49da-86c6-4c6786c3ceea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:05.103394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:05.103394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:05.103394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:05.103394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:05.103394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:05.103394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:05.103394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:05.103394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:05.103394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:05.103394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:05.103394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:05.103394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:05.103394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:05.103394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:05.104344 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:05.104344 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:05.104344 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:05.104344 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:05.104344 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:05.104344 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:05.104344 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:05.104344 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:05.104344 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:05.104344 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:05.104344 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:05.104344 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:05.104344 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:05.104344 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:05.104344 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:05.104344 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:05.104344 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:05.105254 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:05.105254 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:05.105254 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:05.105254 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:05.105481 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:05.106916 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 422/852] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:05.113841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fdb81-0c5d-49da-86c6-4c6786c3ceea None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:05.142091 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675fc3b-6a6f-4a41-b469-53bb68814436 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:05.189066 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2c055-8203-4013-b4db-8a6a9c13cd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:05.190190 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2c055-8203-4013-b4db-8a6a9c13cd37 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:05.190731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2c055-8203-4013-b4db-8a6a9c13cd37 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:05.191799 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2c055-8203-4013-b4db-8a6a9c13cd37 None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:05.192862 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf2c055-8203-4013-b4db-8a6a9c13cd37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:05.193375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf2c055-8203-4013-b4db-8a6a9c13cd37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:05.195102 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf2c055-8203-4013-b4db-8a6a9c13cd37 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:05.209123 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 431/853] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:05.214222 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2c055-8203-4013-b4db-8a6a9c13cd37 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:05.262327 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fdb81-0c5d-49da-86c6-4c6786c3ceea None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:05.313061 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246c34e-4af6-4b99-a4d2-118fc5865bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:05.313809 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246c34e-4af6-4b99-a4d2-118fc5865bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:05.314089 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246c34e-4af6-4b99-a4d2-118fc5865bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:05.314393 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246c34e-4af6-4b99-a4d2-118fc5865bd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:05.315809 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246c34e-4af6-4b99-a4d2-118fc5865bd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:05.316120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246c34e-4af6-4b99-a4d2-118fc5865bd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:05.318983 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246c34e-4af6-4b99-a4d2-118fc5865bd2 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:05.329941 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2c055-8203-4013-b4db-8a6a9c13cd37 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:05.337076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 423/854] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:05.342470 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246c34e-4af6-4b99-a4d2-118fc5865bd2 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:05.377373 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f53f9c-8aa6-4e64-8348-4e29f3d9e02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:05.378807 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f53f9c-8aa6-4e64-8348-4e29f3d9e02f None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:05.380132 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f53f9c-8aa6-4e64-8348-4e29f3d9e02f None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:05.380853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f53f9c-8aa6-4e64-8348-4e29f3d9e02f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:05.387255 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:05.389702 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f53f9c-8aa6-4e64-8348-4e29f3d9e02f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:05.391487 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f53f9c-8aa6-4e64-8348-4e29f3d9e02f None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:05.408610 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-b9f53f9c-8aa6-4e64-8348-4e29f3d9e02f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:05.408610 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:05.408610 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:05.408610 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:05.408610 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:05.408610 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:05.408610 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:05.408610 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:05.408610 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:05.408610 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:05.408610 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:05.408610 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:05.408610 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:05.408610 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:05.408610 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:05.409598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:05.409598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:05.409598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:05.409598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:05.409598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:05.409598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:05.409598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:05.409598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:05.409598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:05.409598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:05.409598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:05.409598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:05.409598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:05.409598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:05.409598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:05.409598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:05.409598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:05.410556 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:05.410556 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:05.410556 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:05.410556 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:05.410556 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:05.410556 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:05.410556 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:05.410556 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:05.413396 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 432/855] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:05.419481 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f53f9c-8aa6-4e64-8348-4e29f3d9e02f None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:05.443120 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:05.471829 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246c34e-4af6-4b99-a4d2-118fc5865bd2 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:05.510563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d90ab7-9f02-4ccb-b6a9-f21c40d3a807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:05.511385 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d90ab7-9f02-4ccb-b6a9-f21c40d3a807 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:05.511666 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d90ab7-9f02-4ccb-b6a9-f21c40d3a807 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:05.512051 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d90ab7-9f02-4ccb-b6a9-f21c40d3a807 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:05.520610 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d90ab7-9f02-4ccb-b6a9-f21c40d3a807 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:05.522463 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d90ab7-9f02-4ccb-b6a9-f21c40d3a807 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:05.537885 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-61d90ab7-9f02-4ccb-b6a9-f21c40d3a807 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 12:08:05.537885 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:05.537885 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:05.537885 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:05.537885 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:05.537885 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:05.537885 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:05.537885 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:05.537885 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:05.537885 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:05.537885 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:05.537885 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:05.537885 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:08:05.537885 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:08:05.537885 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:08:05.537885 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:08:05.538898 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:05.538898 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:05.538898 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:05.538898 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:05.538898 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:05.538898 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:05.538898 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:05.538898 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:05.538898 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:05.538898 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:05.538898 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:05.538898 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:05.538898 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:05.538898 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:05.538898 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:05.538898 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:05.538898 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:05.538898 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:05.539854 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:05.539854 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:05.539854 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:08:05.539854 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:08:05.539854 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:08:05.539854 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:08:05.539854 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:08:05.539854 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:08:05.539854 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 12:08:05.539854 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:05.542976 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 424/856] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:08:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:05.545211 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d90ab7-9f02-4ccb-b6a9-f21c40d3a807 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:05.558023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f53f9c-8aa6-4e64-8348-4e29f3d9e02f None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:05.604004 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ea9b7-b1ed-4411-88c3-171ac977840c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:05.604916 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ea9b7-b1ed-4411-88c3-171ac977840c None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:05.605371 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ea9b7-b1ed-4411-88c3-171ac977840c None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:05.605785 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ea9b7-b1ed-4411-88c3-171ac977840c None admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:05.607055 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ea9b7-b1ed-4411-88c3-171ac977840c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:05.607517 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ea9b7-b1ed-4411-88c3-171ac977840c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:05.609950 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ea9b7-b1ed-4411-88c3-171ac977840c None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:05.635067 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 433/857] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:08:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:05.637881 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ea9b7-b1ed-4411-88c3-171ac977840c None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:05.664672 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:05.673136 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d90ab7-9f02-4ccb-b6a9-f21c40d3a807 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:05.715531 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b5095-cdfd-4309-839a-7f257d061c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:05.716554 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b5095-cdfd-4309-839a-7f257d061c90 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:05.717046 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b5095-cdfd-4309-839a-7f257d061c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:05.717816 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b5095-cdfd-4309-839a-7f257d061c90 None admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:05.719456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b5095-cdfd-4309-839a-7f257d061c90 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:05.719994 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b5095-cdfd-4309-839a-7f257d061c90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:05.722270 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b5095-cdfd-4309-839a-7f257d061c90 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:05.738007 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:05.750522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 425/858] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Jun 29 12:08:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:05.758778 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b5095-cdfd-4309-839a-7f257d061c90 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:05.792953 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ea9b7-b1ed-4411-88c3-171ac977840c None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:05.832393 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b822c-d0e7-47cd-a688-8585ff4e970b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:05.833313 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b822c-d0e7-47cd-a688-8585ff4e970b None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:05.833585 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b822c-d0e7-47cd-a688-8585ff4e970b None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:05.833956 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b822c-d0e7-47cd-a688-8585ff4e970b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:05.834896 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b822c-d0e7-47cd-a688-8585ff4e970b None admin] RBAC: Adding query filter params (role.id=0be824a9ecd0492f984e3b3b991e3984, scope.project.id=489877ae137244c5b83291671c703c99, user.id=2891b5a315b64f228f665e024b641629) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:05.835320 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b822c-d0e7-47cd-a688-8585ff4e970b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:05.836784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b822c-d0e7-47cd-a688-8585ff4e970b None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:05.850969 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 434/859] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:08:05 2022] GET /identity/v3/role_assignments?user.id=2891b5a315b64f228f665e024b641629&scope.project.id=489877ae137244c5b83291671c703c99&role.id=0be824a9ecd0492f984e3b3b991e3984 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:05.885353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b5095-cdfd-4309-839a-7f257d061c90 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:05.927240 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855c9ef-914c-44e4-b038-0ef878e293b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:05.928179 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855c9ef-914c-44e4-b038-0ef878e293b6 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:05.928619 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855c9ef-914c-44e4-b038-0ef878e293b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:05.929041 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855c9ef-914c-44e4-b038-0ef878e293b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:05.958462 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:06.010695 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855c9ef-914c-44e4-b038-0ef878e293b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:06.012383 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855c9ef-914c-44e4-b038-0ef878e293b6 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:06.133625 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 426/860] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:05 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:08:06.139591 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b822c-d0e7-47cd-a688-8585ff4e970b None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:06.245186 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b822c-d0e7-47cd-a688-8585ff4e970b None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:06.275040 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:06.281352 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568319c8-2473-44f7-a55e-f0aef712dae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:06.282510 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568319c8-2473-44f7-a55e-f0aef712dae0 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:06.283003 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568319c8-2473-44f7-a55e-f0aef712dae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:06.283460 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568319c8-2473-44f7-a55e-f0aef712dae0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:06.296279 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568319c8-2473-44f7-a55e-f0aef712dae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:06.298038 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568319c8-2473-44f7-a55e-f0aef712dae0 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:06.316266 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-568319c8-2473-44f7-a55e-f0aef712dae0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:06.316266 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:06.316266 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:06.316266 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:06.316266 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:06.316266 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:06.316266 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:06.316266 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:06.316266 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:06.316266 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:06.316266 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:06.316266 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:06.316266 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:06.316266 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:06.316266 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:06.317308 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:06.317308 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:06.317308 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:06.317308 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:06.317308 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:06.317308 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:06.317308 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:06.317308 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:06.317308 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:06.317308 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:06.317308 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:06.317308 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:06.317308 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:06.317308 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:06.317308 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:06.317308 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:06.317308 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:06.318218 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:06.318218 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:06.318218 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:06.318218 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:06.320215 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 435/861] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:06.326010 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855c9ef-914c-44e4-b038-0ef878e293b6 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:06.338915 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31455c-b40d-42ce-bc9a-f455cb904a98 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:06.339457 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31455c-b40d-42ce-bc9a-f455cb904a98 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:06.339871 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31455c-b40d-42ce-bc9a-f455cb904a98 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:06.341665 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 436/862] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:08:06.348575 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293ed88-7665-4175-866e-af397975d469 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:06.349052 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293ed88-7665-4175-866e-af397975d469 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:06.349498 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293ed88-7665-4175-866e-af397975d469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:06.367374 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-8293ed88-7665-4175-866e-af397975d469 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:06.368789 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-8293ed88-7665-4175-866e-af397975d469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:06.388156 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:06.436139 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855c9ef-914c-44e4-b038-0ef878e293b6 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:06.450912 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 437/863] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:08:06.466821 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293ed88-7665-4175-866e-af397975d469 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:06.473930 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81f2d0-b32d-434d-a8ed-07aa66faa658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:06.474722 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81f2d0-b32d-434d-a8ed-07aa66faa658 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:06.475082 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81f2d0-b32d-434d-a8ed-07aa66faa658 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:06.475434 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81f2d0-b32d-434d-a8ed-07aa66faa658 None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:06.476235 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81f2d0-b32d-434d-a8ed-07aa66faa658 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:06.476611 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81f2d0-b32d-434d-a8ed-07aa66faa658 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:06.478141 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81f2d0-b32d-434d-a8ed-07aa66faa658 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:06.491013 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 427/864] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:06.496071 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81f2d0-b32d-434d-a8ed-07aa66faa658 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:06.594754 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293ed88-7665-4175-866e-af397975d469 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:06.609061 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:06.633122 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a9439-5ab0-4af2-bdbf-e94bfb68dee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:06.633950 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a9439-5ab0-4af2-bdbf-e94bfb68dee7 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:06.634192 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81f2d0-b32d-434d-a8ed-07aa66faa658 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:06.634299 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a9439-5ab0-4af2-bdbf-e94bfb68dee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:06.634498 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a9439-5ab0-4af2-bdbf-e94bfb68dee7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:06.635279 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a9439-5ab0-4af2-bdbf-e94bfb68dee7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:06.636700 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a9439-5ab0-4af2-bdbf-e94bfb68dee7 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:06.650167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-474a9439-5ab0-4af2-bdbf-e94bfb68dee7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 12:08:06.650167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:06.650167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:08:06.650167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:08:06.650167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:08:06.650167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:08:06.650167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:08:06.650167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:06.650167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 12:08:06.650167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:06.650167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:08:06.650167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:06.650167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:06.650167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:06.650167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:06.650167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:06.651225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:06.651225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:06.651225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:06.651225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:06.651225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:06.651225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:06.651225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:06.651225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:08:06.651225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:08:06.651225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:08:06.651225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:08:06.651225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:06.651225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:06.651225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:06.651225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:06.651225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:06.652069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:06.652069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:06.652069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:06.652069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:06.652069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:06.652069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:06.652069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:06.652069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:06.652069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:06.652069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:06.652069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:06.652069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:08:06.652069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:06.652069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 12:08:06.652069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:06.654941 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:06.656430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 438/865] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Jun 29 12:08:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:06.657510 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a9439-5ab0-4af2-bdbf-e94bfb68dee7 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:06.683598 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34373a27-2a32-430b-acb8-174e2bec6369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:06.685246 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34373a27-2a32-430b-acb8-174e2bec6369 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:06.685843 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34373a27-2a32-430b-acb8-174e2bec6369 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:06.686286 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34373a27-2a32-430b-acb8-174e2bec6369 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:06.696533 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34373a27-2a32-430b-acb8-174e2bec6369 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:06.699246 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34373a27-2a32-430b-acb8-174e2bec6369 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:06.717680 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-34373a27-2a32-430b-acb8-174e2bec6369 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:06.717680 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:06.717680 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:06.717680 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:06.717680 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:06.717680 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:06.717680 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:06.717680 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:06.717680 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:06.717680 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:06.717680 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:06.717680 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:06.717680 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:06.717680 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:06.717680 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:06.718841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:06.718841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:06.718841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:06.718841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:06.718841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:06.718841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:06.718841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:06.718841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:06.718841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:06.718841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:06.718841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:06.718841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:06.718841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:06.718841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:06.718841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:06.718841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:06.718841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:06.719946 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:06.719946 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:06.719946 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:06.719946 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:06.719946 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:06.719946 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:06.719946 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:06.719946 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:06.727202 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 428/866] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:06.728147 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34373a27-2a32-430b-acb8-174e2bec6369 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:06.782304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a9439-5ab0-4af2-bdbf-e94bfb68dee7 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:06.819385 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedd865-6044-426c-b8c5-788aab0b44d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:06.820467 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedd865-6044-426c-b8c5-788aab0b44d8 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:06.820976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedd865-6044-426c-b8c5-788aab0b44d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:06.821461 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedd865-6044-426c-b8c5-788aab0b44d8 None admin] PATH_INFO: `/v3/services` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:06.822372 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aedd865-6044-426c-b8c5-788aab0b44d8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:06.822931 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aedd865-6044-426c-b8c5-788aab0b44d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:06.824519 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aedd865-6044-426c-b8c5-788aab0b44d8 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:06.834392 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 439/867] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Jun 29 12:08:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:06.835752 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedd865-6044-426c-b8c5-788aab0b44d8 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:06.869882 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34373a27-2a32-430b-acb8-174e2bec6369 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:06.884106 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:06.917398 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e112b7-2ace-40ce-b092-073e838f81db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:06.918069 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e112b7-2ace-40ce-b092-073e838f81db None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:06.918357 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e112b7-2ace-40ce-b092-073e838f81db None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:06.918657 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e112b7-2ace-40ce-b092-073e838f81db None admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:06.919858 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e112b7-2ace-40ce-b092-073e838f81db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:06.920176 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e112b7-2ace-40ce-b092-073e838f81db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:06.921928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e112b7-2ace-40ce-b092-073e838f81db None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:06.942872 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 429/868] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:08:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:06.944705 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e112b7-2ace-40ce-b092-073e838f81db None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:06.982453 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedd865-6044-426c-b8c5-788aab0b44d8 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:06.989175 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:07.033399 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b484f-86cf-4e20-80f4-16a6521d0850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:07.034359 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b484f-86cf-4e20-80f4-16a6521d0850 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:07.034843 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b484f-86cf-4e20-80f4-16a6521d0850 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:07.035124 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b484f-86cf-4e20-80f4-16a6521d0850 None admin] PATH_INFO: `/v3/services` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:07.035834 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b484f-86cf-4e20-80f4-16a6521d0850 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:07.036398 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b484f-86cf-4e20-80f4-16a6521d0850 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:07.037773 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b484f-86cf-4e20-80f4-16a6521d0850 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:07.042669 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 440/869] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Jun 29 12:08:06 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:07.043913 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7cff5-ec8c-4ce1-a1e3-2c36ea7586fa None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:07.044249 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7cff5-ec8c-4ce1-a1e3-2c36ea7586fa None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:07.044525 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7cff5-ec8c-4ce1-a1e3-2c36ea7586fa None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:07.045971 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 441/870] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:07.052191 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72372f-273a-4422-bab2-defcd212fbc0 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:07.052468 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72372f-273a-4422-bab2-defcd212fbc0 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:07.052736 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72372f-273a-4422-bab2-defcd212fbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:07.070704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e112b7-2ace-40ce-b092-073e838f81db None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:07.072128 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-bb72372f-273a-4422-bab2-defcd212fbc0 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:07.073464 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-bb72372f-273a-4422-bab2-defcd212fbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:07.117721 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37ebfd-2547-4fba-a7a9-a6fc4af96325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:07.118398 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37ebfd-2547-4fba-a7a9-a6fc4af96325 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:07.118762 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37ebfd-2547-4fba-a7a9-a6fc4af96325 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:07.119043 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37ebfd-2547-4fba-a7a9-a6fc4af96325 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:07.119950 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37ebfd-2547-4fba-a7a9-a6fc4af96325 None admin] RBAC: Adding query filter params (role.id=5ef3464f4436446b88430cdf7cc1a3d7, scope.project.id=489877ae137244c5b83291671c703c99, user.id=11efdbeeaa5c428aa344f7f0f5b061ba) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:07.120209 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37ebfd-2547-4fba-a7a9-a6fc4af96325 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:07.122671 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37ebfd-2547-4fba-a7a9-a6fc4af96325 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:07.133393 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 430/871] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:08:06 2022] GET /identity/v3/role_assignments?user.id=11efdbeeaa5c428aa344f7f0f5b061ba&scope.project.id=489877ae137244c5b83291671c703c99&role.id=5ef3464f4436446b88430cdf7cc1a3d7 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:07.161173 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 442/872] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:08:07.184064 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37ebfd-2547-4fba-a7a9-a6fc4af96325 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:07.313756 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:07.318196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37ebfd-2547-4fba-a7a9-a6fc4af96325 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:07.358173 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395c462-4e6a-4ab1-8adb-021b561a0e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:07.358872 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395c462-4e6a-4ab1-8adb-021b561a0e88 None admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:07.359156 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395c462-4e6a-4ab1-8adb-021b561a0e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:07.359429 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395c462-4e6a-4ab1-8adb-021b561a0e88 None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:07.360154 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395c462-4e6a-4ab1-8adb-021b561a0e88 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:07.361517 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395c462-4e6a-4ab1-8adb-021b561a0e88 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:07.378008 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 431/873] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Jun 29 12:08:07 2022] POST /identity/v3/services => generated 251 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:08:08.097801 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682085c-9e6e-47ca-a1ec-140f888664eb None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:08.098529 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682085c-9e6e-47ca-a1ec-140f888664eb None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:08.098529 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682085c-9e6e-47ca-a1ec-140f888664eb None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:08.099957 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 443/874] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:08.105110 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162762b-9e7c-4882-b9f0-e030daf46701 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:08.105756 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162762b-9e7c-4882-b9f0-e030daf46701 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:08.105756 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162762b-9e7c-4882-b9f0-e030daf46701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:08.123161 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-e162762b-9e7c-4882-b9f0-e030daf46701 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:08.124350 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-e162762b-9e7c-4882-b9f0-e030daf46701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:08.207293 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 432/875] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:08 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:08.228650 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682085c-9e6e-47ca-a1ec-140f888664eb None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:08.290031 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:08.366709 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682085c-9e6e-47ca-a1ec-140f888664eb None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:08.403177 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ec509-3118-4f2a-a80b-d0d3b6b2c2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:08.404002 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ec509-3118-4f2a-a80b-d0d3b6b2c2e8 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:08.404288 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ec509-3118-4f2a-a80b-d0d3b6b2c2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:08.404570 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ec509-3118-4f2a-a80b-d0d3b6b2c2e8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:08.415739 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ec509-3118-4f2a-a80b-d0d3b6b2c2e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:08.423851 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-8f7ec509-3118-4f2a-a80b-d0d3b6b2c2e8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 12:08:08.423851 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:08.423851 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:08.423851 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:08.423851 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:08.423851 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:08.423851 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:08.423851 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:08.423851 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:08.423851 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:08.423851 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:08.423851 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:08.423851 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:08.423851 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:08.423851 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:08.423851 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:08.426128 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:08.426128 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:08.426128 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:08.426128 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:08.426128 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:08.426128 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:08.426128 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:08.426128 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:08.426128 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:08.426128 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:08.426128 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:08.426128 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:08.426128 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:08.426128 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:08.426128 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:08.426128 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:08.429315 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:08.429315 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:08.429315 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:08.429315 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:08.429315 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:08.429315 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:08.429315 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:08.429315 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:08.429315 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:08.429315 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:08.429315 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 12:08:08.429315 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:08.431750 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 444/876] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Jun 29 12:08:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:08.431981 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e162762b-9e7c-4882-b9f0-e030daf46701 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:08.521031 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:08.537481 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e162762b-9e7c-4882-b9f0-e030daf46701 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:08.575954 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f59b1d-f550-4e4f-abff-19b2f7e8c889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:08.576632 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f59b1d-f550-4e4f-abff-19b2f7e8c889 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:08.576918 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f59b1d-f550-4e4f-abff-19b2f7e8c889 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:08.577199 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f59b1d-f550-4e4f-abff-19b2f7e8c889 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:08.577949 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f59b1d-f550-4e4f-abff-19b2f7e8c889 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:08.578261 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f59b1d-f550-4e4f-abff-19b2f7e8c889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:08.579661 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f59b1d-f550-4e4f-abff-19b2f7e8c889 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:08.592852 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 433/877] 10.222.0.13 () {56 vars in 1115 bytes} [Wed Jun 29 12:08:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:08.594187 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ec509-3118-4f2a-a80b-d0d3b6b2c2e8 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:08.756330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:08.767561 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ec509-3118-4f2a-a80b-d0d3b6b2c2e8 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:08.822805 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9cb5d-3483-4c60-9bc8-a6b2742e69fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:08.823996 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9cb5d-3483-4c60-9bc8-a6b2742e69fb None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:08.824492 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9cb5d-3483-4c60-9bc8-a6b2742e69fb None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:08.824996 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9cb5d-3483-4c60-9bc8-a6b2742e69fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:08.836927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9cb5d-3483-4c60-9bc8-a6b2742e69fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:08.838813 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9cb5d-3483-4c60-9bc8-a6b2742e69fb None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:08.858770 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-6ea9cb5d-3483-4c60-9bc8-a6b2742e69fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:08.858770 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:08.858770 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:08.858770 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:08.858770 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:08.858770 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:08.858770 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:08.858770 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:08.858770 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:08.858770 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:08.858770 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:08.858770 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:08.858770 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:08.858770 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:08.858770 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:08.859726 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:08.859726 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:08.859726 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:08.859726 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:08.859726 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:08.859726 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:08.859726 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:08.859726 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:08.859726 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:08.859726 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:08.859726 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:08.859726 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:08.859726 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:08.859726 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:08.859726 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:08.859726 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:08.859726 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:08.860629 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:08.860629 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:08.860629 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:08.860629 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:08.863463 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 445/878] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:08.872439 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f59b1d-f550-4e4f-abff-19b2f7e8c889 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:09.006371 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f59b1d-f550-4e4f-abff-19b2f7e8c889 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:09.043616 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2af290-cf4e-4a6b-8846-4f2dbb33cb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:09.044733 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2af290-cf4e-4a6b-8846-4f2dbb33cb41 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:09.045212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2af290-cf4e-4a6b-8846-4f2dbb33cb41 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:09.045687 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2af290-cf4e-4a6b-8846-4f2dbb33cb41 None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:09.047001 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2af290-cf4e-4a6b-8846-4f2dbb33cb41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:09.047534 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2af290-cf4e-4a6b-8846-4f2dbb33cb41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:09.049976 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2af290-cf4e-4a6b-8846-4f2dbb33cb41 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:09.070795 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 434/879] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:09.072973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9cb5d-3483-4c60-9bc8-a6b2742e69fb None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:09.187945 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9cb5d-3483-4c60-9bc8-a6b2742e69fb None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:09.229545 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075660a4-cff8-4b45-b436-0987f733fd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:09.230418 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075660a4-cff8-4b45-b436-0987f733fd08 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:09.230738 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075660a4-cff8-4b45-b436-0987f733fd08 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:09.231020 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075660a4-cff8-4b45-b436-0987f733fd08 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:09.239184 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075660a4-cff8-4b45-b436-0987f733fd08 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:09.241075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075660a4-cff8-4b45-b436-0987f733fd08 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:09.241737 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f39dd8-b38f-473e-bb38-10a3ab288ed0 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:09.242233 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f39dd8-b38f-473e-bb38-10a3ab288ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:09.242329 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f39dd8-b38f-473e-bb38-10a3ab288ed0 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:09.243799 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 435/880] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:09.249255 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f40a6-2b75-4756-9cdd-1cc4fb8b2426 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:09.249740 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f40a6-2b75-4756-9cdd-1cc4fb8b2426 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:09.250193 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f40a6-2b75-4756-9cdd-1cc4fb8b2426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:09.261593 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-075660a4-cff8-4b45-b436-0987f733fd08 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 12:08:09.261593 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:09.261593 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:09.261593 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:09.261593 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:09.261593 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:09.261593 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:09.261593 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:09.261593 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:09.261593 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:09.261593 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:09.261593 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:09.261593 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:08:09.261593 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:08:09.261593 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:08:09.261593 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:08:09.262764 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:09.262764 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:09.262764 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:09.262764 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:09.262764 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:09.262764 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:09.262764 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:09.262764 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:09.262764 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:09.262764 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:09.262764 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:09.262764 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:09.262764 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:09.262764 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:09.262764 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:09.262764 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:09.262764 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:09.262764 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:09.263936 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:09.263936 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:09.263936 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:08:09.263936 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:08:09.263936 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:08:09.263936 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:08:09.263936 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:08:09.263936 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:08:09.263936 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 12:08:09.263936 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:09.264647 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:09.266661 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 446/881] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Jun 29 12:08:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:09.276407 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-938f40a6-2b75-4756-9cdd-1cc4fb8b2426 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:09.278100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-938f40a6-2b75-4756-9cdd-1cc4fb8b2426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:09.278713 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075660a4-cff8-4b45-b436-0987f733fd08 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:09.288562 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:09.368418 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 436/882] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:09 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:09.394961 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f40a6-2b75-4756-9cdd-1cc4fb8b2426 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:09.396452 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075660a4-cff8-4b45-b436-0987f733fd08 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:09.434349 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21edfc-a969-4e62-b253-2aac16ea0bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:09.435067 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21edfc-a969-4e62-b253-2aac16ea0bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:09.435356 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21edfc-a969-4e62-b253-2aac16ea0bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:09.435629 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21edfc-a969-4e62-b253-2aac16ea0bf3 None admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:09.436475 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21edfc-a969-4e62-b253-2aac16ea0bf3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:09.436792 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21edfc-a969-4e62-b253-2aac16ea0bf3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:09.438253 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21edfc-a969-4e62-b253-2aac16ea0bf3 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:09.467031 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 447/883] 10.222.0.13 () {56 vars in 1149 bytes} [Wed Jun 29 12:08:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:09.468147 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21edfc-a969-4e62-b253-2aac16ea0bf3 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:09.537288 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f40a6-2b75-4756-9cdd-1cc4fb8b2426 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:09.545861 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:09.580565 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fb6a2-c5b5-44d5-95cc-a415181b16e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:09.581247 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fb6a2-c5b5-44d5-95cc-a415181b16e2 None admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:09.581644 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fb6a2-c5b5-44d5-95cc-a415181b16e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:09.582487 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fb6a2-c5b5-44d5-95cc-a415181b16e2 None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:09.583252 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617fb6a2-c5b5-44d5-95cc-a415181b16e2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:09.586079 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617fb6a2-c5b5-44d5-95cc-a415181b16e2 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:09.588626 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:09.605413 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21edfc-a969-4e62-b253-2aac16ea0bf3 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:09.610732 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 437/884] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Jun 29 12:08:09 2022] POST /identity/v3/services => generated 269 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:08:09.610732 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead391d-f2a0-40f7-918f-9abe4bd038a0 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:09.610732 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead391d-f2a0-40f7-918f-9abe4bd038a0 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:09.610732 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead391d-f2a0-40f7-918f-9abe4bd038a0 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:09.614687 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 438/885] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:09.619755 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3085f2-00aa-43d7-8c00-7f98b31ee0e6 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:09.620218 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3085f2-00aa-43d7-8c00-7f98b31ee0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:09.620982 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3085f2-00aa-43d7-8c00-7f98b31ee0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:09.651443 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-2c3085f2-00aa-43d7-8c00-7f98b31ee0e6 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:09.653509 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-2c3085f2-00aa-43d7-8c00-7f98b31ee0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:09.695826 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9fec0-4c69-4a84-a18d-ea9905100946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:09.697467 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9fec0-4c69-4a84-a18d-ea9905100946 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:09.698869 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9fec0-4c69-4a84-a18d-ea9905100946 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:09.699348 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9fec0-4c69-4a84-a18d-ea9905100946 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:09.763091 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 439/886] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:09 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:09.779661 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3085f2-00aa-43d7-8c00-7f98b31ee0e6 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:09.794548 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9fec0-4c69-4a84-a18d-ea9905100946 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:09.796157 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9fec0-4c69-4a84-a18d-ea9905100946 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:09.874733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:09.910283 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3085f2-00aa-43d7-8c00-7f98b31ee0e6 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:09.924950 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 448/887] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:09 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:08:09.930797 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9fec0-4c69-4a84-a18d-ea9905100946 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:09.947943 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:09.961596 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74c777-d600-406b-9bbc-5e5d164517e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:09.962690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74c777-d600-406b-9bbc-5e5d164517e9 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:09.963355 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74c777-d600-406b-9bbc-5e5d164517e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:09.963768 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74c777-d600-406b-9bbc-5e5d164517e9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:09.964969 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74c777-d600-406b-9bbc-5e5d164517e9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:09.967555 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74c777-d600-406b-9bbc-5e5d164517e9 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:09.984491 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-0c74c777-d600-406b-9bbc-5e5d164517e9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 12:08:09.984491 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:09.984491 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:08:09.984491 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:08:09.984491 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:08:09.984491 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:08:09.984491 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:08:09.984491 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:09.984491 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 12:08:09.984491 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:09.984491 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:08:09.984491 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:09.984491 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:09.984491 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:09.984491 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:09.984491 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:09.984491 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:09.985555 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:09.985555 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:09.985555 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:09.985555 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:09.985555 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:09.985555 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:09.985555 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:08:09.985555 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:08:09.985555 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:08:09.985555 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:08:09.985555 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:09.985555 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:09.985555 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:09.985555 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:09.985555 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:09.985555 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:09.986420 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:09.986420 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:09.986420 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:09.986420 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:09.986420 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:09.986420 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:09.986420 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:09.986420 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:09.986420 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:09.986420 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:09.986420 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:08:09.986420 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:09.986420 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 12:08:09.986420 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:09.986420 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 440/888] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 29 12:08:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:09.987262 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857e63a-7092-4ed2-90b7-ab9fd39ce36f None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:09.987262 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857e63a-7092-4ed2-90b7-ab9fd39ce36f None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:09.988936 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857e63a-7092-4ed2-90b7-ab9fd39ce36f None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:09.989527 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 441/889] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:09.995019 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857e63a-7092-4ed2-90b7-ab9fd39ce36f None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:10.059379 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9fec0-4c69-4a84-a18d-ea9905100946 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:10.094450 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d0cc6-27c0-41e5-a8c4-28f45749529c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:10.095699 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d0cc6-27c0-41e5-a8c4-28f45749529c None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:10.095980 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d0cc6-27c0-41e5-a8c4-28f45749529c None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:10.096248 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d0cc6-27c0-41e5-a8c4-28f45749529c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:10.107093 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d0cc6-27c0-41e5-a8c4-28f45749529c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:10.108550 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d0cc6-27c0-41e5-a8c4-28f45749529c None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:10.126306 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-d19d0cc6-27c0-41e5-a8c4-28f45749529c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:10.126306 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:10.126306 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:10.126306 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:10.126306 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:10.126306 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:10.126306 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:10.126306 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:10.126306 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:10.126306 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:10.126306 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:10.126306 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:10.126306 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:10.126306 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:10.126306 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:10.127292 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:10.127292 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:10.127292 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:10.127292 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:10.127292 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:10.127292 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:10.127292 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:10.127292 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:10.127292 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:10.127292 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:10.127292 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:10.127292 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:10.127292 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:10.127292 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:10.127292 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:10.127292 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:10.127292 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:10.128182 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:10.128182 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:10.128182 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:10.128182 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:10.132809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 449/890] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:10.133895 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc35627-7348-43e6-8375-7d54d461b9a3 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:10.134180 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc35627-7348-43e6-8375-7d54d461b9a3 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:10.134466 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc35627-7348-43e6-8375-7d54d461b9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:10.139265 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857e63a-7092-4ed2-90b7-ab9fd39ce36f None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:10.151591 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-fcc35627-7348-43e6-8375-7d54d461b9a3 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:10.152750 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-fcc35627-7348-43e6-8375-7d54d461b9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:10.161332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:10.187292 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc584a-074b-4cff-90eb-9a787f00c88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:10.188231 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc584a-074b-4cff-90eb-9a787f00c88e None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:10.188659 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc584a-074b-4cff-90eb-9a787f00c88e None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:10.189077 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc584a-074b-4cff-90eb-9a787f00c88e None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:10.189917 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc584a-074b-4cff-90eb-9a787f00c88e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:10.190367 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc584a-074b-4cff-90eb-9a787f00c88e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:10.192019 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc584a-074b-4cff-90eb-9a787f00c88e None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:10.197521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 442/891] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 29 12:08:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:10.198590 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc584a-074b-4cff-90eb-9a787f00c88e None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:10.235606 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 450/892] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:10.237151 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc35627-7348-43e6-8375-7d54d461b9a3 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:10.269298 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:10.324172 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc584a-074b-4cff-90eb-9a787f00c88e None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:10.357092 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc35627-7348-43e6-8375-7d54d461b9a3 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:10.379888 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0fa93-596b-4f16-9bca-6ba984f4a9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:10.380740 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0fa93-596b-4f16-9bca-6ba984f4a9ab None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:10.381228 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0fa93-596b-4f16-9bca-6ba984f4a9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:10.381739 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0fa93-596b-4f16-9bca-6ba984f4a9ab None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:10.383025 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0fa93-596b-4f16-9bca-6ba984f4a9ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:10.383549 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0fa93-596b-4f16-9bca-6ba984f4a9ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:10.386048 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0fa93-596b-4f16-9bca-6ba984f4a9ab None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:10.396999 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289b1b2-6a51-483a-9ee1-09cf9f39ca14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:10.397676 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289b1b2-6a51-483a-9ee1-09cf9f39ca14 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:10.398556 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289b1b2-6a51-483a-9ee1-09cf9f39ca14 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:10.398867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289b1b2-6a51-483a-9ee1-09cf9f39ca14 None admin] PATH_INFO: `/v3/services` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:10.399639 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289b1b2-6a51-483a-9ee1-09cf9f39ca14 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:10.399984 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289b1b2-6a51-483a-9ee1-09cf9f39ca14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:10.401838 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289b1b2-6a51-483a-9ee1-09cf9f39ca14 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:10.411259 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 443/893] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:10.411259 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0fa93-596b-4f16-9bca-6ba984f4a9ab None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:10.412511 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 451/894] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 29 12:08:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:10.413262 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289b1b2-6a51-483a-9ee1-09cf9f39ca14 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:10.422357 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:10.527595 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289b1b2-6a51-483a-9ee1-09cf9f39ca14 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:10.554599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0fa93-596b-4f16-9bca-6ba984f4a9ab None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:10.571665 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:10.575221 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1969b-cb4f-4175-a8a3-dfaf53e57240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:10.576259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1969b-cb4f-4175-a8a3-dfaf53e57240 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:10.576810 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1969b-cb4f-4175-a8a3-dfaf53e57240 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:10.577089 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1969b-cb4f-4175-a8a3-dfaf53e57240 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:10.584652 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1969b-cb4f-4175-a8a3-dfaf53e57240 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:10.586102 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1969b-cb4f-4175-a8a3-dfaf53e57240 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:10.595697 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c624536-9e36-4504-8b38-bbd36d1f9212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:10.596720 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c624536-9e36-4504-8b38-bbd36d1f9212 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:10.597722 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c624536-9e36-4504-8b38-bbd36d1f9212 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:10.598181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c624536-9e36-4504-8b38-bbd36d1f9212 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:10.599049 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c624536-9e36-4504-8b38-bbd36d1f9212 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:10.600670 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c624536-9e36-4504-8b38-bbd36d1f9212 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:10.600827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-32e1969b-cb4f-4175-a8a3-dfaf53e57240 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:10.600827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:10.600827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:10.600827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:10.600827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:10.600827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:10.600827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:10.600827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:10.600827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:10.600827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:10.600827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:10.600827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:10.600827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:10.600827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:10.600827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:10.601668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:10.601668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:10.601668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:10.601668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:10.601668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:10.601668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:10.601668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:10.601668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:10.601668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:10.601668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:10.601668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:10.601668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:10.601668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:10.601668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:10.601668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:10.601668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:10.601668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:10.602562 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:10.602562 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:10.602562 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:10.602562 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:10.602562 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:10.602562 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:10.602562 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:10.602562 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:10.602562 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 452/895] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:10.603078 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1969b-cb4f-4175-a8a3-dfaf53e57240 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:10.621818 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-4c624536-9e36-4504-8b38-bbd36d1f9212 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 12:08:10.621818 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:10.621818 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:08:10.621818 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:08:10.621818 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:08:10.621818 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:08:10.621818 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:08:10.621818 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:10.621818 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 12:08:10.621818 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:10.621818 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:08:10.621818 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:10.621818 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:10.621818 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:10.621818 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:10.621818 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:10.621818 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:10.622956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:10.622956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:10.622956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:10.622956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:10.622956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:10.622956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:10.622956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:08:10.622956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:08:10.622956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:08:10.622956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:08:10.622956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:10.622956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:10.622956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:10.622956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:10.622956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:10.622956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:10.623815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:10.623815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:10.623815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:10.623815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:10.623815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:10.623815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:10.623815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:10.623815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:10.623815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:10.623815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:10.623815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:08:10.623815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:10.623815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 12:08:10.623815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:10.623815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 444/896] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Jun 29 12:08:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:10.624603 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c624536-9e36-4504-8b38-bbd36d1f9212 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:10.702287 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:10.749295 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c624536-9e36-4504-8b38-bbd36d1f9212 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:10.756500 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1969b-cb4f-4175-a8a3-dfaf53e57240 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:10.792451 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c9e4b-a778-4863-b02b-ec1ba08fdab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:10.793123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c9e4b-a778-4863-b02b-ec1ba08fdab4 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:10.793502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c9e4b-a778-4863-b02b-ec1ba08fdab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:10.793689 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c9e4b-a778-4863-b02b-ec1ba08fdab4 None admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:10.794590 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c9e4b-a778-4863-b02b-ec1ba08fdab4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:10.795012 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c9e4b-a778-4863-b02b-ec1ba08fdab4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:10.796412 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c9e4b-a778-4863-b02b-ec1ba08fdab4 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:10.798428 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fb43a-32ae-4bd9-a712-9758c6c66698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:10.799410 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fb43a-32ae-4bd9-a712-9758c6c66698 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:10.799826 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fb43a-32ae-4bd9-a712-9758c6c66698 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:10.800146 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fb43a-32ae-4bd9-a712-9758c6c66698 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:10.801622 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25fb43a-32ae-4bd9-a712-9758c6c66698 None admin] RBAC: Adding query filter params (interface=public, service_id=1e66cd14c4c441a683762b26049d6390, region_id=RegionOne) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:10.801980 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25fb43a-32ae-4bd9-a712-9758c6c66698 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:10.803439 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25fb43a-32ae-4bd9-a712-9758c6c66698 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:10.809982 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 453/897] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Jun 29 12:08:10 2022] GET /identity/v3/endpoints?service_id=1e66cd14c4c441a683762b26049d6390&interface=public®ion_id=RegionOne => generated 194 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:10.811363 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fb43a-32ae-4bd9-a712-9758c6c66698 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:10.812114 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 445/898] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:08:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:10.821055 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c9e4b-a778-4863-b02b-ec1ba08fdab4 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:10.882439 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:10.951043 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fb43a-32ae-4bd9-a712-9758c6c66698 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:10.952787 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c9e4b-a778-4863-b02b-ec1ba08fdab4 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:10.983950 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:10.991513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04018131-d559-4645-ac6d-83100a72734d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:10.992189 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04018131-d559-4645-ac6d-83100a72734d None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:10.992374 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52813d-821e-4fad-b9f5-e43a5205e091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:10.992533 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04018131-d559-4645-ac6d-83100a72734d None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:10.992775 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04018131-d559-4645-ac6d-83100a72734d None admin] PATH_INFO: `/v3/services` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:10.993089 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52813d-821e-4fad-b9f5-e43a5205e091 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:10.993438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52813d-821e-4fad-b9f5-e43a5205e091 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:10.993584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04018131-d559-4645-ac6d-83100a72734d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:10.993825 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52813d-821e-4fad-b9f5-e43a5205e091 None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:10.994142 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04018131-d559-4645-ac6d-83100a72734d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:10.994695 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f52813d-821e-4fad-b9f5-e43a5205e091 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:10.995943 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04018131-d559-4645-ac6d-83100a72734d None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:10.996161 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f52813d-821e-4fad-b9f5-e43a5205e091 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:11.010904 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 454/899] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Jun 29 12:08:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:11.011134 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 446/900] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Jun 29 12:08:10 2022] GET /identity/v3/services => generated 1268 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:08:11.011264 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04018131-d559-4645-ac6d-83100a72734d None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:11.011391 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52813d-821e-4fad-b9f5-e43a5205e091 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:11.138006 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52813d-821e-4fad-b9f5-e43a5205e091 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:11.139777 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:11.146279 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04018131-d559-4645-ac6d-83100a72734d None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:11.177657 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82e8ee-ef0b-47db-840d-f74c983e1ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:11.178339 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82e8ee-ef0b-47db-840d-f74c983e1ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:11.178624 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82e8ee-ef0b-47db-840d-f74c983e1ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:11.178930 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82e8ee-ef0b-47db-840d-f74c983e1ba4 None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:11.179647 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82e8ee-ef0b-47db-840d-f74c983e1ba4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:11.180018 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82e8ee-ef0b-47db-840d-f74c983e1ba4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:11.181472 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82e8ee-ef0b-47db-840d-f74c983e1ba4 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:11.187073 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 447/901] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Jun 29 12:08:11 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:11.196103 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38452b-8545-4850-b581-546e25d8794d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:11.196797 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38452b-8545-4850-b581-546e25d8794d None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:11.197077 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38452b-8545-4850-b581-546e25d8794d None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:11.197353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38452b-8545-4850-b581-546e25d8794d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:11.198210 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e38452b-8545-4850-b581-546e25d8794d None admin] RBAC: Adding query filter params (role.id=1d0cb8616d7f45139d1db10e50725fe7, scope.project.id=489877ae137244c5b83291671c703c99, user.id=2891b5a315b64f228f665e024b641629) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:11.198521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e38452b-8545-4850-b581-546e25d8794d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:11.200190 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e38452b-8545-4850-b581-546e25d8794d None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:11.207541 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 455/902] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:08:11 2022] GET /identity/v3/role_assignments?user.id=2891b5a315b64f228f665e024b641629&scope.project.id=489877ae137244c5b83291671c703c99&role.id=1d0cb8616d7f45139d1db10e50725fe7 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:11.809843 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b9216-d568-4f86-ba34-f3be7e5502f0 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:11.810554 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b9216-d568-4f86-ba34-f3be7e5502f0 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:11.810554 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b9216-d568-4f86-ba34-f3be7e5502f0 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:11.812076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 448/903] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:08:11.817962 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4e2a6-df5d-49f1-86b7-f547685694fc None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:11.818664 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4e2a6-df5d-49f1-86b7-f547685694fc None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:11.818664 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4e2a6-df5d-49f1-86b7-f547685694fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:11.838371 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-0fb4e2a6-df5d-49f1-86b7-f547685694fc None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:11.839602 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-0fb4e2a6-df5d-49f1-86b7-f547685694fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:11.903758 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:11.928450 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 456/904] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:11 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:08:11.951847 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b9216-d568-4f86-ba34-f3be7e5502f0 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:12.059068 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b9216-d568-4f86-ba34-f3be7e5502f0 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:12.094764 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa39897-5aad-4d91-8876-cbc763916e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:12.095581 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa39897-5aad-4d91-8876-cbc763916e75 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:12.095867 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa39897-5aad-4d91-8876-cbc763916e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:12.096147 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa39897-5aad-4d91-8876-cbc763916e75 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:12.096805 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa39897-5aad-4d91-8876-cbc763916e75 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:12.098222 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa39897-5aad-4d91-8876-cbc763916e75 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:12.110590 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-2fa39897-5aad-4d91-8876-cbc763916e75 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 12:08:12.110590 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:12.110590 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:08:12.110590 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:08:12.110590 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:08:12.110590 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:08:12.110590 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:08:12.110590 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:12.110590 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 12:08:12.110590 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:12.110590 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:08:12.110590 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:12.110590 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:12.110590 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:12.110590 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:12.110590 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:12.112056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:12.112056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:12.112056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:12.112056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:12.112056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:12.112056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:12.112056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:12.112056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:08:12.112056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:08:12.112056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:08:12.112056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:08:12.112056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:12.112056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:12.112056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:12.112056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:12.112056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:12.113954 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:12.113954 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:12.113954 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:12.113954 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:12.113954 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:12.113954 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:12.113954 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:12.113954 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:12.113954 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:12.113954 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:12.113954 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:12.113954 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:08:12.113954 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:12.113954 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 12:08:12.113954 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:12.113954 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 449/905] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Jun 29 12:08:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:12.124221 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4e2a6-df5d-49f1-86b7-f547685694fc None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:12.277421 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4e2a6-df5d-49f1-86b7-f547685694fc None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:12.324842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2c16b-cbd0-4e3e-b0cb-30b6913c8b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:12.325429 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2c16b-cbd0-4e3e-b0cb-30b6913c8b2f None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:12.325710 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2c16b-cbd0-4e3e-b0cb-30b6913c8b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:12.325984 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2c16b-cbd0-4e3e-b0cb-30b6913c8b2f None admin] PATH_INFO: `/v3/services` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:12.326730 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2c16b-cbd0-4e3e-b0cb-30b6913c8b2f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:12.327172 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2c16b-cbd0-4e3e-b0cb-30b6913c8b2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:12.328557 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2c16b-cbd0-4e3e-b0cb-30b6913c8b2f None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:12.334069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 457/906] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Jun 29 12:08:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:12.339707 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa39897-5aad-4d91-8876-cbc763916e75 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:12.372547 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:12.452973 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa39897-5aad-4d91-8876-cbc763916e75 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:12.489873 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844474b-afa9-4909-b123-1fd5dc93840f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:12.491245 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844474b-afa9-4909-b123-1fd5dc93840f None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:12.491741 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844474b-afa9-4909-b123-1fd5dc93840f None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:12.492221 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844474b-afa9-4909-b123-1fd5dc93840f None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:12.493195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844474b-afa9-4909-b123-1fd5dc93840f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:12.493757 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844474b-afa9-4909-b123-1fd5dc93840f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:12.495385 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844474b-afa9-4909-b123-1fd5dc93840f None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:12.501188 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 450/907] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Jun 29 12:08:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:12.507355 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2c16b-cbd0-4e3e-b0cb-30b6913c8b2f None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:12.564726 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:12.613854 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2c16b-cbd0-4e3e-b0cb-30b6913c8b2f None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:12.650156 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f2ed5-e246-4ef4-9f03-214b3f683869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:12.650863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f2ed5-e246-4ef4-9f03-214b3f683869 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:12.651149 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f2ed5-e246-4ef4-9f03-214b3f683869 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:12.651432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f2ed5-e246-4ef4-9f03-214b3f683869 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:12.652223 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f2ed5-e246-4ef4-9f03-214b3f683869 None admin] RBAC: Adding query filter params (interface=public, service_id=e9706b0a5809437cbcea3ec0619a612a, region_id=RegionOne) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:12.652542 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f2ed5-e246-4ef4-9f03-214b3f683869 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:12.653936 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f2ed5-e246-4ef4-9f03-214b3f683869 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:12.659887 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 458/908] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Jun 29 12:08:12 2022] GET /identity/v3/endpoints?service_id=e9706b0a5809437cbcea3ec0619a612a&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:12.665638 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844474b-afa9-4909-b123-1fd5dc93840f None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:12.783147 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:12.786395 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844474b-afa9-4909-b123-1fd5dc93840f None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:12.827039 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c4859-6208-4b6a-8065-2583540cdf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:12.827835 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c4859-6208-4b6a-8065-2583540cdf7f None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:12.828038 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c4859-6208-4b6a-8065-2583540cdf7f None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:12.830666 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c4859-6208-4b6a-8065-2583540cdf7f None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:12.830666 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c4859-6208-4b6a-8065-2583540cdf7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:12.830666 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c4859-6208-4b6a-8065-2583540cdf7f None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:12.838584 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 451/909] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Jun 29 12:08:12 2022] GET /identity/v3/services => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:08:13.348929 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2f8d4-1ea5-4625-8c81-cd72d1b166ab None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:13.349486 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2f8d4-1ea5-4625-8c81-cd72d1b166ab None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:13.349486 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2f8d4-1ea5-4625-8c81-cd72d1b166ab None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:13.350884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 459/910] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:08:13.359452 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893b522-ad30-429b-95fc-ed1b7fd5b9da None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:13.359745 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893b522-ad30-429b-95fc-ed1b7fd5b9da None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:13.360022 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893b522-ad30-429b-95fc-ed1b7fd5b9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:13.388158 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-7893b522-ad30-429b-95fc-ed1b7fd5b9da None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:13.389344 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-7893b522-ad30-429b-95fc-ed1b7fd5b9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:13.461985 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 452/911] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:08:13.473730 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df2ade-9678-485c-b910-9ff6f33bf42c None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:13.473730 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df2ade-9678-485c-b910-9ff6f33bf42c None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:13.473730 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df2ade-9678-485c-b910-9ff6f33bf42c None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:13.474403 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 460/912] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:13.480426 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c37561-bbdc-41ae-846f-e1801e0bad20 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:13.480716 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c37561-bbdc-41ae-846f-e1801e0bad20 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:13.480994 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c37561-bbdc-41ae-846f-e1801e0bad20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:13.491216 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df2ade-9678-485c-b910-9ff6f33bf42c None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:13.501359 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-f8c37561-bbdc-41ae-846f-e1801e0bad20 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:13.503749 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-f8c37561-bbdc-41ae-846f-e1801e0bad20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:13.583030 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 453/913] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:13.604946 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c37561-bbdc-41ae-846f-e1801e0bad20 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:13.622026 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df2ade-9678-485c-b910-9ff6f33bf42c None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:13.624119 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:13.643369 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:13.666964 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046d88c-3851-48ed-a6bd-741abe3f3aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:13.668054 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046d88c-3851-48ed-a6bd-741abe3f3aab None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:13.668333 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046d88c-3851-48ed-a6bd-741abe3f3aab None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:13.668604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046d88c-3851-48ed-a6bd-741abe3f3aab None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:13.669260 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046d88c-3851-48ed-a6bd-741abe3f3aab None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:13.670658 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046d88c-3851-48ed-a6bd-741abe3f3aab None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:13.683435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-e046d88c-3851-48ed-a6bd-741abe3f3aab None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 12:08:13.683435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:13.683435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:08:13.683435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:08:13.683435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:08:13.683435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:08:13.683435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:08:13.683435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:13.683435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 12:08:13.683435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:13.683435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:08:13.683435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:13.683435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:13.683435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:13.683435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:13.683435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:13.683435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:13.684712 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:13.684712 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:13.684712 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:13.684712 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:13.684712 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:13.684712 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:13.684712 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:08:13.684712 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:08:13.684712 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:08:13.684712 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:08:13.684712 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:13.684712 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:13.684712 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:13.684712 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:13.684712 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:13.684712 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:13.685642 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:13.685642 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:13.685642 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:13.685642 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:13.685642 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:13.685642 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:13.685642 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:13.685642 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:13.685642 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:13.685642 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:13.685642 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:08:13.685642 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:13.685642 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 12:08:13.685642 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:13.689678 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 461/914] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 29 12:08:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:13.690587 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046d88c-3851-48ed-a6bd-741abe3f3aab None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:13.742845 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c37561-bbdc-41ae-846f-e1801e0bad20 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:13.791019 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52e3d5-3734-447a-af37-eb6bf02f587a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:13.792728 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52e3d5-3734-447a-af37-eb6bf02f587a None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:13.793173 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52e3d5-3734-447a-af37-eb6bf02f587a None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:13.793640 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52e3d5-3734-447a-af37-eb6bf02f587a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:13.809637 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e52e3d5-3734-447a-af37-eb6bf02f587a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:13.810299 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046d88c-3851-48ed-a6bd-741abe3f3aab None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:13.821359 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-3e52e3d5-3734-447a-af37-eb6bf02f587a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 12:08:13.821359 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:13.821359 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:13.821359 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:13.821359 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:13.821359 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:13.821359 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:13.821359 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:13.821359 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:13.821359 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:13.821359 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:13.821359 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:13.821359 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:13.821359 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:13.821359 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:13.821359 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:13.822589 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:13.822589 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:13.822589 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:13.822589 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:13.822589 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:13.822589 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:13.822589 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:13.822589 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:13.822589 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:13.822589 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:13.822589 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:13.822589 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:13.822589 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:13.822589 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:13.822589 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:13.822589 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:13.823687 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:13.823687 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:13.823687 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:13.823687 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:13.823687 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:13.823687 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:13.823687 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:13.823687 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:13.823687 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:13.823687 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:13.823687 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 12:08:13.823687 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:13.826804 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 454/915] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Jun 29 12:08:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:13.833571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52e3d5-3734-447a-af37-eb6bf02f587a None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:13.858295 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741a786-4258-4150-a5bd-ef556597db88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:13.858923 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741a786-4258-4150-a5bd-ef556597db88 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:13.859213 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741a786-4258-4150-a5bd-ef556597db88 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:13.859494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741a786-4258-4150-a5bd-ef556597db88 None admin] PATH_INFO: `/v3/services` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:13.860378 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1741a786-4258-4150-a5bd-ef556597db88 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:13.860690 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1741a786-4258-4150-a5bd-ef556597db88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:13.862144 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1741a786-4258-4150-a5bd-ef556597db88 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:13.872780 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 462/916] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 29 12:08:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:13.873849 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741a786-4258-4150-a5bd-ef556597db88 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:13.925740 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:13.929546 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:13.953863 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52e3d5-3734-447a-af37-eb6bf02f587a None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:13.988767 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741a786-4258-4150-a5bd-ef556597db88 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:13.991158 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64e09b-41a4-4d1c-8f34-c21e97e4c6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:13.992479 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64e09b-41a4-4d1c-8f34-c21e97e4c6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:13.992479 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64e09b-41a4-4d1c-8f34-c21e97e4c6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:13.992680 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64e09b-41a4-4d1c-8f34-c21e97e4c6d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:13.993497 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64e09b-41a4-4d1c-8f34-c21e97e4c6d3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:13.993873 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64e09b-41a4-4d1c-8f34-c21e97e4c6d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:13.995923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64e09b-41a4-4d1c-8f34-c21e97e4c6d3 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:14.013515 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 455/917] 10.222.0.13 () {56 vars in 1115 bytes} [Wed Jun 29 12:08:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:14.014664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64e09b-41a4-4d1c-8f34-c21e97e4c6d3 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:14.028410 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8dc8f-ad02-49a0-8391-81d5fd74017c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:14.029397 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8dc8f-ad02-49a0-8391-81d5fd74017c None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:14.029890 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8dc8f-ad02-49a0-8391-81d5fd74017c None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:14.030350 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8dc8f-ad02-49a0-8391-81d5fd74017c None admin] PATH_INFO: `/v3/services` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:14.031447 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8dc8f-ad02-49a0-8391-81d5fd74017c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:14.032003 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8dc8f-ad02-49a0-8391-81d5fd74017c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:14.033603 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8dc8f-ad02-49a0-8391-81d5fd74017c None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:14.040674 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 463/918] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 29 12:08:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:14.045862 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8dc8f-ad02-49a0-8391-81d5fd74017c None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:14.138910 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64e09b-41a4-4d1c-8f34-c21e97e4c6d3 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:14.168074 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8dc8f-ad02-49a0-8391-81d5fd74017c None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:14.177080 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d64f6-dfed-4e19-a6dd-55f6df347bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:14.177989 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d64f6-dfed-4e19-a6dd-55f6df347bdb None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:14.178337 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d64f6-dfed-4e19-a6dd-55f6df347bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:14.178704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d64f6-dfed-4e19-a6dd-55f6df347bdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:14.179816 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:14.191872 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:14.195105 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d64f6-dfed-4e19-a6dd-55f6df347bdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:14.196955 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d64f6-dfed-4e19-a6dd-55f6df347bdb None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:14.216345 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdd9b1-80d7-4715-b75b-e6bba118207b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:14.216966 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-d86d64f6-dfed-4e19-a6dd-55f6df347bdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:14.216966 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:14.216966 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:14.216966 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:14.216966 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:14.216966 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:14.216966 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:14.216966 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:14.216966 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:14.216966 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:14.216966 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:14.216966 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:14.216966 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:14.216966 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:14.216966 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:14.218024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:14.218024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:14.218024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:14.218024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:14.218024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:14.218024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:14.218024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:14.218024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:14.218024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:14.218024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:14.218024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:14.218024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:14.218024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:14.218024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:14.218024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:14.218024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:14.218024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:14.219143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:14.219143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:14.219143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:14.219143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:14.219424 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdd9b1-80d7-4715-b75b-e6bba118207b None admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:14.219424 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdd9b1-80d7-4715-b75b-e6bba118207b None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:14.219424 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdd9b1-80d7-4715-b75b-e6bba118207b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:14.219944 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdd9b1-80d7-4715-b75b-e6bba118207b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:14.226246 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdd9b1-80d7-4715-b75b-e6bba118207b None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:14.226765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 456/919] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:14.227822 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d64f6-dfed-4e19-a6dd-55f6df347bdb None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:14.254747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 464/920] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Jun 29 12:08:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:08:14.338185 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4c9d0-129a-4499-ac50-d8374182911b None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:14.338742 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4c9d0-129a-4499-ac50-d8374182911b None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:14.339381 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4c9d0-129a-4499-ac50-d8374182911b None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:14.341307 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 465/921] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:14.348839 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a048710-75c3-45d5-9c67-f4c1fdfd5a9b None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:14.349585 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a048710-75c3-45d5-9c67-f4c1fdfd5a9b None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:14.350533 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a048710-75c3-45d5-9c67-f4c1fdfd5a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:14.359466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d64f6-dfed-4e19-a6dd-55f6df347bdb None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:14.376325 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-1a048710-75c3-45d5-9c67-f4c1fdfd5a9b None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:14.377917 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-1a048710-75c3-45d5-9c67-f4c1fdfd5a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:14.425803 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0f27c-c558-412a-a317-e8b5f5256bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:14.427007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0f27c-c558-412a-a317-e8b5f5256bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:14.427515 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0f27c-c558-412a-a317-e8b5f5256bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:14.427995 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0f27c-c558-412a-a317-e8b5f5256bb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:14.428956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0f27c-c558-412a-a317-e8b5f5256bb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:14.429480 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0f27c-c558-412a-a317-e8b5f5256bb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:14.431173 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0f27c-c558-412a-a317-e8b5f5256bb7 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:14.448046 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 457/922] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:14.454114 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0f27c-c558-412a-a317-e8b5f5256bb7 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:14.504521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 466/923] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:08:14.528865 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a048710-75c3-45d5-9c67-f4c1fdfd5a9b None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:14.531347 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:14.594091 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0f27c-c558-412a-a317-e8b5f5256bb7 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:14.635989 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80c755-f73a-4b46-8c68-ed156511b968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:14.636951 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80c755-f73a-4b46-8c68-ed156511b968 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:14.637073 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80c755-f73a-4b46-8c68-ed156511b968 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:14.637359 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80c755-f73a-4b46-8c68-ed156511b968 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:14.646115 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c80c755-f73a-4b46-8c68-ed156511b968 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:14.647533 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c80c755-f73a-4b46-8c68-ed156511b968 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:14.659744 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:14.664281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-9c80c755-f73a-4b46-8c68-ed156511b968 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 12:08:14.664281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:14.664281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:14.664281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:14.664281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:14.664281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:14.664281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:14.664281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:14.664281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:14.664281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:14.664281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:14.664281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:14.664281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:08:14.664281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:08:14.664281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:08:14.664281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:08:14.665280 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:14.665280 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:14.665280 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:14.665280 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:14.665280 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:14.665280 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:14.665280 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:14.665280 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:14.665280 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:14.665280 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:14.665280 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:14.665280 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:14.665280 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:14.665280 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:14.665280 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:14.665280 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:14.665280 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:14.665280 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:14.666308 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:14.666308 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:14.666308 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:08:14.666308 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:08:14.666308 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:08:14.666308 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:08:14.666308 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:08:14.666308 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:08:14.666308 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 12:08:14.666308 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:14.666308 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 458/924] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Jun 29 12:08:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:14.672420 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80c755-f73a-4b46-8c68-ed156511b968 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:14.675946 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a048710-75c3-45d5-9c67-f4c1fdfd5a9b None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:14.722929 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b0a8e-be11-4e4a-9caf-3d4169f916ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:14.724003 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b0a8e-be11-4e4a-9caf-3d4169f916ef None admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:14.725008 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b0a8e-be11-4e4a-9caf-3d4169f916ef None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:14.725523 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b0a8e-be11-4e4a-9caf-3d4169f916ef None admin] PATH_INFO: `/v3/services` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:14.726481 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b0a8e-be11-4e4a-9caf-3d4169f916ef None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:14.728516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b0a8e-be11-4e4a-9caf-3d4169f916ef None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:14.755044 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 467/925] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Jun 29 12:08:14 2022] POST /identity/v3/services => generated 241 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:08:14.806113 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80c755-f73a-4b46-8c68-ed156511b968 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:14.819919 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:14.859892 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0b4b1-6d4b-432c-aed2-a47c5dfa503b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:14.861483 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0b4b1-6d4b-432c-aed2-a47c5dfa503b None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:14.861990 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0b4b1-6d4b-432c-aed2-a47c5dfa503b None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:14.862520 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0b4b1-6d4b-432c-aed2-a47c5dfa503b None admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:14.863606 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0b4b1-6d4b-432c-aed2-a47c5dfa503b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:14.864099 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0b4b1-6d4b-432c-aed2-a47c5dfa503b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:14.865795 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0b4b1-6d4b-432c-aed2-a47c5dfa503b None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:14.888104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 459/926] 10.222.0.13 () {56 vars in 1149 bytes} [Wed Jun 29 12:08:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:14.893632 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b0a8e-be11-4e4a-9caf-3d4169f916ef None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:15.016605 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b0a8e-be11-4e4a-9caf-3d4169f916ef None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:15.064192 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46b222-af2e-4221-b9f5-984a5caa2dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:15.065000 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46b222-af2e-4221-b9f5-984a5caa2dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:15.065279 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46b222-af2e-4221-b9f5-984a5caa2dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:15.065553 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46b222-af2e-4221-b9f5-984a5caa2dc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:15.077795 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b46b222-af2e-4221-b9f5-984a5caa2dc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:15.079310 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b46b222-af2e-4221-b9f5-984a5caa2dc3 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:15.097228 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-9b46b222-af2e-4221-b9f5-984a5caa2dc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:15.097228 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:15.097228 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:15.097228 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:15.097228 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:15.097228 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:15.097228 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:15.097228 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:15.097228 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:15.097228 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:15.097228 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:15.097228 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:15.097228 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:15.097228 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:15.097228 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:15.098229 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:15.098229 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:15.098229 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:15.098229 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:15.098229 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:15.098229 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:15.098229 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:15.098229 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:15.098229 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:15.098229 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:15.098229 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:15.098229 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:15.098229 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:15.098229 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:15.098229 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:15.098229 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:15.098229 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:15.099181 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:15.099181 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:15.099181 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:15.099181 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:15.102841 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 468/927] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:15.104922 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0b4b1-6d4b-432c-aed2-a47c5dfa503b None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:15.162585 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc2955-67bf-4668-a368-2b2d089851f1 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:15.162953 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc2955-67bf-4668-a368-2b2d089851f1 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:15.163182 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc2955-67bf-4668-a368-2b2d089851f1 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:15.164684 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 469/928] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:08:15.170134 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5140364-f6db-46ec-bf3d-ae06964fa8a3 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:15.170909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5140364-f6db-46ec-bf3d-ae06964fa8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:15.171462 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5140364-f6db-46ec-bf3d-ae06964fa8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:15.184717 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:15.192709 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-a5140364-f6db-46ec-bf3d-ae06964fa8a3 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:15.193909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-a5140364-f6db-46ec-bf3d-ae06964fa8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:15.243916 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0b4b1-6d4b-432c-aed2-a47c5dfa503b None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:15.272609 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 470/929] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:08:15.286509 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae4814-d755-445a-9c45-da69e5ca9d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:15.287574 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae4814-d755-445a-9c45-da69e5ca9d9e None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:15.288085 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae4814-d755-445a-9c45-da69e5ca9d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:15.288569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae4814-d755-445a-9c45-da69e5ca9d9e None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:15.289499 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae4814-d755-445a-9c45-da69e5ca9d9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:15.290125 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae4814-d755-445a-9c45-da69e5ca9d9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:15.291746 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae4814-d755-445a-9c45-da69e5ca9d9e None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:15.295913 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5140364-f6db-46ec-bf3d-ae06964fa8a3 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:15.311943 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 460/930] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:15.313663 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae4814-d755-445a-9c45-da69e5ca9d9e None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:15.351779 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:15.417743 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5140364-f6db-46ec-bf3d-ae06964fa8a3 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:15.458193 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05165bc-f2d7-49c5-9f48-1c2182589f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:15.459379 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05165bc-f2d7-49c5-9f48-1c2182589f65 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:15.459659 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05165bc-f2d7-49c5-9f48-1c2182589f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:15.459932 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05165bc-f2d7-49c5-9f48-1c2182589f65 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:15.460620 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05165bc-f2d7-49c5-9f48-1c2182589f65 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:15.461982 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05165bc-f2d7-49c5-9f48-1c2182589f65 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:15.465126 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:15.468252 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae4814-d755-445a-9c45-da69e5ca9d9e None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:15.480721 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-d05165bc-f2d7-49c5-9f48-1c2182589f65 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 12:08:15.480721 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:15.480721 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:08:15.480721 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:08:15.480721 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:08:15.480721 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:08:15.480721 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:08:15.480721 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:15.480721 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 12:08:15.480721 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:15.480721 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:08:15.480721 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:15.480721 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:15.480721 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:15.480721 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:15.480721 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:15.481790 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:15.481790 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:15.481790 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:15.481790 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:15.481790 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:15.481790 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:15.481790 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:15.481790 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:08:15.481790 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:08:15.481790 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:08:15.481790 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:08:15.481790 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:15.481790 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:15.481790 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:15.481790 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:15.481790 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:15.488239 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:15.488239 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:15.488239 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:15.488239 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:15.488239 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:15.488239 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:15.488239 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:15.488239 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:15.488239 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:15.488239 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:15.488239 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:15.488239 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:08:15.488239 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:15.488239 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 12:08:15.488239 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:15.488239 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 471/931] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Jun 29 12:08:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:15.490784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05165bc-f2d7-49c5-9f48-1c2182589f65 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:15.510838 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff8486-7020-4553-8bd6-6179a8a8b155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:15.511679 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff8486-7020-4553-8bd6-6179a8a8b155 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:15.511959 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff8486-7020-4553-8bd6-6179a8a8b155 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:15.512247 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff8486-7020-4553-8bd6-6179a8a8b155 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:15.519934 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff8486-7020-4553-8bd6-6179a8a8b155 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:15.521677 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff8486-7020-4553-8bd6-6179a8a8b155 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:15.537480 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-59ff8486-7020-4553-8bd6-6179a8a8b155 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:15.537480 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:15.537480 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:15.537480 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:15.537480 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:15.537480 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:15.537480 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:15.537480 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:15.537480 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:15.537480 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:15.537480 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:15.537480 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:15.537480 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:15.537480 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:15.537480 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:15.538515 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:15.538515 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:15.538515 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:15.538515 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:15.538515 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:15.538515 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:15.538515 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:15.538515 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:15.538515 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:15.538515 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:15.538515 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:15.538515 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:15.538515 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:15.538515 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:15.538515 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:15.538515 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:15.538515 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:15.539450 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:15.539450 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:15.539450 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:15.539450 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:15.539450 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:15.539450 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:15.539450 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:15.539450 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:15.543028 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 461/932] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:15.544594 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff8486-7020-4553-8bd6-6179a8a8b155 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:15.611733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05165bc-f2d7-49c5-9f48-1c2182589f65 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:15.632040 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:15.650894 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff8486-7020-4553-8bd6-6179a8a8b155 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:15.652152 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8d1b7-0837-4fd5-bed4-5f7a0c6645f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:15.653307 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8d1b7-0837-4fd5-bed4-5f7a0c6645f8 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:15.653803 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8d1b7-0837-4fd5-bed4-5f7a0c6645f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:15.654290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8d1b7-0837-4fd5-bed4-5f7a0c6645f8 None admin] PATH_INFO: `/v3/services` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:15.655253 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8d1b7-0837-4fd5-bed4-5f7a0c6645f8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:15.655788 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8d1b7-0837-4fd5-bed4-5f7a0c6645f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:15.657416 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8d1b7-0837-4fd5-bed4-5f7a0c6645f8 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:15.668874 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 472/933] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Jun 29 12:08:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:15.670618 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8d1b7-0837-4fd5-bed4-5f7a0c6645f8 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:15.688449 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3deb402-bdb3-440a-a9db-d7311fbdf9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:15.689121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3deb402-bdb3-440a-a9db-d7311fbdf9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:15.689402 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3deb402-bdb3-440a-a9db-d7311fbdf9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:15.689676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3deb402-bdb3-440a-a9db-d7311fbdf9c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:15.690551 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3deb402-bdb3-440a-a9db-d7311fbdf9c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:15.690834 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3deb402-bdb3-440a-a9db-d7311fbdf9c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:15.692266 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3deb402-bdb3-440a-a9db-d7311fbdf9c4 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:15.710150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 462/934] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:08:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:15.711126 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3deb402-bdb3-440a-a9db-d7311fbdf9c4 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:15.747846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:15.797843 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8d1b7-0837-4fd5-bed4-5f7a0c6645f8 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:15.831038 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3deb402-bdb3-440a-a9db-d7311fbdf9c4 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:15.836194 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03743346-f753-4677-9d74-ab66b8c3b14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:15.837189 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03743346-f753-4677-9d74-ab66b8c3b14d None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:15.837689 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03743346-f753-4677-9d74-ab66b8c3b14d None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:15.838167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03743346-f753-4677-9d74-ab66b8c3b14d None admin] PATH_INFO: `/v3/services` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:15.839224 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03743346-f753-4677-9d74-ab66b8c3b14d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:15.839761 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03743346-f753-4677-9d74-ab66b8c3b14d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:15.841475 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03743346-f753-4677-9d74-ab66b8c3b14d None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:15.852826 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 473/935] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Jun 29 12:08:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:15.854372 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03743346-f753-4677-9d74-ab66b8c3b14d None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:15.870039 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe04421-fe35-4b40-9511-905b94271548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:15.871016 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe04421-fe35-4b40-9511-905b94271548 None admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:15.871296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe04421-fe35-4b40-9511-905b94271548 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:15.871571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe04421-fe35-4b40-9511-905b94271548 None admin] PATH_INFO: `/v3/projects/489877ae137244c5b83291671c703c99/users/2891b5a315b64f228f665e024b641629/roles/1d0cb8616d7f45139d1db10e50725fe7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:15.873822 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe04421-fe35-4b40-9511-905b94271548 None admin] RBAC: Authorizing `identity:create_grant(project_id=489877ae137244c5b83291671c703c99, user_id=2891b5a315b64f228f665e024b641629, role_id=1d0cb8616d7f45139d1db10e50725fe7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:15.875349 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe04421-fe35-4b40-9511-905b94271548 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:15.898821 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 463/936] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 29 12:08:15 2022] PUT /identity/v3/projects/489877ae137244c5b83291671c703c99/users/2891b5a315b64f228f665e024b641629/roles/1d0cb8616d7f45139d1db10e50725fe7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:08:15.974193 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03743346-f753-4677-9d74-ab66b8c3b14d None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:16.004953 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:16.015531 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6bd2d-8f22-410d-af70-1d6a751c4966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:16.016216 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6bd2d-8f22-410d-af70-1d6a751c4966 None admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:16.016502 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6bd2d-8f22-410d-af70-1d6a751c4966 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:16.016775 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6bd2d-8f22-410d-af70-1d6a751c4966 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:16.017639 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6bd2d-8f22-410d-af70-1d6a751c4966 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:16.019764 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6bd2d-8f22-410d-af70-1d6a751c4966 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:16.050981 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 474/937] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Jun 29 12:08:15 2022] POST /identity/v3/endpoints => generated 347 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:08:16.738797 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595db22d-40d0-4221-948f-abe861d48142 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:16.739124 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595db22d-40d0-4221-948f-abe861d48142 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:16.739369 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595db22d-40d0-4221-948f-abe861d48142 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:16.741022 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 464/938] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:16.746531 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50de1d-2273-41ce-af0d-4fc216c5666d None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:16.747037 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50de1d-2273-41ce-af0d-4fc216c5666d None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:16.747116 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50de1d-2273-41ce-af0d-4fc216c5666d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:16.764717 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-8a50de1d-2273-41ce-af0d-4fc216c5666d None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:16.765913 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-8a50de1d-2273-41ce-af0d-4fc216c5666d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:16.843088 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 475/939] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:16.866671 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595db22d-40d0-4221-948f-abe861d48142 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:16.869930 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:16.978549 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595db22d-40d0-4221-948f-abe861d48142 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:17.016365 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfd887-b93c-48c3-bedc-b38d39b97340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:17.016955 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfd887-b93c-48c3-bedc-b38d39b97340 None admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:17.017243 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfd887-b93c-48c3-bedc-b38d39b97340 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:17.017521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfd887-b93c-48c3-bedc-b38d39b97340 None admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:17.018223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccfd887-b93c-48c3-bedc-b38d39b97340 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:17.019741 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccfd887-b93c-48c3-bedc-b38d39b97340 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:17.021119 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: WARNING keystone.server.flask.common [None req-eccfd887-b93c-48c3-bedc-b38d39b97340 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 29 12:08:17.043196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.sql.core [None req-eccfd887-b93c-48c3-bedc-b38d39b97340 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 29 12:08:17.043196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 29 12:08:17.043196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [parameters: {'id': 'b868c3596dc84c51bbd433b3e19deb08', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 29 12:08:17.043196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80081) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 29 12:08:17.051783 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-eccfd887-b93c-48c3-bedc-b38d39b97340 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b868c3596dc84c51bbd433b3e19deb08.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b868c3596dc84c51bbd433b3e19deb08. Jun 29 12:08:17.051783 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:17.051783 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 12:08:17.051783 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 12:08:17.051783 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 12:08:17.051783 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 12:08:17.051783 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 12:08:17.051783 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 12:08:17.051783 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 12:08:17.051783 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application conn.query(q) Jun 29 12:08:17.051783 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 12:08:17.051783 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 12:08:17.051783 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 12:08:17.053569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application result.read() Jun 29 12:08:17.053569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 12:08:17.053569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 12:08:17.053569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 12:08:17.053569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 12:08:17.053569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 12:08:17.053569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 12:08:17.053569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 12:08:17.053569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 12:08:17.053569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 29 12:08:17.053569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:17.053569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 29 12:08:17.053569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:17.053569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:17.053569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 29 12:08:17.053569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 29 12:08:17.053569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 29 12:08:17.053569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 29 12:08:17.056024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 12:08:17.056024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application next(self.gen) Jun 29 12:08:17.056024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 29 12:08:17.056024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application yield resource Jun 29 12:08:17.056024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 12:08:17.056024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application next(self.gen) Jun 29 12:08:17.056024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 29 12:08:17.056024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self.session.rollback() Jun 29 12:08:17.056024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 29 12:08:17.056024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self.force_reraise() Jun 29 12:08:17.056024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 29 12:08:17.056024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise self.value Jun 29 12:08:17.056024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 29 12:08:17.056024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 29 12:08:17.056024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 29 12:08:17.056024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application session.commit() Jun 29 12:08:17.056024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 29 12:08:17.058120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 29 12:08:17.058120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 29 12:08:17.058120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._prepare_impl() Jun 29 12:08:17.058120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 29 12:08:17.058120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self.session.flush() Jun 29 12:08:17.058120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 29 12:08:17.058120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._flush(objects) Jun 29 12:08:17.058120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 29 12:08:17.058120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 29 12:08:17.058120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 29 12:08:17.058120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application compat.raise_( Jun 29 12:08:17.058120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 12:08:17.058120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception Jun 29 12:08:17.058120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 29 12:08:17.058120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application flush_context.execute() Jun 29 12:08:17.058120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 29 12:08:17.058120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rec.execute(self) Jun 29 12:08:17.060279 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 29 12:08:17.060279 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 29 12:08:17.060279 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 29 12:08:17.060279 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 29 12:08:17.060279 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 29 12:08:17.060279 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 29 12:08:17.060279 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 29 12:08:17.060279 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 29 12:08:17.060279 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 29 12:08:17.060279 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 29 12:08:17.060279 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 29 12:08:17.060279 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 29 12:08:17.060279 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 29 12:08:17.060279 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 29 12:08:17.060279 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 29 12:08:17.062067 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 29 12:08:17.062067 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 12:08:17.062067 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception Jun 29 12:08:17.062067 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 12:08:17.062067 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 12:08:17.062067 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 12:08:17.062067 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 12:08:17.062067 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 12:08:17.062067 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 12:08:17.062067 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 12:08:17.062067 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application conn.query(q) Jun 29 12:08:17.062067 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 12:08:17.062067 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 12:08:17.062067 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 12:08:17.062067 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application result.read() Jun 29 12:08:17.062067 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 12:08:17.062067 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 12:08:17.064423 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 12:08:17.064423 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 12:08:17.064423 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 12:08:17.064423 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 12:08:17.064423 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 12:08:17.064423 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 12:08:17.064423 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 29 12:08:17.064423 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 29 12:08:17.064423 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [parameters: {'id': 'b868c3596dc84c51bbd433b3e19deb08', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 29 12:08:17.064423 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 29 12:08:17.064423 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:17.064423 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:08:17.064423 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:17.064423 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:17.064423 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 29 12:08:17.066334 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 29 12:08:17.066334 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 29 12:08:17.066334 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 29 12:08:17.066334 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 29 12:08:17.066334 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:17.066334 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:08:17.066334 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:17.066334 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:17.066334 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:17.066334 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:17.066334 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:17.066334 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:17.066334 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:17.066334 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:17.066334 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:17.066334 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:17.066334 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:17.068464 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:17.068464 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 29 12:08:17.068464 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 29 12:08:17.068464 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:17.068464 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:17.068464 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 29 12:08:17.068464 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 29 12:08:17.068464 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b868c3596dc84c51bbd433b3e19deb08. Jun 29 12:08:17.068464 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:17.068464 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 465/940] 10.222.0.13 () {60 vars in 1140 bytes} [Wed Jun 29 12:08:16 2022] POST /identity/v3/projects => generated 262 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:17.069709 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50de1d-2273-41ce-af0d-4fc216c5666d None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:17.169861 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50de1d-2273-41ce-af0d-4fc216c5666d None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:17.181771 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:17.206935 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555910a0-78eb-4488-9e81-dc9f34b16f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:17.207692 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555910a0-78eb-4488-9e81-dc9f34b16f45 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:17.208233 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555910a0-78eb-4488-9e81-dc9f34b16f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:17.208536 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555910a0-78eb-4488-9e81-dc9f34b16f45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:17.215732 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555910a0-78eb-4488-9e81-dc9f34b16f45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:17.217207 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555910a0-78eb-4488-9e81-dc9f34b16f45 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:17.231604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-555910a0-78eb-4488-9e81-dc9f34b16f45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:17.231604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:17.231604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:17.231604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:17.231604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:17.231604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:17.231604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:17.231604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:17.231604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:17.231604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:17.231604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:17.231604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:17.231604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:17.231604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:17.231604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:17.233716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:17.233716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:17.233716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:17.233716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:17.233716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:17.233716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:17.233716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:17.233716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:17.233716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:17.233716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:17.233716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:17.233716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:17.233716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:17.233716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:17.233716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:17.233716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:17.233716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:17.235852 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:17.235852 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:17.235852 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:17.235852 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:17.235852 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:17.235852 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:17.235852 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:17.235852 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:17.235852 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 476/941] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:17.242657 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfd887-b93c-48c3-bedc-b38d39b97340 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:17.310289 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:17.357284 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfd887-b93c-48c3-bedc-b38d39b97340 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:17.394483 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114e4ed-613d-4c0a-88ee-4f035e3dbe68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:17.395195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114e4ed-613d-4c0a-88ee-4f035e3dbe68 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:17.395484 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114e4ed-613d-4c0a-88ee-4f035e3dbe68 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:17.395764 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114e4ed-613d-4c0a-88ee-4f035e3dbe68 None admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:17.396532 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114e4ed-613d-4c0a-88ee-4f035e3dbe68 None admin] RBAC: Adding query filter params (name=service) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:17.396840 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114e4ed-613d-4c0a-88ee-4f035e3dbe68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:17.398497 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114e4ed-613d-4c0a-88ee-4f035e3dbe68 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:17.420877 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 466/942] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Jun 29 12:08:17 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:17.889838 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bcbf0-4440-43d2-bf95-516d821c7fbb None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:17.890536 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bcbf0-4440-43d2-bf95-516d821c7fbb None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:17.890743 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bcbf0-4440-43d2-bf95-516d821c7fbb None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:17.893126 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 477/943] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:17.900689 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ead53c-29ac-4603-8978-2f7ba3130288 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:17.900978 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ead53c-29ac-4603-8978-2f7ba3130288 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:17.901257 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ead53c-29ac-4603-8978-2f7ba3130288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:17.922727 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-83ead53c-29ac-4603-8978-2f7ba3130288 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:17.924250 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-83ead53c-29ac-4603-8978-2f7ba3130288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:17.999367 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 467/944] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:18.033205 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bcbf0-4440-43d2-bf95-516d821c7fbb None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:18.085676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a8164-edc3-444c-83d0-0a5b39c2e2de None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:18.086001 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a8164-edc3-444c-83d0-0a5b39c2e2de None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:18.086248 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a8164-edc3-444c-83d0-0a5b39c2e2de None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:18.087954 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 468/945] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:18.093244 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46587922-905a-44ce-91e9-170e037f7825 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:18.093808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46587922-905a-44ce-91e9-170e037f7825 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:18.094299 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46587922-905a-44ce-91e9-170e037f7825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:18.112538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-46587922-905a-44ce-91e9-170e037f7825 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:18.114104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-46587922-905a-44ce-91e9-170e037f7825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:18.179740 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bcbf0-4440-43d2-bf95-516d821c7fbb None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:18.194061 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:18.230994 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 469/946] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:18.238348 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1816c-5d54-4923-9850-f1155c639889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:18.239619 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1816c-5d54-4923-9850-f1155c639889 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:18.240041 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1816c-5d54-4923-9850-f1155c639889 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:18.240452 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1816c-5d54-4923-9850-f1155c639889 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:18.241469 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f1816c-5d54-4923-9850-f1155c639889 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:18.243752 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f1816c-5d54-4923-9850-f1155c639889 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:18.247044 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac7f9a-2bdb-43e1-ac52-fe791a81cf5e None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:18.247490 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac7f9a-2bdb-43e1-ac52-fe791a81cf5e None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:18.247990 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac7f9a-2bdb-43e1-ac52-fe791a81cf5e None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:18.250886 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 470/947] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:08:18.255013 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac7f9a-2bdb-43e1-ac52-fe791a81cf5e None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:18.262284 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-96f1816c-5d54-4923-9850-f1155c639889 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 12:08:18.262284 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:18.262284 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:08:18.262284 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:08:18.262284 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:08:18.262284 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:08:18.262284 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:08:18.262284 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:18.262284 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 12:08:18.262284 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:18.262284 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:08:18.262284 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:18.262284 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:18.262284 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:18.262284 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:18.262284 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:18.262284 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:18.263445 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:18.263445 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:18.263445 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:18.263445 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:18.263445 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:18.263445 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:18.263445 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:08:18.263445 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:08:18.263445 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:08:18.263445 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:08:18.263445 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:18.263445 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:18.263445 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:18.263445 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:18.263445 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:18.263445 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:18.264294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:18.264294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:18.264294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:18.264294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:18.264294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:18.264294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:18.264294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:18.264294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:18.264294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:18.264294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:18.264294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:08:18.264294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:18.264294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 12:08:18.264294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:18.264294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 478/948] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Jun 29 12:08:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:18.265501 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d008a0-46ec-4cb7-8d75-9db495f3fb93 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:18.265501 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d008a0-46ec-4cb7-8d75-9db495f3fb93 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:18.265745 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d008a0-46ec-4cb7-8d75-9db495f3fb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:18.288907 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-d7d008a0-46ec-4cb7-8d75-9db495f3fb93 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:18.290128 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-d7d008a0-46ec-4cb7-8d75-9db495f3fb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:18.318088 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:18.362026 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 479/949] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:18.362967 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d008a0-46ec-4cb7-8d75-9db495f3fb93 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:18.382324 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac7f9a-2bdb-43e1-ac52-fe791a81cf5e None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:18.425715 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d96836-1c2d-4f4c-8c42-dc279df6c277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:18.426525 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d96836-1c2d-4f4c-8c42-dc279df6c277 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:18.426893 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d96836-1c2d-4f4c-8c42-dc279df6c277 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:18.427139 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d96836-1c2d-4f4c-8c42-dc279df6c277 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:18.439074 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d96836-1c2d-4f4c-8c42-dc279df6c277 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:18.448338 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-10d96836-1c2d-4f4c-8c42-dc279df6c277 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 12:08:18.448338 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:18.448338 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:18.448338 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:18.448338 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:18.448338 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:18.448338 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:18.448338 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:18.448338 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:18.448338 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:18.448338 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:18.448338 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:18.448338 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:18.448338 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:18.448338 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:18.448338 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:18.449364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:18.449364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:18.449364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:18.449364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:18.449364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:18.449364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:18.449364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:18.449364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:18.449364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:18.449364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:18.449364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:18.449364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:18.449364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:18.449364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:18.449364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:18.449364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:18.450223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:18.450223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:18.450223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:18.450223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:18.450223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:18.450223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:18.450223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:18.450223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:18.450223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:18.450223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:18.450223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 12:08:18.450223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:18.450223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 471/950] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Jun 29 12:08:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:18.451262 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d96836-1c2d-4f4c-8c42-dc279df6c277 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:18.492104 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d008a0-46ec-4cb7-8d75-9db495f3fb93 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:18.496128 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:18.532890 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e38f52-2e2a-4073-b7d0-d22f47752118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:18.533469 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e38f52-2e2a-4073-b7d0-d22f47752118 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:18.533752 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e38f52-2e2a-4073-b7d0-d22f47752118 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:18.534022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e38f52-2e2a-4073-b7d0-d22f47752118 None admin] PATH_INFO: `/v3/services` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:18.534802 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e38f52-2e2a-4073-b7d0-d22f47752118 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:18.535111 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e38f52-2e2a-4073-b7d0-d22f47752118 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:18.536763 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e38f52-2e2a-4073-b7d0-d22f47752118 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:18.546493 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 480/951] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Jun 29 12:08:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:18.546493 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e38f52-2e2a-4073-b7d0-d22f47752118 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:18.571409 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d96836-1c2d-4f4c-8c42-dc279df6c277 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:18.576147 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:18.617901 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f2f49-dcf2-401c-a78c-73382a93eae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:18.619200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f2f49-dcf2-401c-a78c-73382a93eae0 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:18.619626 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f2f49-dcf2-401c-a78c-73382a93eae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:18.620041 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f2f49-dcf2-401c-a78c-73382a93eae0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:18.621088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f2f49-dcf2-401c-a78c-73382a93eae0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:18.623344 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f2f49-dcf2-401c-a78c-73382a93eae0 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:18.644437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-722f2f49-dcf2-401c-a78c-73382a93eae0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 12:08:18.644437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:18.644437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:08:18.644437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:08:18.644437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:08:18.644437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:08:18.644437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:08:18.644437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:18.644437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 12:08:18.644437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:18.644437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:08:18.644437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:18.644437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:18.644437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:18.644437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:18.644437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:18.644437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:18.645502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:18.645502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:18.645502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:18.645502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:18.645502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:18.645502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:18.645502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:08:18.645502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:08:18.645502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:08:18.645502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:08:18.645502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:18.645502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:18.645502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:18.645502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:18.645502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:18.645502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:18.646530 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:18.646530 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:18.646530 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:18.646530 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:18.646530 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:18.646530 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:18.646530 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:18.646530 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:18.646530 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:18.646530 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:18.646530 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:08:18.646530 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:18.646530 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 12:08:18.646530 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:18.646530 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 472/952] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:18.647886 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f2f49-dcf2-401c-a78c-73382a93eae0 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:18.657175 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e38f52-2e2a-4073-b7d0-d22f47752118 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:18.697894 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e35ab4-af6c-4818-b675-08567abf9720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:18.698575 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e35ab4-af6c-4818-b675-08567abf9720 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:18.698976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e35ab4-af6c-4818-b675-08567abf9720 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:18.699437 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e35ab4-af6c-4818-b675-08567abf9720 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:18.700449 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e35ab4-af6c-4818-b675-08567abf9720 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:18.700758 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e35ab4-af6c-4818-b675-08567abf9720 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:18.702144 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e35ab4-af6c-4818-b675-08567abf9720 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:18.715089 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 481/953] 10.222.0.13 () {56 vars in 1115 bytes} [Wed Jun 29 12:08:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:18.716178 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e35ab4-af6c-4818-b675-08567abf9720 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:18.801549 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f2f49-dcf2-401c-a78c-73382a93eae0 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:18.803624 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:18.844431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:18.847010 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b6901-c122-4a99-b8c0-787f65ed4e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:18.847698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b6901-c122-4a99-b8c0-787f65ed4e48 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:18.847980 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b6901-c122-4a99-b8c0-787f65ed4e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:18.848264 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b6901-c122-4a99-b8c0-787f65ed4e48 None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:18.848970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b6901-c122-4a99-b8c0-787f65ed4e48 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:18.849275 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b6901-c122-4a99-b8c0-787f65ed4e48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:18.850972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b6901-c122-4a99-b8c0-787f65ed4e48 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:18.856640 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 473/954] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Jun 29 12:08:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:18.857454 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b6901-c122-4a99-b8c0-787f65ed4e48 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:18.858257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e35ab4-af6c-4818-b675-08567abf9720 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:18.903956 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fbea2-471e-412f-8a19-816efb68dac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:18.904777 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fbea2-471e-412f-8a19-816efb68dac9 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:18.904999 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fbea2-471e-412f-8a19-816efb68dac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:18.905274 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fbea2-471e-412f-8a19-816efb68dac9 None admin] PATH_INFO: `/v3/services` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:18.905980 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514fbea2-471e-412f-8a19-816efb68dac9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:18.906291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514fbea2-471e-412f-8a19-816efb68dac9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:18.907828 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514fbea2-471e-412f-8a19-816efb68dac9 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:18.921621 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 482/955] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Jun 29 12:08:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:18.921621 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fbea2-471e-412f-8a19-816efb68dac9 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:19.000393 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b6901-c122-4a99-b8c0-787f65ed4e48 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:19.042443 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0e6ac-fd03-46f1-978b-ec03eeb9625e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:19.043327 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0e6ac-fd03-46f1-978b-ec03eeb9625e None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:19.043620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0e6ac-fd03-46f1-978b-ec03eeb9625e None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:19.043902 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0e6ac-fd03-46f1-978b-ec03eeb9625e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:19.050438 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fbea2-471e-412f-8a19-816efb68dac9 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:19.057282 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b0e6ac-fd03-46f1-978b-ec03eeb9625e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:19.059003 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b0e6ac-fd03-46f1-978b-ec03eeb9625e None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:19.078871 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-33b0e6ac-fd03-46f1-978b-ec03eeb9625e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:19.078871 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:19.078871 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:19.078871 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:19.078871 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:19.078871 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:19.078871 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:19.078871 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:19.078871 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:19.078871 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:19.078871 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:19.078871 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:19.078871 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:19.078871 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:19.078871 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:19.079982 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:19.079982 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:19.079982 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:19.079982 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:19.079982 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:19.079982 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:19.079982 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:19.079982 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:19.079982 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:19.079982 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:19.079982 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:19.079982 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:19.079982 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:19.079982 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:19.079982 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:19.079982 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:19.079982 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:19.080864 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:19.080864 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:19.080864 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:19.080864 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:19.085398 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 474/956] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:19.086404 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0e6ac-fd03-46f1-978b-ec03eeb9625e None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:19.095204 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562c986-a608-4aa3-b340-e9c91b0ad2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:19.096117 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562c986-a608-4aa3-b340-e9c91b0ad2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:19.096644 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562c986-a608-4aa3-b340-e9c91b0ad2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:19.097607 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562c986-a608-4aa3-b340-e9c91b0ad2a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:19.098464 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562c986-a608-4aa3-b340-e9c91b0ad2a9 None admin] RBAC: Adding query filter params (interface=public, service_id=a0b39eb9539646b6b41eeec8d2a374ca, region_id=RegionOne) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:19.098857 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562c986-a608-4aa3-b340-e9c91b0ad2a9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:19.100564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562c986-a608-4aa3-b340-e9c91b0ad2a9 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:19.107360 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 483/957] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Jun 29 12:08:18 2022] GET /identity/v3/endpoints?service_id=a0b39eb9539646b6b41eeec8d2a374ca&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:19.109063 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562c986-a608-4aa3-b340-e9c91b0ad2a9 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:19.114262 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:19.138848 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:19.221068 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0e6ac-fd03-46f1-978b-ec03eeb9625e None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:19.241506 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562c986-a608-4aa3-b340-e9c91b0ad2a9 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:19.261589 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4967d-7571-4847-a8b7-0e4255906d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:19.262272 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4967d-7571-4847-a8b7-0e4255906d05 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:19.262553 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4967d-7571-4847-a8b7-0e4255906d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:19.262853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4967d-7571-4847-a8b7-0e4255906d05 None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:19.263656 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4967d-7571-4847-a8b7-0e4255906d05 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:19.263965 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4967d-7571-4847-a8b7-0e4255906d05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:19.265343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4967d-7571-4847-a8b7-0e4255906d05 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:19.270978 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 475/958] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Jun 29 12:08:19 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:19.271652 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4967d-7571-4847-a8b7-0e4255906d05 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:19.291090 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4c9cb-6884-4b32-89fe-707908002d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:19.292224 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4c9cb-6884-4b32-89fe-707908002d8f None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:19.292505 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4c9cb-6884-4b32-89fe-707908002d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:19.292779 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4c9cb-6884-4b32-89fe-707908002d8f None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:19.293514 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4c9cb-6884-4b32-89fe-707908002d8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:19.293816 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4c9cb-6884-4b32-89fe-707908002d8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:19.295255 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4c9cb-6884-4b32-89fe-707908002d8f None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:19.310216 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 484/959] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:19.316891 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4c9cb-6884-4b32-89fe-707908002d8f None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:19.396284 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:19.428468 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4967d-7571-4847-a8b7-0e4255906d05 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:19.429540 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:19.471036 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4c9cb-6884-4b32-89fe-707908002d8f None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:19.499972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67bb3b-4b2f-42be-b9dd-8dd07ca09a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:19.501001 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67bb3b-4b2f-42be-b9dd-8dd07ca09a90 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:19.501467 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67bb3b-4b2f-42be-b9dd-8dd07ca09a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:19.501935 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67bb3b-4b2f-42be-b9dd-8dd07ca09a90 None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:19.503415 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67bb3b-4b2f-42be-b9dd-8dd07ca09a90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:19.505174 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67bb3b-4b2f-42be-b9dd-8dd07ca09a90 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:19.519094 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900711b-bdf6-4bcc-920c-d57d23b26809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:19.519094 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900711b-bdf6-4bcc-920c-d57d23b26809 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:19.519094 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900711b-bdf6-4bcc-920c-d57d23b26809 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:19.519094 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900711b-bdf6-4bcc-920c-d57d23b26809 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:19.520033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 476/960] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Jun 29 12:08:19 2022] GET /identity/v3/services => generated 1497 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:08:19.529494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900711b-bdf6-4bcc-920c-d57d23b26809 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:19.531034 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900711b-bdf6-4bcc-920c-d57d23b26809 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:19.549240 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-0900711b-bdf6-4bcc-920c-d57d23b26809 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 12:08:19.549240 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:19.549240 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:19.549240 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:19.549240 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:19.549240 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:19.549240 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:19.549240 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:19.549240 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:19.549240 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:19.549240 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:19.549240 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:19.549240 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:08:19.549240 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:08:19.549240 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:08:19.549240 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:08:19.550853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:19.550853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:19.550853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:19.550853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:19.550853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:19.550853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:19.550853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:19.550853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:19.550853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:19.550853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:19.550853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:19.550853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:19.550853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:19.550853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:19.550853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:19.550853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:19.550853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:19.550853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:19.551846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:19.551846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:19.551846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:08:19.551846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:08:19.551846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:08:19.551846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:08:19.551846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:08:19.551846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:08:19.551846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 12:08:19.551846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:19.551846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 485/961] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Jun 29 12:08:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:19.558748 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67bb3b-4b2f-42be-b9dd-8dd07ca09a90 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:19.672074 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67bb3b-4b2f-42be-b9dd-8dd07ca09a90 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:19.709571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8908d0c-4e2d-40d6-913d-1af73545f1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:19.710267 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8908d0c-4e2d-40d6-913d-1af73545f1bd None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:19.710547 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8908d0c-4e2d-40d6-913d-1af73545f1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:19.710853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8908d0c-4e2d-40d6-913d-1af73545f1bd None admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:19.711691 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8908d0c-4e2d-40d6-913d-1af73545f1bd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:19.711997 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8908d0c-4e2d-40d6-913d-1af73545f1bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:19.713426 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8908d0c-4e2d-40d6-913d-1af73545f1bd None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:19.738678 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 477/962] 10.222.0.13 () {56 vars in 1149 bytes} [Wed Jun 29 12:08:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:19.741200 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900711b-bdf6-4bcc-920c-d57d23b26809 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:19.842163 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a250dc0-57f6-4a5b-81e2-1df51d3e321a None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:19.842460 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a250dc0-57f6-4a5b-81e2-1df51d3e321a None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:19.842788 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a250dc0-57f6-4a5b-81e2-1df51d3e321a None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:19.844364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 478/963] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:08:19.849497 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc166e9-0554-47b4-8304-c129c9c72d8f None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:19.850507 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc166e9-0554-47b4-8304-c129c9c72d8f None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:19.851123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc166e9-0554-47b4-8304-c129c9c72d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:19.853077 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900711b-bdf6-4bcc-920c-d57d23b26809 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:19.859510 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:19.872697 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-0cc166e9-0554-47b4-8304-c129c9c72d8f None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:19.874429 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-0cc166e9-0554-47b4-8304-c129c9c72d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:19.894376 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85143958-a360-43b8-8b68-882c3c66a3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:19.895089 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85143958-a360-43b8-8b68-882c3c66a3aa None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:19.895372 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85143958-a360-43b8-8b68-882c3c66a3aa None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:19.895649 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85143958-a360-43b8-8b68-882c3c66a3aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:19.904948 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:19.990526 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85143958-a360-43b8-8b68-882c3c66a3aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:19.991959 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85143958-a360-43b8-8b68-882c3c66a3aa None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:20.002508 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 479/964] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:08:20.028365 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc166e9-0554-47b4-8304-c129c9c72d8f None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:20.147381 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 486/965] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:19 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 29 12:08:20.152457 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85143958-a360-43b8-8b68-882c3c66a3aa None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:20.200233 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:20.204103 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc166e9-0554-47b4-8304-c129c9c72d8f None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:20.264973 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd69e7-98c7-4762-badd-0301c66e1384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:20.265992 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd69e7-98c7-4762-badd-0301c66e1384 None admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:20.266494 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd69e7-98c7-4762-badd-0301c66e1384 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:20.267038 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd69e7-98c7-4762-badd-0301c66e1384 None admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:20.267951 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd69e7-98c7-4762-badd-0301c66e1384 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:20.270164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd69e7-98c7-4762-badd-0301c66e1384 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:20.278816 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:20.288082 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.sql.core [None req-f5dd69e7-98c7-4762-badd-0301c66e1384 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 29 12:08:20.288082 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 29 12:08:20.288082 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [parameters: {'user_id': '8330f93ead4b401a9326e030d8d44765', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 29 12:08:20.288082 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80081) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 29 12:08:20.292745 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85143958-a360-43b8-8b68-882c3c66a3aa None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:20.296035 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-f5dd69e7-98c7-4762-badd-0301c66e1384 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 29 12:08:20.296035 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:20.296035 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 12:08:20.296035 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 12:08:20.296035 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 12:08:20.296035 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 12:08:20.296035 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 12:08:20.296035 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 12:08:20.296035 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 12:08:20.296035 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application conn.query(q) Jun 29 12:08:20.296035 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 12:08:20.296035 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 12:08:20.296035 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 12:08:20.296035 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application result.read() Jun 29 12:08:20.296035 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 12:08:20.297492 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 12:08:20.297492 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 12:08:20.297492 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 12:08:20.297492 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 12:08:20.297492 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 12:08:20.297492 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 12:08:20.297492 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 12:08:20.297492 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 29 12:08:20.297492 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:20.297492 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 29 12:08:20.297492 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:20.297492 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:20.297492 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 29 12:08:20.297492 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 29 12:08:20.297492 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 29 12:08:20.297492 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 29 12:08:20.297492 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 12:08:20.297492 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application next(self.gen) Jun 29 12:08:20.299150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 29 12:08:20.299150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application yield resource Jun 29 12:08:20.299150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 12:08:20.299150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application next(self.gen) Jun 29 12:08:20.299150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 29 12:08:20.299150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self.session.rollback() Jun 29 12:08:20.299150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 29 12:08:20.299150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self.force_reraise() Jun 29 12:08:20.299150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 29 12:08:20.299150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise self.value Jun 29 12:08:20.299150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 29 12:08:20.299150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 29 12:08:20.299150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 29 12:08:20.299150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application session.commit() Jun 29 12:08:20.299150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 29 12:08:20.299150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 29 12:08:20.299150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 29 12:08:20.300810 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._prepare_impl() Jun 29 12:08:20.300810 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 29 12:08:20.300810 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self.session.flush() Jun 29 12:08:20.300810 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 29 12:08:20.300810 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._flush(objects) Jun 29 12:08:20.300810 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 29 12:08:20.300810 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 29 12:08:20.300810 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 29 12:08:20.300810 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application compat.raise_( Jun 29 12:08:20.300810 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 12:08:20.300810 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception Jun 29 12:08:20.300810 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 29 12:08:20.300810 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application flush_context.execute() Jun 29 12:08:20.300810 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 29 12:08:20.300810 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rec.execute(self) Jun 29 12:08:20.300810 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 29 12:08:20.300810 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 29 12:08:20.302348 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 29 12:08:20.302348 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 29 12:08:20.302348 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 29 12:08:20.302348 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 29 12:08:20.302348 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 29 12:08:20.302348 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 29 12:08:20.302348 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 29 12:08:20.302348 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 29 12:08:20.302348 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 29 12:08:20.302348 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 29 12:08:20.302348 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 29 12:08:20.302348 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 29 12:08:20.302348 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 29 12:08:20.302348 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 29 12:08:20.302348 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 12:08:20.302348 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception Jun 29 12:08:20.305629 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 12:08:20.305629 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 12:08:20.305629 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 12:08:20.305629 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 12:08:20.305629 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 12:08:20.305629 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 12:08:20.305629 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 12:08:20.305629 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application conn.query(q) Jun 29 12:08:20.305629 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 12:08:20.305629 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 12:08:20.305629 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 12:08:20.305629 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application result.read() Jun 29 12:08:20.305629 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 12:08:20.305629 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 12:08:20.305629 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 12:08:20.305629 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 12:08:20.307353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 12:08:20.307353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 12:08:20.307353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 12:08:20.307353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 12:08:20.307353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 29 12:08:20.307353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 29 12:08:20.307353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [parameters: {'user_id': '8330f93ead4b401a9326e030d8d44765', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 29 12:08:20.307353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 29 12:08:20.307353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:20.307353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:08:20.307353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:20.307353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:20.307353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:20.307353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:20.307353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:20.309036 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:20.309036 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:20.309036 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:20.309036 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:20.309036 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:20.309036 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:20.309036 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:20.309036 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 29 12:08:20.309036 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 29 12:08:20.309036 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:20.309036 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:20.309036 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:20.309036 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:20.309036 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:20.309036 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:20.309036 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 29 12:08:20.309036 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 29 12:08:20.315012 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 29 12:08:20.315012 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 29 12:08:20.315012 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 29 12:08:20.315012 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 29 12:08:20.315012 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 29 12:08:20.315012 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:20.315012 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 480/966] 10.222.0.13 () {60 vars in 1131 bytes} [Wed Jun 29 12:08:20 2022] POST /identity/v3/users => generated 160 bytes in 271 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:20.315012 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd69e7-98c7-4762-badd-0301c66e1384 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:20.366750 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7036124-4c4b-45a5-9b67-2342cc54452e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:20.368457 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7036124-4c4b-45a5-9b67-2342cc54452e None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:20.369099 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7036124-4c4b-45a5-9b67-2342cc54452e None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:20.369746 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7036124-4c4b-45a5-9b67-2342cc54452e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:20.388241 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7036124-4c4b-45a5-9b67-2342cc54452e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:20.391032 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7036124-4c4b-45a5-9b67-2342cc54452e None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:20.419925 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd69e7-98c7-4762-badd-0301c66e1384 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:20.424208 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-d7036124-4c4b-45a5-9b67-2342cc54452e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:20.424208 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:20.424208 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:20.424208 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:20.424208 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:20.424208 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:20.424208 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:20.424208 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:20.424208 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:20.424208 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:20.424208 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:20.424208 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:20.424208 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:20.424208 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:20.424208 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:20.425627 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:20.425627 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:20.425627 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:20.425627 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:20.425627 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:20.425627 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:20.425627 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:20.425627 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:20.425627 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:20.425627 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:20.425627 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:20.425627 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:20.425627 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:20.425627 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:20.425627 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:20.425627 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:20.425627 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:20.427122 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:20.427122 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:20.427122 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:20.427122 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:20.430605 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 487/967] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:20.436465 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7036124-4c4b-45a5-9b67-2342cc54452e None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:20.470317 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671200dd-adb9-4033-b36e-547e4fdc4299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:20.470317 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671200dd-adb9-4033-b36e-547e4fdc4299 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:20.470880 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671200dd-adb9-4033-b36e-547e4fdc4299 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:20.470880 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671200dd-adb9-4033-b36e-547e4fdc4299 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:20.481382 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671200dd-adb9-4033-b36e-547e4fdc4299 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:20.483227 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671200dd-adb9-4033-b36e-547e4fdc4299 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:20.501612 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-671200dd-adb9-4033-b36e-547e4fdc4299 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 12:08:20.501612 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:20.501612 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:20.501612 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:20.501612 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:20.501612 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:20.501612 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:20.501612 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:20.501612 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:20.501612 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:20.501612 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:20.501612 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:20.501612 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:08:20.501612 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:08:20.501612 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:08:20.501612 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:08:20.502630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:20.502630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:20.502630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:20.502630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:20.502630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:20.502630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:20.502630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:20.502630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:20.502630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:20.502630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:20.502630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:20.502630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:20.502630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:20.502630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:20.502630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:20.502630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:20.502630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:20.502630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:20.503648 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:20.503648 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:20.503648 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:08:20.503648 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:08:20.503648 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:08:20.503648 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:08:20.503648 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:08:20.503648 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:08:20.503648 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 12:08:20.503648 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:20.507042 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 481/968] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:08:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:20.509163 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671200dd-adb9-4033-b36e-547e4fdc4299 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:20.546452 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:20.557724 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7036124-4c4b-45a5-9b67-2342cc54452e None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:20.575025 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:20.595075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6ba0a-924e-43e6-b31c-3474c89b606e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:20.596208 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6ba0a-924e-43e6-b31c-3474c89b606e None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:20.597286 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6ba0a-924e-43e6-b31c-3474c89b606e None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:20.597768 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6ba0a-924e-43e6-b31c-3474c89b606e None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:20.598731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6ba0a-924e-43e6-b31c-3474c89b606e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:20.599257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6ba0a-924e-43e6-b31c-3474c89b606e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:20.600883 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6ba0a-924e-43e6-b31c-3474c89b606e None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:20.613434 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 488/969] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:20.618603 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6ba0a-924e-43e6-b31c-3474c89b606e None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:20.631112 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671200dd-adb9-4033-b36e-547e4fdc4299 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:20.670045 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb24709-540d-4587-a68b-ea8d82b2cf24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:20.670655 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb24709-540d-4587-a68b-ea8d82b2cf24 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:20.670944 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb24709-540d-4587-a68b-ea8d82b2cf24 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:20.671220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb24709-540d-4587-a68b-ea8d82b2cf24 None admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:20.672247 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb24709-540d-4587-a68b-ea8d82b2cf24 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:20.672373 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb24709-540d-4587-a68b-ea8d82b2cf24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:20.673746 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb24709-540d-4587-a68b-ea8d82b2cf24 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:20.724585 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 482/970] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 29 12:08:20 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:20.737249 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6ba0a-924e-43e6-b31c-3474c89b606e None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:20.781293 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61994d46-fd79-41d0-bfeb-2f5f86de85a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:20.782582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61994d46-fd79-41d0-bfeb-2f5f86de85a2 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:20.783179 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61994d46-fd79-41d0-bfeb-2f5f86de85a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:20.783682 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61994d46-fd79-41d0-bfeb-2f5f86de85a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:20.793281 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61994d46-fd79-41d0-bfeb-2f5f86de85a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:20.795249 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61994d46-fd79-41d0-bfeb-2f5f86de85a2 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:20.813515 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-61994d46-fd79-41d0-bfeb-2f5f86de85a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:20.813515 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:20.813515 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:20.813515 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:20.813515 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:20.813515 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:20.813515 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:20.813515 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:20.813515 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:20.813515 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:20.813515 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:20.813515 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:20.813515 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:20.813515 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:20.813515 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:20.814492 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:20.814492 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:20.814492 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:20.814492 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:20.814492 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:20.814492 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:20.814492 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:20.814492 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:20.814492 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:20.814492 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:20.814492 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:20.814492 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:20.814492 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:20.814492 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:20.814492 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:20.814492 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:20.814492 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:20.816181 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:20.816181 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:20.816181 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:20.816181 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:20.816181 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:20.816181 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:20.816181 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:20.816181 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:20.819020 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 489/971] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:20.827333 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb24709-540d-4587-a68b-ea8d82b2cf24 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:20.943670 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb24709-540d-4587-a68b-ea8d82b2cf24 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:20.961339 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:20.983125 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f005c47-4f9f-4092-af59-c624613e9478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:20.983813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f005c47-4f9f-4092-af59-c624613e9478 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:20.984096 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f005c47-4f9f-4092-af59-c624613e9478 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:20.984427 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f005c47-4f9f-4092-af59-c624613e9478 None admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:20.985224 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f005c47-4f9f-4092-af59-c624613e9478 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:20.985531 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f005c47-4f9f-4092-af59-c624613e9478 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:20.987031 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f005c47-4f9f-4092-af59-c624613e9478 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:21.000569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 483/972] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:08:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:21.007143 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61994d46-fd79-41d0-bfeb-2f5f86de85a2 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:21.021304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:21.118937 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61994d46-fd79-41d0-bfeb-2f5f86de85a2 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:21.154238 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314daaa-faef-47e8-9364-8296bb0f1089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:21.155023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314daaa-faef-47e8-9364-8296bb0f1089 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:21.155309 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314daaa-faef-47e8-9364-8296bb0f1089 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:21.155583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314daaa-faef-47e8-9364-8296bb0f1089 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:21.156407 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314daaa-faef-47e8-9364-8296bb0f1089 None admin] RBAC: Adding query filter params (role.id=1d0cb8616d7f45139d1db10e50725fe7, scope.project.id=489877ae137244c5b83291671c703c99, user.id=2891b5a315b64f228f665e024b641629) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:21.156718 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314daaa-faef-47e8-9364-8296bb0f1089 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:21.158156 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314daaa-faef-47e8-9364-8296bb0f1089 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:21.170731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 490/973] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:08:21 2022] GET /identity/v3/role_assignments?user.id=2891b5a315b64f228f665e024b641629&scope.project.id=489877ae137244c5b83291671c703c99&role.id=1d0cb8616d7f45139d1db10e50725fe7 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:21.679342 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20aa2b-1c79-4607-b2ca-67218208c63a None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:21.679866 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20aa2b-1c79-4607-b2ca-67218208c63a None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:21.680340 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20aa2b-1c79-4607-b2ca-67218208c63a None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:21.682957 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 484/974] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:21.688694 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5984734-fcb5-4fa3-95b7-ff6b54f8404e None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:21.689020 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5984734-fcb5-4fa3-95b7-ff6b54f8404e None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:21.689268 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5984734-fcb5-4fa3-95b7-ff6b54f8404e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:21.706011 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-e5984734-fcb5-4fa3-95b7-ff6b54f8404e None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:21.707232 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-e5984734-fcb5-4fa3-95b7-ff6b54f8404e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:21.790735 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 491/975] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:08:21.814527 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20aa2b-1c79-4607-b2ca-67218208c63a None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:21.923942 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd9f54-80a6-46d8-b2fd-876bfbc8d179 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:21.924409 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd9f54-80a6-46d8-b2fd-876bfbc8d179 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:21.924910 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd9f54-80a6-46d8-b2fd-876bfbc8d179 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:21.930962 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 492/976] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:21.933160 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63014e-2f7d-4156-9f4a-b95eb56f3eb1 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:21.933807 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63014e-2f7d-4156-9f4a-b95eb56f3eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:21.934260 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63014e-2f7d-4156-9f4a-b95eb56f3eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:21.943066 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:21.960434 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-1e63014e-2f7d-4156-9f4a-b95eb56f3eb1 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:21.961695 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-1e63014e-2f7d-4156-9f4a-b95eb56f3eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:21.981973 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20aa2b-1c79-4607-b2ca-67218208c63a None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:22.020417 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2488f43-873f-4af3-ae45-a1575e05a3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:22.021281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2488f43-873f-4af3-ae45-a1575e05a3e0 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:22.021633 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2488f43-873f-4af3-ae45-a1575e05a3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:22.021806 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2488f43-873f-4af3-ae45-a1575e05a3e0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:22.022491 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2488f43-873f-4af3-ae45-a1575e05a3e0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:22.023893 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2488f43-873f-4af3-ae45-a1575e05a3e0 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:22.037270 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-d2488f43-873f-4af3-ae45-a1575e05a3e0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 12:08:22.037270 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:22.037270 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:08:22.037270 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:08:22.037270 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:08:22.037270 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:08:22.037270 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:08:22.037270 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:22.037270 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 12:08:22.037270 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:22.037270 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:08:22.037270 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:22.037270 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:22.037270 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:22.037270 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:22.037270 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:22.037270 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:22.038330 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:22.038330 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:22.038330 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:22.038330 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:22.038330 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:22.038330 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:22.038330 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:08:22.038330 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:08:22.038330 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:08:22.038330 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:08:22.038330 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:22.038330 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:22.038330 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:22.038330 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:22.038330 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:22.038330 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:22.039552 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:22.039552 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:22.039552 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:22.039552 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:22.039552 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:22.039552 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:22.039552 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:22.039552 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:22.039552 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:22.039552 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:22.039552 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:08:22.039552 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:22.039552 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 12:08:22.039552 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:22.039552 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 485/977] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Jun 29 12:08:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:22.044356 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2488f43-873f-4af3-ae45-a1575e05a3e0 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:22.049675 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 493/978] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:22.086721 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63014e-2f7d-4156-9f4a-b95eb56f3eb1 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:22.109740 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:22.204134 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2488f43-873f-4af3-ae45-a1575e05a3e0 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:22.240999 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63014e-2f7d-4156-9f4a-b95eb56f3eb1 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:22.256824 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c592e17-3ac6-46ef-b72d-c7a70fa8a92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:22.257869 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c592e17-3ac6-46ef-b72d-c7a70fa8a92a None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:22.258345 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c592e17-3ac6-46ef-b72d-c7a70fa8a92a None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:22.258859 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c592e17-3ac6-46ef-b72d-c7a70fa8a92a None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:22.259925 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c592e17-3ac6-46ef-b72d-c7a70fa8a92a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:22.260437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c592e17-3ac6-46ef-b72d-c7a70fa8a92a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:22.262781 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c592e17-3ac6-46ef-b72d-c7a70fa8a92a None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:22.275421 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 486/979] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Jun 29 12:08:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:22.276906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c592e17-3ac6-46ef-b72d-c7a70fa8a92a None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:22.296917 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc97399-00e6-4d5d-aa6f-4612cdbdfe90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:22.297961 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc97399-00e6-4d5d-aa6f-4612cdbdfe90 None admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:22.298287 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc97399-00e6-4d5d-aa6f-4612cdbdfe90 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:22.298733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc97399-00e6-4d5d-aa6f-4612cdbdfe90 None admin] PATH_INFO: `/v3/services` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:22.300025 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc97399-00e6-4d5d-aa6f-4612cdbdfe90 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:22.302380 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc97399-00e6-4d5d-aa6f-4612cdbdfe90 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:22.305644 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:22.322366 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 494/980] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Jun 29 12:08:22 2022] POST /identity/v3/services => generated 242 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:08:22.456777 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c592e17-3ac6-46ef-b72d-c7a70fa8a92a None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:22.459587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:22.519857 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fab804-c152-40a7-bdd2-056193827f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:22.520936 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fab804-c152-40a7-bdd2-056193827f28 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:22.521388 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fab804-c152-40a7-bdd2-056193827f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:22.521851 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fab804-c152-40a7-bdd2-056193827f28 None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:22.523097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fab804-c152-40a7-bdd2-056193827f28 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:22.523517 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fab804-c152-40a7-bdd2-056193827f28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:22.525034 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fab804-c152-40a7-bdd2-056193827f28 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:22.530889 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 487/981] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Jun 29 12:08:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:22.536785 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc97399-00e6-4d5d-aa6f-4612cdbdfe90 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:22.715579 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc97399-00e6-4d5d-aa6f-4612cdbdfe90 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:22.764859 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bb2b3-9ada-4380-8684-5eaa6484aa6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:22.765530 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bb2b3-9ada-4380-8684-5eaa6484aa6c None admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:22.765814 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bb2b3-9ada-4380-8684-5eaa6484aa6c None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:22.766079 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bb2b3-9ada-4380-8684-5eaa6484aa6c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:22.766855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2bb2b3-9ada-4380-8684-5eaa6484aa6c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:22.768318 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2bb2b3-9ada-4380-8684-5eaa6484aa6c None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:22.793276 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 495/982] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Jun 29 12:08:22 2022] POST /identity/v3/endpoints => generated 349 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:08:23.496016 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c3ef1-1eff-4522-9cab-785ff98a109a None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:23.496580 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c3ef1-1eff-4522-9cab-785ff98a109a None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:23.496580 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c3ef1-1eff-4522-9cab-785ff98a109a None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:23.498196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 488/983] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:08:23.503940 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db1a79-1bc5-4340-bb2b-49b437bd2777 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:23.504437 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db1a79-1bc5-4340-bb2b-49b437bd2777 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:23.504525 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db1a79-1bc5-4340-bb2b-49b437bd2777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:23.522007 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-41db1a79-1bc5-4340-bb2b-49b437bd2777 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:23.523249 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-41db1a79-1bc5-4340-bb2b-49b437bd2777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:23.576161 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:23.606016 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 496/984] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:23 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:23.628967 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c3ef1-1eff-4522-9cab-785ff98a109a None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:23.740213 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c3ef1-1eff-4522-9cab-785ff98a109a None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:23.776446 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c03b5f-7b40-4b1e-9877-7ed69e0cd871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:23.777160 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c03b5f-7b40-4b1e-9877-7ed69e0cd871 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:23.777437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c03b5f-7b40-4b1e-9877-7ed69e0cd871 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:23.777705 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c03b5f-7b40-4b1e-9877-7ed69e0cd871 None admin] PATH_INFO: `/v3/services/image` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:23.778350 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c03b5f-7b40-4b1e-9877-7ed69e0cd871 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:23.779740 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c03b5f-7b40-4b1e-9877-7ed69e0cd871 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:23.791649 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-96c03b5f-7b40-4b1e-9877-7ed69e0cd871 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 12:08:23.791649 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:23.791649 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:08:23.791649 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:08:23.791649 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:08:23.791649 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:08:23.791649 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:08:23.791649 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:23.791649 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 12:08:23.791649 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:23.791649 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:08:23.791649 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:23.791649 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:23.791649 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:23.791649 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:23.791649 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:23.791649 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:23.792699 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:23.792699 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:23.792699 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:23.792699 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:23.792699 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:23.792699 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:23.792699 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:08:23.792699 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:08:23.792699 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:08:23.792699 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:08:23.792699 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:23.792699 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:23.792699 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:23.792699 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:23.792699 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:23.792699 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:23.793563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:23.793563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:23.793563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:23.793563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:23.793563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:23.793563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:23.793563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:23.793563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:23.793563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:23.793563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:23.793563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:08:23.793563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:23.793563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 12:08:23.793563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:23.797571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 489/985] 10.222.0.13 () {56 vars in 1105 bytes} [Wed Jun 29 12:08:23 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:23.798946 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db1a79-1bc5-4340-bb2b-49b437bd2777 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:23.900591 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db1a79-1bc5-4340-bb2b-49b437bd2777 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:23.935297 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada4883-0631-45e1-b474-432b516e3028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:23.935978 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada4883-0631-45e1-b474-432b516e3028 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:23.936259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada4883-0631-45e1-b474-432b516e3028 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:23.936530 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada4883-0631-45e1-b474-432b516e3028 None admin] PATH_INFO: `/v3/services` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:23.937240 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada4883-0631-45e1-b474-432b516e3028 None admin] RBAC: Adding query filter params (name=image) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:23.937549 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada4883-0631-45e1-b474-432b516e3028 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:23.938981 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada4883-0631-45e1-b474-432b516e3028 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:23.945135 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 497/986] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:23.951133 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c03b5f-7b40-4b1e-9877-7ed69e0cd871 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:23.981717 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:24.058411 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c03b5f-7b40-4b1e-9877-7ed69e0cd871 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:24.092454 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a4ad0-4fc0-4f08-8f7a-61d429903fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:24.093125 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a4ad0-4fc0-4f08-8f7a-61d429903fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:24.093408 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a4ad0-4fc0-4f08-8f7a-61d429903fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:24.093682 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a4ad0-4fc0-4f08-8f7a-61d429903fb9 None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:24.094384 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a4ad0-4fc0-4f08-8f7a-61d429903fb9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:24.094715 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a4ad0-4fc0-4f08-8f7a-61d429903fb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:24.096088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a4ad0-4fc0-4f08-8f7a-61d429903fb9 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:24.106731 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 490/987] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:23 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:24.466347 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5537d4-1d78-4ab8-9c11-f44c5b33fe75 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:24.466757 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5537d4-1d78-4ab8-9c11-f44c5b33fe75 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:24.466956 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5537d4-1d78-4ab8-9c11-f44c5b33fe75 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:24.468459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 498/988] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:24.473979 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28639e56-dcc7-411c-8b1b-b00eba82fc72 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:24.474276 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28639e56-dcc7-411c-8b1b-b00eba82fc72 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:24.474557 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28639e56-dcc7-411c-8b1b-b00eba82fc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:24.492028 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-28639e56-dcc7-411c-8b1b-b00eba82fc72 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:24.493536 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-28639e56-dcc7-411c-8b1b-b00eba82fc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:24.562719 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 491/989] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:24 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:24.585325 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5537d4-1d78-4ab8-9c11-f44c5b33fe75 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:24.630030 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:24.689348 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5537d4-1d78-4ab8-9c11-f44c5b33fe75 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:24.723592 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f26ce-8b85-4ab9-ac10-a45801b9d3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:24.724321 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f26ce-8b85-4ab9-ac10-a45801b9d3e0 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:24.724605 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f26ce-8b85-4ab9-ac10-a45801b9d3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:24.724878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f26ce-8b85-4ab9-ac10-a45801b9d3e0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:24.725529 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f26ce-8b85-4ab9-ac10-a45801b9d3e0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:24.728467 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f26ce-8b85-4ab9-ac10-a45801b9d3e0 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:24.741047 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-366f26ce-8b85-4ab9-ac10-a45801b9d3e0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 12:08:24.741047 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:24.741047 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:08:24.741047 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:08:24.741047 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:08:24.741047 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:08:24.741047 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:08:24.741047 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:24.741047 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 12:08:24.741047 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:24.741047 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:08:24.741047 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:24.741047 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:24.741047 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:24.741047 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:24.741047 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:24.741047 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:24.742123 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:24.742123 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:24.742123 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:24.742123 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:24.742123 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:24.742123 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:24.742123 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:08:24.742123 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:08:24.742123 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:08:24.742123 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:08:24.742123 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:24.742123 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:24.742123 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:24.742123 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:24.742123 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:24.742123 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:24.742995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:24.742995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:24.742995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:24.742995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:24.742995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:24.742995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:24.742995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:24.742995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:24.742995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:24.742995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:24.742995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:08:24.742995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:24.742995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 12:08:24.742995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:24.744394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 499/990] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:24.751244 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28639e56-dcc7-411c-8b1b-b00eba82fc72 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:24.774191 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:24.868434 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28639e56-dcc7-411c-8b1b-b00eba82fc72 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:24.904122 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ce3d8-d874-4614-80b4-6214b5333acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:24.904837 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ce3d8-d874-4614-80b4-6214b5333acb None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:24.905123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ce3d8-d874-4614-80b4-6214b5333acb None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:24.905398 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ce3d8-d874-4614-80b4-6214b5333acb None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:24.906097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ce3d8-d874-4614-80b4-6214b5333acb None admin] RBAC: Adding query filter params (name=compute) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:24.906402 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ce3d8-d874-4614-80b4-6214b5333acb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:24.907909 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ce3d8-d874-4614-80b4-6214b5333acb None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:24.913839 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 492/991] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Jun 29 12:08:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:24.919590 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f26ce-8b85-4ab9-ac10-a45801b9d3e0 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:25.024662 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f26ce-8b85-4ab9-ac10-a45801b9d3e0 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:25.027757 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:25.063198 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e638105-0fd3-4a67-96b4-675ae6680b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:25.063866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e638105-0fd3-4a67-96b4-675ae6680b55 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:25.064152 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e638105-0fd3-4a67-96b4-675ae6680b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:25.064431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e638105-0fd3-4a67-96b4-675ae6680b55 None admin] PATH_INFO: `/v3/services` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:25.065139 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e638105-0fd3-4a67-96b4-675ae6680b55 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:25.065447 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e638105-0fd3-4a67-96b4-675ae6680b55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:25.066861 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e638105-0fd3-4a67-96b4-675ae6680b55 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:25.072301 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 500/992] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Jun 29 12:08:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:25.077925 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ce3d8-d874-4614-80b4-6214b5333acb None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:25.168158 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:25.185962 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ce3d8-d874-4614-80b4-6214b5333acb None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:25.195942 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121328d-56f2-40d7-b023-58a9c4a8c75c None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:25.196279 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121328d-56f2-40d7-b023-58a9c4a8c75c None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:25.196502 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121328d-56f2-40d7-b023-58a9c4a8c75c None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:25.198135 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 501/993] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:25.204657 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9045f9e-4420-498e-81ee-dac79dd15e03 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:25.204980 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9045f9e-4420-498e-81ee-dac79dd15e03 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:25.205212 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9045f9e-4420-498e-81ee-dac79dd15e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:25.225403 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-b9045f9e-4420-498e-81ee-dac79dd15e03 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:25.226578 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-b9045f9e-4420-498e-81ee-dac79dd15e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:25.230387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d00265-3c4f-4e5e-b9da-01cea5713283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:25.231084 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d00265-3c4f-4e5e-b9da-01cea5713283 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:25.231370 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d00265-3c4f-4e5e-b9da-01cea5713283 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:25.231644 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d00265-3c4f-4e5e-b9da-01cea5713283 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:25.232438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d00265-3c4f-4e5e-b9da-01cea5713283 None admin] RBAC: Adding query filter params (interface=public, service_id=e70450a38b204eb99f037cd9c1da633f, region_id=RegionOne) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:25.232759 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d00265-3c4f-4e5e-b9da-01cea5713283 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:25.234129 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d00265-3c4f-4e5e-b9da-01cea5713283 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:25.244203 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 493/994] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Jun 29 12:08:25 2022] GET /identity/v3/endpoints?service_id=e70450a38b204eb99f037cd9c1da633f&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:25.245225 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d00265-3c4f-4e5e-b9da-01cea5713283 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:25.310799 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 502/995] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:25 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:08:25.334498 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9045f9e-4420-498e-81ee-dac79dd15e03 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:25.372200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d00265-3c4f-4e5e-b9da-01cea5713283 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:25.418576 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39bcd4-537a-4beb-84f9-90baaf10b11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:25.419926 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39bcd4-537a-4beb-84f9-90baaf10b11e None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:25.420441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39bcd4-537a-4beb-84f9-90baaf10b11e None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:25.420945 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39bcd4-537a-4beb-84f9-90baaf10b11e None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:25.421823 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c39bcd4-537a-4beb-84f9-90baaf10b11e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:25.423434 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c39bcd4-537a-4beb-84f9-90baaf10b11e None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:25.433974 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 494/996] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Jun 29 12:08:25 2022] GET /identity/v3/services => generated 1727 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:08:25.451475 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:25.457536 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9045f9e-4420-498e-81ee-dac79dd15e03 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:25.500829 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42bde7-85e9-45c9-80c8-ab93ced620d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:25.501649 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42bde7-85e9-45c9-80c8-ab93ced620d2 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:25.501931 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42bde7-85e9-45c9-80c8-ab93ced620d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:25.502206 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42bde7-85e9-45c9-80c8-ab93ced620d2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:25.503493 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42bde7-85e9-45c9-80c8-ab93ced620d2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:25.504926 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42bde7-85e9-45c9-80c8-ab93ced620d2 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:25.518927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-bd42bde7-85e9-45c9-80c8-ab93ced620d2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 12:08:25.518927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:25.518927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:08:25.518927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:08:25.518927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:08:25.518927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:08:25.518927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:08:25.518927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:25.518927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 12:08:25.518927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:25.518927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:08:25.518927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:25.518927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:25.518927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:25.518927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:25.518927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:25.518927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:25.520052 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:25.520052 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:25.520052 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:25.520052 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:25.520052 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:25.520052 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:25.520052 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:08:25.520052 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:08:25.520052 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:08:25.520052 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:08:25.520052 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:25.520052 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:25.520052 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:25.520052 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:25.520052 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:25.520052 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:25.520943 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:25.520943 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:25.520943 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:25.520943 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:25.520943 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:25.520943 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:25.520943 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:25.520943 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:25.520943 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:25.520943 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:25.520943 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:08:25.520943 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:25.520943 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 12:08:25.520943 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:25.520943 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 503/997] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Jun 29 12:08:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:25.529490 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39bcd4-537a-4beb-84f9-90baaf10b11e None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:25.554245 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:25.687513 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39bcd4-537a-4beb-84f9-90baaf10b11e None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:25.745907 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e00f2-2be6-4e0e-bdba-e3ab1db638d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:25.746962 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e00f2-2be6-4e0e-bdba-e3ab1db638d2 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:25.747402 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e00f2-2be6-4e0e-bdba-e3ab1db638d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:25.747817 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e00f2-2be6-4e0e-bdba-e3ab1db638d2 None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:25.748950 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e00f2-2be6-4e0e-bdba-e3ab1db638d2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:25.749414 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e00f2-2be6-4e0e-bdba-e3ab1db638d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:25.751642 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e00f2-2be6-4e0e-bdba-e3ab1db638d2 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:25.760313 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 495/998] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Jun 29 12:08:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:25.768327 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42bde7-85e9-45c9-80c8-ab93ced620d2 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:25.917622 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42bde7-85e9-45c9-80c8-ab93ced620d2 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:25.967382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc1879-6586-4a5e-a943-4044f7f77ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:25.968287 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc1879-6586-4a5e-a943-4044f7f77ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:25.968719 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc1879-6586-4a5e-a943-4044f7f77ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:25.969132 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc1879-6586-4a5e-a943-4044f7f77ae3 None admin] PATH_INFO: `/v3/services` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:25.970245 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc1879-6586-4a5e-a943-4044f7f77ae3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:25.970734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc1879-6586-4a5e-a943-4044f7f77ae3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:25.973491 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc1879-6586-4a5e-a943-4044f7f77ae3 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:25.985677 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 504/999] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Jun 29 12:08:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:25.988386 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e00f2-2be6-4e0e-bdba-e3ab1db638d2 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:26.103924 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:26.137647 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efe0a9-da3f-4f38-9570-d849e89a1b71 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:26.138079 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efe0a9-da3f-4f38-9570-d849e89a1b71 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:26.138496 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efe0a9-da3f-4f38-9570-d849e89a1b71 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:26.139272 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e00f2-2be6-4e0e-bdba-e3ab1db638d2 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:26.140939 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 505/1000] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:26.145894 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927c11f-8c5f-437d-b8cb-48f8f190d179 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:26.146185 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927c11f-8c5f-437d-b8cb-48f8f190d179 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:26.146465 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927c11f-8c5f-437d-b8cb-48f8f190d179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:26.164909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-7927c11f-8c5f-437d-b8cb-48f8f190d179 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:26.166622 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-7927c11f-8c5f-437d-b8cb-48f8f190d179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:26.185138 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b34a5-d9f4-4e9d-abf3-25599768ca04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:26.186160 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b34a5-d9f4-4e9d-abf3-25599768ca04 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:26.186660 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b34a5-d9f4-4e9d-abf3-25599768ca04 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:26.187162 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b34a5-d9f4-4e9d-abf3-25599768ca04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:26.188154 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b34a5-d9f4-4e9d-abf3-25599768ca04 None admin] RBAC: Adding query filter params (interface=admin, service_id=a0b39eb9539646b6b41eeec8d2a374ca, region_id=RegionOne) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:26.188664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b34a5-d9f4-4e9d-abf3-25599768ca04 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:26.190243 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b34a5-d9f4-4e9d-abf3-25599768ca04 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:26.195822 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 496/1001] 10.222.0.13 () {56 vars in 1249 bytes} [Wed Jun 29 12:08:25 2022] GET /identity/v3/endpoints?service_id=a0b39eb9539646b6b41eeec8d2a374ca&interface=admin®ion_id=RegionOne => generated 193 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:26.200348 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:26.202466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b34a5-d9f4-4e9d-abf3-25599768ca04 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:26.270784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 506/1002] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:26 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:08:26.293389 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927c11f-8c5f-437d-b8cb-48f8f190d179 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:26.325003 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b34a5-d9f4-4e9d-abf3-25599768ca04 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:26.375586 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf78ffb-a809-4b72-99f4-4a383b6f6e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:26.376666 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf78ffb-a809-4b72-99f4-4a383b6f6e02 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:26.377134 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf78ffb-a809-4b72-99f4-4a383b6f6e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:26.377613 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf78ffb-a809-4b72-99f4-4a383b6f6e02 None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:26.378873 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf78ffb-a809-4b72-99f4-4a383b6f6e02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:26.381233 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf78ffb-a809-4b72-99f4-4a383b6f6e02 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:26.391796 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 497/1003] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Jun 29 12:08:26 2022] GET /identity/v3/services => generated 1727 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:08:26.392768 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927c11f-8c5f-437d-b8cb-48f8f190d179 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:26.444844 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20725b-1001-4e7b-8dc4-0a122b4be9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:26.445728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20725b-1001-4e7b-8dc4-0a122b4be9f0 None admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:26.446140 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20725b-1001-4e7b-8dc4-0a122b4be9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:26.446556 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20725b-1001-4e7b-8dc4-0a122b4be9f0 None admin] PATH_INFO: `/v3/services` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:26.447513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20725b-1001-4e7b-8dc4-0a122b4be9f0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:26.449103 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20725b-1001-4e7b-8dc4-0a122b4be9f0 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:26.467017 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 507/1004] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Jun 29 12:08:26 2022] POST /identity/v3/services => generated 242 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:08:27.522125 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93b249-4ca4-4bc7-bae8-1f79727fb0c2 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:27.522664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93b249-4ca4-4bc7-bae8-1f79727fb0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:27.523137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93b249-4ca4-4bc7-bae8-1f79727fb0c2 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:27.525634 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 498/1005] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:27.531223 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390aa2b-0610-4a31-9b62-88923300276c None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:27.531912 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390aa2b-0610-4a31-9b62-88923300276c None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:27.531912 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390aa2b-0610-4a31-9b62-88923300276c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:27.549702 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-0390aa2b-0610-4a31-9b62-88923300276c None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:27.551102 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-0390aa2b-0610-4a31-9b62-88923300276c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:27.564475 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:27.636876 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 508/1006] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:27 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:08:27.660201 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93b249-4ca4-4bc7-bae8-1f79727fb0c2 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:27.664426 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:27.774436 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93b249-4ca4-4bc7-bae8-1f79727fb0c2 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:27.808664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da363c3-9574-4048-80b5-b0a9928909df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:27.809460 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da363c3-9574-4048-80b5-b0a9928909df None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:27.809742 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da363c3-9574-4048-80b5-b0a9928909df None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:27.810015 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da363c3-9574-4048-80b5-b0a9928909df None admin] PATH_INFO: `/v3/services/compute` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:27.810695 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da363c3-9574-4048-80b5-b0a9928909df None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:27.812064 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da363c3-9574-4048-80b5-b0a9928909df None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:27.825054 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-0da363c3-9574-4048-80b5-b0a9928909df None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 12:08:27.825054 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:27.825054 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:08:27.825054 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:08:27.825054 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:08:27.825054 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:08:27.825054 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:08:27.825054 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:27.825054 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 12:08:27.825054 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:27.825054 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:08:27.825054 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:27.825054 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:27.825054 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:27.825054 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:27.825054 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:27.825054 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:27.826063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:27.826063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:27.826063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:27.826063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:27.826063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:27.826063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:27.826063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:08:27.826063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:08:27.826063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:08:27.826063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:08:27.826063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:27.826063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:27.826063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:27.826063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:27.826063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:27.826063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:27.827571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:27.827571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:27.827571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:27.827571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:27.827571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:27.827571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:27.827571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:27.827571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:27.827571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:27.827571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:27.827571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:08:27.827571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:27.827571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 12:08:27.827571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:27.828655 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 499/1007] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:27.832446 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390aa2b-0610-4a31-9b62-88923300276c None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:27.931381 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390aa2b-0610-4a31-9b62-88923300276c None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:27.966652 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fe015-812f-4c87-87a5-77b0911473ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:27.967333 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fe015-812f-4c87-87a5-77b0911473ce None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:27.967615 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fe015-812f-4c87-87a5-77b0911473ce None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:27.967890 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fe015-812f-4c87-87a5-77b0911473ce None admin] PATH_INFO: `/v3/services` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:27.968600 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2fe015-812f-4c87-87a5-77b0911473ce None admin] RBAC: Adding query filter params (name=compute) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:27.968904 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2fe015-812f-4c87-87a5-77b0911473ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:27.970281 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2fe015-812f-4c87-87a5-77b0911473ce None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:27.980071 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 509/1008] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Jun 29 12:08:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:27.981651 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da363c3-9574-4048-80b5-b0a9928909df None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:28.052597 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:28.090434 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da363c3-9574-4048-80b5-b0a9928909df None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:28.124925 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda50fc0-5439-42f4-8789-ef18d402528f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:28.125595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda50fc0-5439-42f4-8789-ef18d402528f None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:28.125880 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda50fc0-5439-42f4-8789-ef18d402528f None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:28.126154 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda50fc0-5439-42f4-8789-ef18d402528f None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:28.126894 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda50fc0-5439-42f4-8789-ef18d402528f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:28.127201 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda50fc0-5439-42f4-8789-ef18d402528f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:28.129195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda50fc0-5439-42f4-8789-ef18d402528f None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:28.139197 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 500/1009] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Jun 29 12:08:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:28.140080 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fe015-812f-4c87-87a5-77b0911473ce None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:28.149174 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:28.243599 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fe015-812f-4c87-87a5-77b0911473ce None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:28.279861 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a46a5a0-bbfd-4a07-9b7d-d33806a8cdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:28.280522 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46a5a0-bbfd-4a07-9b7d-d33806a8cdcd None admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:28.280804 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46a5a0-bbfd-4a07-9b7d-d33806a8cdcd None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:28.281079 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46a5a0-bbfd-4a07-9b7d-d33806a8cdcd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:28.281822 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a46a5a0-bbfd-4a07-9b7d-d33806a8cdcd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:28.283238 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a46a5a0-bbfd-4a07-9b7d-d33806a8cdcd None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:28.310794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 510/1010] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Jun 29 12:08:28 2022] POST /identity/v3/endpoints => generated 334 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:08:28.505885 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88d879-4e07-41a8-bc05-135dc6857c0b None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:28.506225 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88d879-4e07-41a8-bc05-135dc6857c0b None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:28.506444 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88d879-4e07-41a8-bc05-135dc6857c0b None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:28.508113 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 501/1011] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:28.515989 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344475f-4ed0-4d9f-a0b4-c8ebfa926bda None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:28.516429 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344475f-4ed0-4d9f-a0b4-c8ebfa926bda None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:28.516860 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344475f-4ed0-4d9f-a0b4-c8ebfa926bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:28.543459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-e344475f-4ed0-4d9f-a0b4-c8ebfa926bda None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:28.545184 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-e344475f-4ed0-4d9f-a0b4-c8ebfa926bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:28.577086 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceceebb-2882-425f-9f7e-5a8f37b57dda None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:28.577768 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceceebb-2882-425f-9f7e-5a8f37b57dda None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:28.577768 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceceebb-2882-425f-9f7e-5a8f37b57dda None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:28.579206 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 502/1012] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:08:28.585236 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abb789-0562-4db8-ab58-9fb94c3da085 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:28.585236 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abb789-0562-4db8-ab58-9fb94c3da085 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:28.585528 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abb789-0562-4db8-ab58-9fb94c3da085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:28.604777 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-52abb789-0562-4db8-ab58-9fb94c3da085 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:28.605965 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-52abb789-0562-4db8-ab58-9fb94c3da085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:28.625828 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:28.649276 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 511/1013] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:28 2022] POST /identity/v3/auth/tokens => generated 1812 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:28.678970 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344475f-4ed0-4d9f-a0b4-c8ebfa926bda None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:28.700300 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 503/1014] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:28 2022] POST /identity/v3/auth/tokens => generated 1812 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:08:28.726504 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abb789-0562-4db8-ab58-9fb94c3da085 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:28.795252 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:28.812303 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344475f-4ed0-4d9f-a0b4-c8ebfa926bda None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:28.843811 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abb789-0562-4db8-ab58-9fb94c3da085 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:28.857811 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eff0b6-5f49-4b0a-8324-4ce07e73652c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:28.858921 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eff0b6-5f49-4b0a-8324-4ce07e73652c None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:28.859306 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eff0b6-5f49-4b0a-8324-4ce07e73652c None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:28.859721 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eff0b6-5f49-4b0a-8324-4ce07e73652c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:28.860835 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eff0b6-5f49-4b0a-8324-4ce07e73652c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:28.862738 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eff0b6-5f49-4b0a-8324-4ce07e73652c None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:28.878516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-92eff0b6-5f49-4b0a-8324-4ce07e73652c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 12:08:28.878516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:28.878516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:08:28.878516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:08:28.878516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:08:28.878516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:08:28.878516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:08:28.878516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:28.878516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 12:08:28.878516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:28.878516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:08:28.878516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:28.878516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:28.878516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:28.878516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:28.878516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:28.878516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:28.880929 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:28.880929 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:28.880929 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:28.880929 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:28.880929 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:28.880929 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:28.880929 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:08:28.880929 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:08:28.880929 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:08:28.880929 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:08:28.880929 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:28.880929 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:28.880929 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:28.880929 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:28.880929 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:28.880929 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:28.883000 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:28.883000 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:28.883000 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:28.883000 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:28.883000 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:28.883000 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:28.883000 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:28.883000 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:28.883000 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:28.883000 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:28.883000 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:08:28.883000 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:28.883000 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 12:08:28.883000 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:28.886980 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 512/1015] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Jun 29 12:08:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:28.888983 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eff0b6-5f49-4b0a-8324-4ce07e73652c None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:28.891234 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2e710-1c55-4eef-9bda-67c9bd2b48a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:28.892142 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2e710-1c55-4eef-9bda-67c9bd2b48a2 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:28.892438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2e710-1c55-4eef-9bda-67c9bd2b48a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:28.892768 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2e710-1c55-4eef-9bda-67c9bd2b48a2 None admin] PATH_INFO: `/v3/services/image` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:28.894060 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2e710-1c55-4eef-9bda-67c9bd2b48a2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:28.895471 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2e710-1c55-4eef-9bda-67c9bd2b48a2 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:28.908220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-15b2e710-1c55-4eef-9bda-67c9bd2b48a2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 12:08:28.908220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:28.908220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:08:28.908220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:08:28.908220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:08:28.908220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:08:28.908220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:08:28.908220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:28.908220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 12:08:28.908220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:28.908220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:08:28.908220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:28.908220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:28.908220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:28.908220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:28.908220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:28.908220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:28.909543 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:28.909543 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:28.909543 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:28.909543 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:28.909543 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:28.909543 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:28.909543 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:08:28.909543 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:08:28.909543 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:08:28.909543 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:08:28.909543 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:28.909543 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:28.909543 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:28.909543 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:28.909543 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:28.909543 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:28.911540 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:28.911540 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:28.911540 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:28.911540 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:28.911540 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:28.911540 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:28.911540 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:28.911540 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:28.911540 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:28.911540 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:28.911540 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:08:28.911540 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:28.911540 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 12:08:28.911540 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:28.915086 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 504/1016] 10.222.0.13 () {56 vars in 1105 bytes} [Wed Jun 29 12:08:28 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:28.916236 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2e710-1c55-4eef-9bda-67c9bd2b48a2 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:28.967174 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:29.047999 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eff0b6-5f49-4b0a-8324-4ce07e73652c None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:29.057962 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2e710-1c55-4eef-9bda-67c9bd2b48a2 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:29.085620 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260812a3-3f7f-49e9-84ca-4f09e4fb6cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:29.086292 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260812a3-3f7f-49e9-84ca-4f09e4fb6cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:29.086577 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260812a3-3f7f-49e9-84ca-4f09e4fb6cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:29.086881 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260812a3-3f7f-49e9-84ca-4f09e4fb6cc4 None admin] PATH_INFO: `/v3/services` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:29.087688 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260812a3-3f7f-49e9-84ca-4f09e4fb6cc4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:29.087996 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260812a3-3f7f-49e9-84ca-4f09e4fb6cc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:29.089472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260812a3-3f7f-49e9-84ca-4f09e4fb6cc4 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:29.093320 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:29.102199 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 513/1017] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Jun 29 12:08:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:29.103403 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260812a3-3f7f-49e9-84ca-4f09e4fb6cc4 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:29.106749 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f42b8-35b5-423c-a69e-71a86cd144ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:29.107613 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f42b8-35b5-423c-a69e-71a86cd144ae None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:29.108032 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f42b8-35b5-423c-a69e-71a86cd144ae None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:29.108449 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f42b8-35b5-423c-a69e-71a86cd144ae None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:29.109307 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f42b8-35b5-423c-a69e-71a86cd144ae None admin] RBAC: Adding query filter params (name=image) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:29.109749 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f42b8-35b5-423c-a69e-71a86cd144ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:29.111327 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f42b8-35b5-423c-a69e-71a86cd144ae None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:29.117499 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 505/1018] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:29.123152 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f42b8-35b5-423c-a69e-71a86cd144ae None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:29.241413 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260812a3-3f7f-49e9-84ca-4f09e4fb6cc4 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:29.269303 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:29.275940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f42b8-35b5-423c-a69e-71a86cd144ae None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:29.298948 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a5344-1173-4d7f-88a2-8a69aaf8db49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:29.301035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a5344-1173-4d7f-88a2-8a69aaf8db49 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:29.301758 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a5344-1173-4d7f-88a2-8a69aaf8db49 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:29.302513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a5344-1173-4d7f-88a2-8a69aaf8db49 None admin] PATH_INFO: `/v3/services` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:29.303950 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a5344-1173-4d7f-88a2-8a69aaf8db49 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:29.304719 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a5344-1173-4d7f-88a2-8a69aaf8db49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:29.307362 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a5344-1173-4d7f-88a2-8a69aaf8db49 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:29.317035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 514/1019] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Jun 29 12:08:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:29.322868 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a5344-1173-4d7f-88a2-8a69aaf8db49 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:29.331618 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13c4ba-b49b-456e-a38e-226e0a3c0942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:29.332665 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13c4ba-b49b-456e-a38e-226e0a3c0942 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:29.333131 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13c4ba-b49b-456e-a38e-226e0a3c0942 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:29.333584 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13c4ba-b49b-456e-a38e-226e0a3c0942 None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:29.334838 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13c4ba-b49b-456e-a38e-226e0a3c0942 None admin] RBAC: Adding query filter params (type=image) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:29.335364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13c4ba-b49b-456e-a38e-226e0a3c0942 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:29.337885 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13c4ba-b49b-456e-a38e-226e0a3c0942 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:29.351238 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 506/1020] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:29.356453 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13c4ba-b49b-456e-a38e-226e0a3c0942 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:29.430654 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:29.473787 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a5344-1173-4d7f-88a2-8a69aaf8db49 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:29.483050 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13c4ba-b49b-456e-a38e-226e0a3c0942 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:29.516203 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576173f-5984-4e70-905a-bfbc9e4e7b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:29.516878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576173f-5984-4e70-905a-bfbc9e4e7b92 None admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:29.517164 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576173f-5984-4e70-905a-bfbc9e4e7b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:29.517443 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576173f-5984-4e70-905a-bfbc9e4e7b92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:29.518216 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576173f-5984-4e70-905a-bfbc9e4e7b92 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:29.519652 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576173f-5984-4e70-905a-bfbc9e4e7b92 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:29.525012 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b47784-f29c-419a-91fb-b553dc91e7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:29.525773 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b47784-f29c-419a-91fb-b553dc91e7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:29.526039 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b47784-f29c-419a-91fb-b553dc91e7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:29.526437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b47784-f29c-419a-91fb-b553dc91e7f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:29.527025 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b47784-f29c-419a-91fb-b553dc91e7f6 None admin] RBAC: Adding query filter params (interface=public, service_id=0419afbaa74340279bcb15c7f9563903, region_id=RegionOne) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:29.527334 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b47784-f29c-419a-91fb-b553dc91e7f6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:29.528707 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b47784-f29c-419a-91fb-b553dc91e7f6 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:29.534388 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 507/1021] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Jun 29 12:08:29 2022] GET /identity/v3/endpoints?service_id=0419afbaa74340279bcb15c7f9563903&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:29.540527 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b47784-f29c-419a-91fb-b553dc91e7f6 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:29.545421 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 515/1022] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Jun 29 12:08:29 2022] POST /identity/v3/endpoints => generated 325 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:08:29.713190 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b47784-f29c-419a-91fb-b553dc91e7f6 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:29.744131 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:29.771999 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb721b31-9579-44f3-8463-1153e565414f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:29.772776 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb721b31-9579-44f3-8463-1153e565414f None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:29.773127 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb721b31-9579-44f3-8463-1153e565414f None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:29.773467 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb721b31-9579-44f3-8463-1153e565414f None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:29.774152 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb721b31-9579-44f3-8463-1153e565414f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:29.775571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb721b31-9579-44f3-8463-1153e565414f None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:29.784535 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 508/1023] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Jun 29 12:08:29 2022] GET /identity/v3/services => generated 1957 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:08:30.613915 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cfbca-3a14-4b73-96b9-2c5a40564696 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:30.614468 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cfbca-3a14-4b73-96b9-2c5a40564696 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:30.614921 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cfbca-3a14-4b73-96b9-2c5a40564696 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:30.617639 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 516/1024] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:30.623030 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41daa0e8-7855-4d2e-b652-fb6d2e6a4636 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:30.623320 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41daa0e8-7855-4d2e-b652-fb6d2e6a4636 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:30.623600 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41daa0e8-7855-4d2e-b652-fb6d2e6a4636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:30.641566 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-41daa0e8-7855-4d2e-b652-fb6d2e6a4636 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:30.643569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-41daa0e8-7855-4d2e-b652-fb6d2e6a4636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:30.728557 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 509/1025] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:08:30.751602 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6cfbca-3a14-4b73-96b9-2c5a40564696 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:30.796871 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:30.859978 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6cfbca-3a14-4b73-96b9-2c5a40564696 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:30.895778 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90084df9-9938-4ce0-8d88-92f09d53f639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:30.896526 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90084df9-9938-4ce0-8d88-92f09d53f639 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:30.896810 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90084df9-9938-4ce0-8d88-92f09d53f639 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:30.897086 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90084df9-9938-4ce0-8d88-92f09d53f639 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:30.908566 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90084df9-9938-4ce0-8d88-92f09d53f639 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:30.917198 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-90084df9-9938-4ce0-8d88-92f09d53f639 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 12:08:30.917198 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:30.917198 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:30.917198 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:30.917198 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:30.917198 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:30.917198 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:30.917198 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:30.917198 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:30.917198 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:30.917198 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:30.917198 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:30.917198 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:30.917198 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:30.917198 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:30.917198 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:30.918167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:30.918167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:30.918167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:30.918167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:30.918167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:30.918167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:30.918167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:30.918167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:30.918167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:30.918167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:30.918167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:30.918167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:30.918167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:30.918167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:30.918167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:30.918167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:30.919430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:30.919430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:30.919430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:30.919430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:30.919430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:30.919430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:30.919430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:30.919430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:30.919430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:30.919430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:30.919430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 12:08:30.919430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:30.922715 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 517/1026] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Jun 29 12:08:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:30.925038 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41daa0e8-7855-4d2e-b652-fb6d2e6a4636 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:31.036083 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41daa0e8-7855-4d2e-b652-fb6d2e6a4636 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:31.045493 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:31.072576 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad7b98-0fd3-4f23-aaeb-bcc26690aa78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:31.073256 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad7b98-0fd3-4f23-aaeb-bcc26690aa78 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:31.073541 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad7b98-0fd3-4f23-aaeb-bcc26690aa78 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:31.073820 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad7b98-0fd3-4f23-aaeb-bcc26690aa78 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:31.074568 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad7b98-0fd3-4f23-aaeb-bcc26690aa78 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:31.074911 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad7b98-0fd3-4f23-aaeb-bcc26690aa78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:31.076281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad7b98-0fd3-4f23-aaeb-bcc26690aa78 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:31.084861 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 510/1027] 10.222.0.13 () {56 vars in 1115 bytes} [Wed Jun 29 12:08:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:31.090279 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90084df9-9938-4ce0-8d88-92f09d53f639 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:31.189386 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:31.193100 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90084df9-9938-4ce0-8d88-92f09d53f639 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:31.232874 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e2f28-0dd5-4d29-a767-232564892a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:31.234183 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e2f28-0dd5-4d29-a767-232564892a88 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:31.234477 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e2f28-0dd5-4d29-a767-232564892a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:31.234791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e2f28-0dd5-4d29-a767-232564892a88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:31.247721 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e2f28-0dd5-4d29-a767-232564892a88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:31.249246 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e2f28-0dd5-4d29-a767-232564892a88 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:31.267311 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-c66e2f28-0dd5-4d29-a767-232564892a88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:31.267311 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:31.267311 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:31.267311 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:31.267311 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:31.267311 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:31.267311 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:31.267311 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:31.267311 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:31.267311 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:31.267311 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:31.267311 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:31.267311 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:31.267311 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:31.267311 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:31.268276 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:31.268276 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:31.268276 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:31.268276 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:31.268276 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:31.268276 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:31.268276 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:31.268276 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:31.268276 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:31.268276 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:31.268276 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:31.268276 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:31.268276 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:31.268276 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:31.268276 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:31.268276 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:31.268276 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:31.269389 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:31.269389 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:31.269389 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:31.269389 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:31.270974 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 518/1028] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:31.275171 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad7b98-0fd3-4f23-aaeb-bcc26690aa78 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:31.379241 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad7b98-0fd3-4f23-aaeb-bcc26690aa78 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:31.414382 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776ea4d-a256-4d4b-8099-b771ee6b36d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:31.415094 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776ea4d-a256-4d4b-8099-b771ee6b36d1 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:31.415383 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776ea4d-a256-4d4b-8099-b771ee6b36d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:31.415710 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776ea4d-a256-4d4b-8099-b771ee6b36d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:31.416497 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776ea4d-a256-4d4b-8099-b771ee6b36d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:31.416753 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776ea4d-a256-4d4b-8099-b771ee6b36d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:31.418128 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776ea4d-a256-4d4b-8099-b771ee6b36d1 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:31.444061 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 511/1029] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:31.445344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e2f28-0dd5-4d29-a767-232564892a88 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:31.550786 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e2f28-0dd5-4d29-a767-232564892a88 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:31.586491 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f66f5-2e2d-4372-b8d3-b19ac2425790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:31.587600 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f66f5-2e2d-4372-b8d3-b19ac2425790 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:31.588095 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f66f5-2e2d-4372-b8d3-b19ac2425790 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:31.588418 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f66f5-2e2d-4372-b8d3-b19ac2425790 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:31.597390 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f66f5-2e2d-4372-b8d3-b19ac2425790 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:31.598881 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f66f5-2e2d-4372-b8d3-b19ac2425790 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:31.614720 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-7d2f66f5-2e2d-4372-b8d3-b19ac2425790 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:08:31.614720 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:31.614720 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:31.614720 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:31.614720 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:31.614720 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:31.614720 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:31.614720 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:31.614720 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:31.614720 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:31.614720 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:31.614720 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:31.614720 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:08:31.614720 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:08:31.614720 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:08:31.614720 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:08:31.616747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:31.616747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:31.616747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:31.616747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:31.616747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:31.616747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:31.616747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:31.616747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:31.616747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:31.616747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:31.616747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:31.616747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:31.616747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:31.616747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:31.616747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:31.616747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:31.616747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:31.616747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:31.617855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:31.617855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:31.617855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:08:31.617855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:08:31.617855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:08:31.617855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:08:31.617855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:08:31.617855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:08:31.617855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:08:31.617855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:31.622488 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 519/1030] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Jun 29 12:08:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:31.624181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776ea4d-a256-4d4b-8099-b771ee6b36d1 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:31.656999 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:31.739081 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776ea4d-a256-4d4b-8099-b771ee6b36d1 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:31.775602 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41874c19-778b-463a-b6d4-e033ffe5178c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:31.776286 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41874c19-778b-463a-b6d4-e033ffe5178c None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:31.776563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41874c19-778b-463a-b6d4-e033ffe5178c None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:31.776846 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41874c19-778b-463a-b6d4-e033ffe5178c None admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:31.777687 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41874c19-778b-463a-b6d4-e033ffe5178c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:31.777999 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41874c19-778b-463a-b6d4-e033ffe5178c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:31.779465 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41874c19-778b-463a-b6d4-e033ffe5178c None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:31.802181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 512/1031] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Jun 29 12:08:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:31.803622 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f66f5-2e2d-4372-b8d3-b19ac2425790 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:31.819290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:31.901801 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c6675-b269-49e1-a2e4-5110f44186c7 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:31.902148 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c6675-b269-49e1-a2e4-5110f44186c7 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:31.902359 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c6675-b269-49e1-a2e4-5110f44186c7 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:31.903904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 513/1032] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:08:31.909186 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb0af1-9d77-43f5-9eb8-149f2d3696ba None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:31.909468 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb0af1-9d77-43f5-9eb8-149f2d3696ba None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:31.909743 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb0af1-9d77-43f5-9eb8-149f2d3696ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:31.913757 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f66f5-2e2d-4372-b8d3-b19ac2425790 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:31.927620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-15eb0af1-9d77-43f5-9eb8-149f2d3696ba None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:31.928826 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-15eb0af1-9d77-43f5-9eb8-149f2d3696ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:31.954497 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e85c1-57a7-44e3-884a-f2d94c9f8a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:31.955225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e85c1-57a7-44e3-884a-f2d94c9f8a2c None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:31.956020 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e85c1-57a7-44e3-884a-f2d94c9f8a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:31.956298 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e85c1-57a7-44e3-884a-f2d94c9f8a2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:32.003072 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 514/1033] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:08:32.027369 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb0af1-9d77-43f5-9eb8-149f2d3696ba None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:32.033258 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e85c1-57a7-44e3-884a-f2d94c9f8a2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:32.035125 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e85c1-57a7-44e3-884a-f2d94c9f8a2c None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:32.045428 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:32.052802 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:32.129980 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb0af1-9d77-43f5-9eb8-149f2d3696ba None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:32.148101 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 520/1034] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:31 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:08:32.153527 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e85c1-57a7-44e3-884a-f2d94c9f8a2c None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:32.171133 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d24c5-6563-4822-aff7-83a802445c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:32.171935 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d24c5-6563-4822-aff7-83a802445c96 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:32.172217 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d24c5-6563-4822-aff7-83a802445c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:32.172491 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d24c5-6563-4822-aff7-83a802445c96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:32.173660 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0d24c5-6563-4822-aff7-83a802445c96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:32.175169 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0d24c5-6563-4822-aff7-83a802445c96 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:32.176964 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 515/1035] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:32.177991 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783c004-afb1-44d0-8154-1c88f6e16619 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:32.178279 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783c004-afb1-44d0-8154-1c88f6e16619 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:32.178554 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783c004-afb1-44d0-8154-1c88f6e16619 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:32.179809 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 516/1036] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:32.183458 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783c004-afb1-44d0-8154-1c88f6e16619 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:32.259129 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e85c1-57a7-44e3-884a-f2d94c9f8a2c None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:32.269777 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:32.272855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:32.287129 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783c004-afb1-44d0-8154-1c88f6e16619 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:32.294865 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688d452-4173-47f2-bf4e-e8400e5d6b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:32.295655 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688d452-4173-47f2-bf4e-e8400e5d6b21 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:32.295996 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688d452-4173-47f2-bf4e-e8400e5d6b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:32.296275 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688d452-4173-47f2-bf4e-e8400e5d6b21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:32.306724 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688d452-4173-47f2-bf4e-e8400e5d6b21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:32.308186 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688d452-4173-47f2-bf4e-e8400e5d6b21 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:32.321768 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadf78c-f74d-46fc-9fac-039a671a6c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:32.322438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadf78c-f74d-46fc-9fac-039a671a6c8f None admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:32.322752 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadf78c-f74d-46fc-9fac-039a671a6c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:32.323033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadf78c-f74d-46fc-9fac-039a671a6c8f None admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:32.323740 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadf78c-f74d-46fc-9fac-039a671a6c8f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:32.325170 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadf78c-f74d-46fc-9fac-039a671a6c8f None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:32.325897 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-c688d452-4173-47f2-bf4e-e8400e5d6b21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:32.325897 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:32.325897 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:32.325897 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:32.325897 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:32.325897 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:32.325897 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:32.325897 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:32.325897 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:32.325897 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:32.325897 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:32.325897 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:32.325897 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:32.325897 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:32.325897 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:32.327038 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:32.327038 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:32.327038 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:32.327038 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:32.327038 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:32.327038 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:32.327038 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:32.327038 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:32.327038 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:32.327038 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:32.327038 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:32.327038 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:32.327038 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:32.327038 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:32.327038 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:32.327038 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:32.327038 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:32.327973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:32.327973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:32.327973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:32.327973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:32.327973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 521/1037] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:32.328665 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5ffc9-6aad-44aa-bfc8-e11dc34eb98b None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:32.328764 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5ffc9-6aad-44aa-bfc8-e11dc34eb98b None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:32.329019 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5ffc9-6aad-44aa-bfc8-e11dc34eb98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:32.345797 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-aca5ffc9-6aad-44aa-bfc8-e11dc34eb98b None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:32.347188 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-aca5ffc9-6aad-44aa-bfc8-e11dc34eb98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:32.354665 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 517/1038] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Jun 29 12:08:32 2022] POST /identity/v3/projects => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:08:32.355517 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadf78c-f74d-46fc-9fac-039a671a6c8f None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:32.428513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 522/1039] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:32.452366 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5ffc9-6aad-44aa-bfc8-e11dc34eb98b None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:32.489591 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadf78c-f74d-46fc-9fac-039a671a6c8f None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:32.533554 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbff47-a41f-45e0-b77a-93d2977804ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:32.536063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbff47-a41f-45e0-b77a-93d2977804ac None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:32.536063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbff47-a41f-45e0-b77a-93d2977804ac None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:32.536063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbff47-a41f-45e0-b77a-93d2977804ac None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:32.536063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbff47-a41f-45e0-b77a-93d2977804ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:32.536063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbff47-a41f-45e0-b77a-93d2977804ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:32.537431 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbff47-a41f-45e0-b77a-93d2977804ac None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:32.544941 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:32.555402 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 518/1040] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:32.557293 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbff47-a41f-45e0-b77a-93d2977804ac None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:32.558385 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:32.567238 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5ffc9-6aad-44aa-bfc8-e11dc34eb98b None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:32.603704 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdec19-ae00-4296-933b-a5126b5ee30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:32.604501 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdec19-ae00-4296-933b-a5126b5ee30d None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:32.604785 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdec19-ae00-4296-933b-a5126b5ee30d None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:32.605056 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdec19-ae00-4296-933b-a5126b5ee30d None admin] PATH_INFO: `/v3/services/image` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:32.605716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcdec19-ae00-4296-933b-a5126b5ee30d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:32.607146 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcdec19-ae00-4296-933b-a5126b5ee30d None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:32.620057 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-5bcdec19-ae00-4296-933b-a5126b5ee30d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 12:08:32.620057 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:32.620057 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:08:32.620057 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:08:32.620057 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:08:32.620057 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:08:32.620057 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:08:32.620057 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:32.620057 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 12:08:32.620057 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:32.620057 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:08:32.620057 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:32.620057 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:32.620057 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:32.620057 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:32.620057 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:32.620057 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:32.621638 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:32.621638 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:32.621638 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:32.621638 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:32.621638 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:32.621638 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:32.621638 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:08:32.621638 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:08:32.621638 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:08:32.621638 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:08:32.621638 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:32.621638 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:32.621638 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:32.621638 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:32.621638 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:32.621638 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:32.622511 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:32.622511 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:32.622511 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:32.622511 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:32.622511 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:32.622511 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:32.622511 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:32.622511 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:32.622511 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:32.622511 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:32.622511 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:08:32.622511 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:32.622511 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 12:08:32.622511 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:32.622511 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 523/1041] 10.222.0.13 () {56 vars in 1105 bytes} [Wed Jun 29 12:08:32 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:32.628075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdec19-ae00-4296-933b-a5126b5ee30d None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:32.676266 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbff47-a41f-45e0-b77a-93d2977804ac None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:32.712119 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0592d6-098d-4c7c-961e-b40de8c569a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:32.712927 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0592d6-098d-4c7c-961e-b40de8c569a6 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:32.713215 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0592d6-098d-4c7c-961e-b40de8c569a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:32.713494 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0592d6-098d-4c7c-961e-b40de8c569a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:32.721359 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0592d6-098d-4c7c-961e-b40de8c569a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:32.724982 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0592d6-098d-4c7c-961e-b40de8c569a6 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:32.738813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-be0592d6-098d-4c7c-961e-b40de8c569a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:32.738813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:32.738813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:32.738813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:32.738813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:32.738813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:32.738813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:32.738813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:32.738813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:32.738813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:32.738813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:32.738813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:32.738813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:32.738813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:32.738813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:32.740211 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:32.740211 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:32.740211 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:32.740211 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:32.740211 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:32.740211 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:32.740211 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:32.740211 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:32.740211 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:32.740211 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:32.740211 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:32.740211 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:32.740211 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:32.740211 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:32.740211 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:32.740211 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:32.740211 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:32.741144 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:32.741144 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:32.741144 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:32.741144 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:32.741144 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:32.741144 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:32.741144 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:32.741144 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:32.741144 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 519/1042] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:32.745742 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0592d6-098d-4c7c-961e-b40de8c569a6 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:32.751997 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdec19-ae00-4296-933b-a5126b5ee30d None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:32.796219 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ba9ea-1a83-425e-9fdd-c2221fbc23c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:32.797631 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ba9ea-1a83-425e-9fdd-c2221fbc23c6 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:32.798277 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ba9ea-1a83-425e-9fdd-c2221fbc23c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:32.799507 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ba9ea-1a83-425e-9fdd-c2221fbc23c6 None admin] PATH_INFO: `/v3/services` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:32.800634 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ba9ea-1a83-425e-9fdd-c2221fbc23c6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:32.801135 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ba9ea-1a83-425e-9fdd-c2221fbc23c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:32.803005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ba9ea-1a83-425e-9fdd-c2221fbc23c6 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:32.809938 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:32.814996 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 524/1043] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:32.815887 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ba9ea-1a83-425e-9fdd-c2221fbc23c6 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:32.843761 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:32.859139 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0592d6-098d-4c7c-961e-b40de8c569a6 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:32.896002 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1acea-a976-45ed-b7f2-25697389e5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:32.897011 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1acea-a976-45ed-b7f2-25697389e5df None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:32.897486 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1acea-a976-45ed-b7f2-25697389e5df None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:32.897963 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1acea-a976-45ed-b7f2-25697389e5df None admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:32.899256 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1acea-a976-45ed-b7f2-25697389e5df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:32.899756 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1acea-a976-45ed-b7f2-25697389e5df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:32.901391 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1acea-a976-45ed-b7f2-25697389e5df None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:32.921502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 520/1044] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:08:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:32.922898 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1acea-a976-45ed-b7f2-25697389e5df None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:32.933507 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ba9ea-1a83-425e-9fdd-c2221fbc23c6 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:32.969719 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130372f8-2399-4f28-a2e7-2e72ee430f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:32.971518 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130372f8-2399-4f28-a2e7-2e72ee430f64 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:32.971967 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130372f8-2399-4f28-a2e7-2e72ee430f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:32.972250 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130372f8-2399-4f28-a2e7-2e72ee430f64 None admin] PATH_INFO: `/v3/services` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:32.972965 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130372f8-2399-4f28-a2e7-2e72ee430f64 None admin] RBAC: Adding query filter params (type=image) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:32.973277 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130372f8-2399-4f28-a2e7-2e72ee430f64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:32.974684 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130372f8-2399-4f28-a2e7-2e72ee430f64 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:32.980221 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 525/1045] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:32.985736 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130372f8-2399-4f28-a2e7-2e72ee430f64 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:33.034605 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1acea-a976-45ed-b7f2-25697389e5df None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:33.054158 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:33.077222 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d63da5-b48a-4055-94f6-b2659738b48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:33.077896 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d63da5-b48a-4055-94f6-b2659738b48c None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:33.078175 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d63da5-b48a-4055-94f6-b2659738b48c None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:33.078318 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:33.078437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d63da5-b48a-4055-94f6-b2659738b48c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:33.079297 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d63da5-b48a-4055-94f6-b2659738b48c None admin] RBAC: Adding query filter params (role.id=1d0cb8616d7f45139d1db10e50725fe7, scope.project.id=489877ae137244c5b83291671c703c99, user.id=3fbcf547421b42e4b520f9246326bff8) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:33.079613 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d63da5-b48a-4055-94f6-b2659738b48c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:33.081597 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d63da5-b48a-4055-94f6-b2659738b48c None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:33.088247 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 521/1046] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:08:32 2022] GET /identity/v3/role_assignments?user.id=3fbcf547421b42e4b520f9246326bff8&scope.project.id=489877ae137244c5b83291671c703c99&role.id=1d0cb8616d7f45139d1db10e50725fe7 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:33.107096 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130372f8-2399-4f28-a2e7-2e72ee430f64 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:33.146491 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a9de8-4d7e-48a0-9653-50de76b0a2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:33.147222 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a9de8-4d7e-48a0-9653-50de76b0a2c7 None admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:33.147512 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a9de8-4d7e-48a0-9653-50de76b0a2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:33.147791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a9de8-4d7e-48a0-9653-50de76b0a2c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:33.148553 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a9de8-4d7e-48a0-9653-50de76b0a2c7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:33.149976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a9de8-4d7e-48a0-9653-50de76b0a2c7 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:33.173961 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 526/1047] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Jun 29 12:08:32 2022] POST /identity/v3/endpoints => generated 327 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:08:34.472632 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8499c6-f282-41c3-bc18-3a2b0145dde9 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:34.473166 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8499c6-f282-41c3-bc18-3a2b0145dde9 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:34.473245 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8499c6-f282-41c3-bc18-3a2b0145dde9 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:34.474772 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 522/1048] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:34.480098 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e733e-9270-4f34-9b2b-e786f6a584b6 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:34.480540 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e733e-9270-4f34-9b2b-e786f6a584b6 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:34.480709 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e733e-9270-4f34-9b2b-e786f6a584b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:34.498025 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-8a4e733e-9270-4f34-9b2b-e786f6a584b6 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:34.499234 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-8a4e733e-9270-4f34-9b2b-e786f6a584b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:34.579589 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 527/1049] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:34.605121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8499c6-f282-41c3-bc18-3a2b0145dde9 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:34.719856 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8499c6-f282-41c3-bc18-3a2b0145dde9 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:34.762764 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7eb15-c5ca-4ccf-90c0-526854048700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:34.763566 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7eb15-c5ca-4ccf-90c0-526854048700 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:34.763854 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7eb15-c5ca-4ccf-90c0-526854048700 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:34.764131 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7eb15-c5ca-4ccf-90c0-526854048700 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:34.765325 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7eb15-c5ca-4ccf-90c0-526854048700 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:34.766801 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7eb15-c5ca-4ccf-90c0-526854048700 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:34.773667 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 523/1050] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:34.775477 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e733e-9270-4f34-9b2b-e786f6a584b6 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:34.845389 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:34.883995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e733e-9270-4f34-9b2b-e786f6a584b6 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:34.920819 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2605e64-8749-4d49-9a8e-e1c1395773e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:34.921499 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2605e64-8749-4d49-9a8e-e1c1395773e0 None admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:34.921780 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2605e64-8749-4d49-9a8e-e1c1395773e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:34.922045 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2605e64-8749-4d49-9a8e-e1c1395773e0 None admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:34.922774 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2605e64-8749-4d49-9a8e-e1c1395773e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:34.924512 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2605e64-8749-4d49-9a8e-e1c1395773e0 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:34.950837 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 528/1051] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 29 12:08:34 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:08:35.143176 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9d0d4-4c5e-449b-965d-560efc416002 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:35.143491 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9d0d4-4c5e-449b-965d-560efc416002 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:35.143666 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9d0d4-4c5e-449b-965d-560efc416002 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:35.145324 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 524/1052] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:35.150712 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f1434-a0fe-42dc-8fb6-08d7032742b6 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:35.151010 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f1434-a0fe-42dc-8fb6-08d7032742b6 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:35.151296 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f1434-a0fe-42dc-8fb6-08d7032742b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:35.168986 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-320f1434-a0fe-42dc-8fb6-08d7032742b6 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:35.170184 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-320f1434-a0fe-42dc-8fb6-08d7032742b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:35.242058 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 529/1053] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:35.255985 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e6037-7cd1-424f-96d8-de26fac77a96 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:35.256272 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e6037-7cd1-424f-96d8-de26fac77a96 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:35.256562 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e6037-7cd1-424f-96d8-de26fac77a96 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:35.258059 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 525/1054] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:35.263163 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394dfea3-7a64-4c68-9d3f-98affc6e287f None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:35.263454 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394dfea3-7a64-4c68-9d3f-98affc6e287f None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:35.263731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394dfea3-7a64-4c68-9d3f-98affc6e287f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:35.265483 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e6037-7cd1-424f-96d8-de26fac77a96 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:35.284704 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-394dfea3-7a64-4c68-9d3f-98affc6e287f None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:35.286149 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-394dfea3-7a64-4c68-9d3f-98affc6e287f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:35.322451 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:35.345758 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:35.374614 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 530/1055] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:35.394199 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e6037-7cd1-424f-96d8-de26fac77a96 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:35.400044 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394dfea3-7a64-4c68-9d3f-98affc6e287f None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:35.443743 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f3bfa-2d0e-4948-95e3-a19939d6d3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:35.444590 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f3bfa-2d0e-4948-95e3-a19939d6d3a6 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:35.444878 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f3bfa-2d0e-4948-95e3-a19939d6d3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:35.445158 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f3bfa-2d0e-4948-95e3-a19939d6d3a6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:35.457178 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f3bfa-2d0e-4948-95e3-a19939d6d3a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:35.465484 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-d25f3bfa-2d0e-4948-95e3-a19939d6d3a6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 12:08:35.465484 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:35.465484 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:35.465484 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:35.465484 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:35.465484 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:35.465484 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:35.465484 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:35.465484 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:35.465484 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:35.465484 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:35.465484 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:35.465484 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:35.465484 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:35.465484 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:35.465484 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:35.466587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:35.466587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:35.466587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:35.466587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:35.466587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:35.466587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:35.466587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:35.466587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:35.466587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:35.466587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:35.466587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:35.466587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:35.466587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:35.466587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:35.466587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:35.466587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:35.467475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:35.467475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:35.467475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:35.467475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:35.467475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:35.467475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:35.467475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:35.467475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:35.467475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:35.467475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:35.467475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 12:08:35.467475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:35.467475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 526/1056] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Jun 29 12:08:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:35.473449 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f3bfa-2d0e-4948-95e3-a19939d6d3a6 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:35.513185 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394dfea3-7a64-4c68-9d3f-98affc6e287f None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:35.556069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a723b80-5398-4462-b474-b9068c1fe10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:35.557166 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a723b80-5398-4462-b474-b9068c1fe10b None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:35.557591 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a723b80-5398-4462-b474-b9068c1fe10b None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:35.558015 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a723b80-5398-4462-b474-b9068c1fe10b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:35.602847 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f3bfa-2d0e-4948-95e3-a19939d6d3a6 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:35.615931 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:35.630521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:35.646034 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579abed-fdc2-4b3f-aabb-0ea3c0072829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:35.646610 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579abed-fdc2-4b3f-aabb-0ea3c0072829 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:35.646922 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579abed-fdc2-4b3f-aabb-0ea3c0072829 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:35.647199 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579abed-fdc2-4b3f-aabb-0ea3c0072829 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:35.647952 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579abed-fdc2-4b3f-aabb-0ea3c0072829 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:35.648261 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579abed-fdc2-4b3f-aabb-0ea3c0072829 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:35.649895 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579abed-fdc2-4b3f-aabb-0ea3c0072829 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:35.654622 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a723b80-5398-4462-b474-b9068c1fe10b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:35.657174 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a723b80-5398-4462-b474-b9068c1fe10b None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:35.664725 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 527/1057] 10.222.0.13 () {56 vars in 1115 bytes} [Wed Jun 29 12:08:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:35.666117 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579abed-fdc2-4b3f-aabb-0ea3c0072829 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:35.781339 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 531/1058] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 29 12:08:35.782467 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a723b80-5398-4462-b474-b9068c1fe10b None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:35.811860 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579abed-fdc2-4b3f-aabb-0ea3c0072829 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:35.848964 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb17d24-35d5-42e9-aa6e-f1ba0a5e6786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:35.849759 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb17d24-35d5-42e9-aa6e-f1ba0a5e6786 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:35.850047 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb17d24-35d5-42e9-aa6e-f1ba0a5e6786 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:35.850325 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb17d24-35d5-42e9-aa6e-f1ba0a5e6786 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:35.862096 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb17d24-35d5-42e9-aa6e-f1ba0a5e6786 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:35.863584 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb17d24-35d5-42e9-aa6e-f1ba0a5e6786 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:35.882663 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-4bb17d24-35d5-42e9-aa6e-f1ba0a5e6786 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:35.882663 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:35.882663 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:35.882663 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:35.882663 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:35.882663 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:35.882663 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:35.882663 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:35.882663 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:35.882663 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:35.882663 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:35.882663 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:35.882663 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:35.882663 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:35.882663 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:35.883599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:35.883599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:35.883599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:35.883599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:35.883599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:35.883599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:35.883599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:35.883599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:35.883599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:35.883599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:35.883599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:35.883599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:35.883599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:35.883599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:35.883599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:35.883599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:35.883599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:35.884520 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:35.884520 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:35.884520 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:35.884520 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:35.884520 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 528/1059] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:35.889782 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb17d24-35d5-42e9-aa6e-f1ba0a5e6786 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:35.904238 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:35.922752 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a723b80-5398-4462-b474-b9068c1fe10b None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:35.928908 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:35.975554 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c23ae8-902a-46e0-b934-8846f78ea5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:35.976360 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c23ae8-902a-46e0-b934-8846f78ea5ce None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:35.976975 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c23ae8-902a-46e0-b934-8846f78ea5ce None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:35.977114 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c23ae8-902a-46e0-b934-8846f78ea5ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:35.991490 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c23ae8-902a-46e0-b934-8846f78ea5ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:35.993290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c23ae8-902a-46e0-b934-8846f78ea5ce None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:36.012829 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-c7c23ae8-902a-46e0-b934-8846f78ea5ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:36.012829 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:36.012829 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:36.012829 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:36.012829 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:36.012829 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:36.012829 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:36.012829 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:36.012829 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:36.012829 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:36.012829 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:36.012829 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:36.012829 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:36.012829 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:36.012829 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:36.013823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:36.013823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:36.013823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:36.013823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:36.013823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:36.013823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:36.013823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:36.013823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:36.013823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:36.013823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:36.013823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:36.013823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:36.013823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:36.013823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:36.013823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:36.013823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:36.013823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:36.014763 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:36.014763 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:36.014763 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:36.014763 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:36.014763 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 532/1060] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:36.022204 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c23ae8-902a-46e0-b934-8846f78ea5ce None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:36.027630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb17d24-35d5-42e9-aa6e-f1ba0a5e6786 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:36.068745 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53605eb2-5b68-4b88-b8d1-4f2879783b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:36.069761 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53605eb2-5b68-4b88-b8d1-4f2879783b84 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:36.070043 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53605eb2-5b68-4b88-b8d1-4f2879783b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:36.070317 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53605eb2-5b68-4b88-b8d1-4f2879783b84 None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:36.071072 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53605eb2-5b68-4b88-b8d1-4f2879783b84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:36.071381 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53605eb2-5b68-4b88-b8d1-4f2879783b84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:36.072747 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53605eb2-5b68-4b88-b8d1-4f2879783b84 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:36.089966 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 529/1061] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:36.091429 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53605eb2-5b68-4b88-b8d1-4f2879783b84 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:36.163170 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c23ae8-902a-46e0-b934-8846f78ea5ce None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:36.208649 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:36.211648 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff423a-7398-401c-9f8c-b2d58d9622a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:36.212683 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff423a-7398-401c-9f8c-b2d58d9622a1 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:36.213138 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff423a-7398-401c-9f8c-b2d58d9622a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:36.213584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff423a-7398-401c-9f8c-b2d58d9622a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:36.214829 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff423a-7398-401c-9f8c-b2d58d9622a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:36.215332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff423a-7398-401c-9f8c-b2d58d9622a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:36.217484 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff423a-7398-401c-9f8c-b2d58d9622a1 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:36.222525 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:36.236868 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53605eb2-5b68-4b88-b8d1-4f2879783b84 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:36.237170 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 533/1062] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:36.278461 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9300707-36a7-46be-b43c-90c41ef39a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:36.279648 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9300707-36a7-46be-b43c-90c41ef39a30 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:36.280084 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9300707-36a7-46be-b43c-90c41ef39a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:36.280518 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9300707-36a7-46be-b43c-90c41ef39a30 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:36.290167 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9300707-36a7-46be-b43c-90c41ef39a30 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:36.291971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9300707-36a7-46be-b43c-90c41ef39a30 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:36.308831 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-e9300707-36a7-46be-b43c-90c41ef39a30 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:08:36.308831 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:36.308831 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:36.308831 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:36.308831 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:36.308831 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:36.308831 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:36.308831 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:36.308831 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:36.308831 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:36.308831 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:36.308831 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:36.308831 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:08:36.308831 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:08:36.308831 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:08:36.308831 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:08:36.309909 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:36.309909 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:36.309909 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:36.309909 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:36.309909 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:36.309909 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:36.309909 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:36.309909 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:36.309909 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:36.309909 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:36.309909 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:36.309909 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:36.309909 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:36.309909 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:36.309909 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:36.309909 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:36.309909 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:36.309909 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:36.310904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:36.310904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:36.310904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:08:36.310904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:08:36.310904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:08:36.310904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:08:36.310904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:08:36.310904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:08:36.310904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:08:36.310904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:36.312024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 530/1063] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Jun 29 12:08:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:36.317477 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff423a-7398-401c-9f8c-b2d58d9622a1 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:36.427125 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff423a-7398-401c-9f8c-b2d58d9622a1 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:36.463385 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa9df4-30b3-45d9-a309-f6b11bd0f3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:36.464060 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa9df4-30b3-45d9-a309-f6b11bd0f3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:36.464342 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa9df4-30b3-45d9-a309-f6b11bd0f3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:36.464614 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa9df4-30b3-45d9-a309-f6b11bd0f3d5 None admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:36.465440 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa9df4-30b3-45d9-a309-f6b11bd0f3d5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:36.465744 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa9df4-30b3-45d9-a309-f6b11bd0f3d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:36.467212 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa9df4-30b3-45d9-a309-f6b11bd0f3d5 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:36.486248 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 534/1064] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Jun 29 12:08:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:36.492008 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9300707-36a7-46be-b43c-90c41ef39a30 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:36.596506 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9300707-36a7-46be-b43c-90c41ef39a30 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:36.629796 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1db2d-fc25-4b9b-8448-6b222c89e94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:36.630585 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1db2d-fc25-4b9b-8448-6b222c89e94f None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:36.631376 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1db2d-fc25-4b9b-8448-6b222c89e94f None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:36.631376 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1db2d-fc25-4b9b-8448-6b222c89e94f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:36.641699 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1db2d-fc25-4b9b-8448-6b222c89e94f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:36.643719 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1db2d-fc25-4b9b-8448-6b222c89e94f None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:36.646173 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:36.661884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-40c1db2d-fc25-4b9b-8448-6b222c89e94f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:36.661884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:36.661884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:36.661884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:36.661884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:36.661884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:36.661884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:36.661884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:36.661884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:36.661884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:36.661884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:36.661884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:36.661884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:36.661884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:36.661884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:36.663014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:36.663014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:36.663014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:36.663014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:36.663014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:36.663014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:36.663014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:36.663014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:36.663014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:36.663014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:36.663014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:36.663014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:36.663014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:36.663014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:36.663014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:36.663014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:36.663014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:36.663927 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:36.663927 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:36.663927 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:36.663927 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:36.663927 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 531/1065] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:36.668887 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa9df4-30b3-45d9-a309-f6b11bd0f3d5 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:36.724335 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:36.776243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa9df4-30b3-45d9-a309-f6b11bd0f3d5 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:36.811339 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e8e68-a6ba-4f4c-82c6-f80a7a5e5b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:36.812011 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e8e68-a6ba-4f4c-82c6-f80a7a5e5b8d None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:36.812298 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e8e68-a6ba-4f4c-82c6-f80a7a5e5b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:36.812579 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e8e68-a6ba-4f4c-82c6-f80a7a5e5b8d None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:36.813313 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e8e68-a6ba-4f4c-82c6-f80a7a5e5b8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:36.813624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e8e68-a6ba-4f4c-82c6-f80a7a5e5b8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:36.815669 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e8e68-a6ba-4f4c-82c6-f80a7a5e5b8d None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:36.827285 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 535/1066] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:36.832826 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1db2d-fc25-4b9b-8448-6b222c89e94f None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:36.934854 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1db2d-fc25-4b9b-8448-6b222c89e94f None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:36.970472 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6406b-5d74-4841-83b8-7734c65105b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:36.971387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6406b-5d74-4841-83b8-7734c65105b8 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:36.971670 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6406b-5d74-4841-83b8-7734c65105b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:36.971944 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6406b-5d74-4841-83b8-7734c65105b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:36.978664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6406b-5d74-4841-83b8-7734c65105b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:36.980037 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6406b-5d74-4841-83b8-7734c65105b8 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:36.994078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-62f6406b-5d74-4841-83b8-7734c65105b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:36.994078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:36.994078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:36.994078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:36.994078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:36.994078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:36.994078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:36.994078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:36.994078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:36.994078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:36.994078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:36.994078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:36.994078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:36.994078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:36.994078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:36.995040 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:36.995040 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:36.995040 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:36.995040 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:36.995040 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:36.995040 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:36.995040 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:36.995040 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:36.995040 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:36.995040 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:36.995040 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:36.995040 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:36.995040 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:36.995040 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:36.995040 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:36.995040 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:36.995040 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:36.995992 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:36.995992 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:36.995992 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:36.995992 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:36.995992 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:36.995992 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:36.995992 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:36.995992 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:36.995992 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 532/1067] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:37.001070 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e8e68-a6ba-4f4c-82c6-f80a7a5e5b8d None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:37.100754 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e8e68-a6ba-4f4c-82c6-f80a7a5e5b8d None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:37.114910 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:37.136107 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52aa494-cd5f-4f06-b1c1-494387fd0c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:37.136784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aa494-cd5f-4f06-b1c1-494387fd0c43 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:37.137068 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aa494-cd5f-4f06-b1c1-494387fd0c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:37.137344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aa494-cd5f-4f06-b1c1-494387fd0c43 None admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:37.138146 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52aa494-cd5f-4f06-b1c1-494387fd0c43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:37.138457 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52aa494-cd5f-4f06-b1c1-494387fd0c43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:37.139971 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52aa494-cd5f-4f06-b1c1-494387fd0c43 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:37.153179 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 536/1068] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:08:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:37.159586 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6406b-5d74-4841-83b8-7734c65105b8 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:37.218902 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:37.242521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b6282-3f3c-40d5-aa4b-f00334ef0c75 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:37.242759 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b6282-3f3c-40d5-aa4b-f00334ef0c75 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:37.243043 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b6282-3f3c-40d5-aa4b-f00334ef0c75 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:37.244423 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 537/1069] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:08:37.249814 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0d1d5-e271-4df8-803c-396e8206bf8e None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:37.250184 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0d1d5-e271-4df8-803c-396e8206bf8e None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:37.250536 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0d1d5-e271-4df8-803c-396e8206bf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:37.265449 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6406b-5d74-4841-83b8-7734c65105b8 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:37.267370 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-29d0d1d5-e271-4df8-803c-396e8206bf8e None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:37.268586 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-29d0d1d5-e271-4df8-803c-396e8206bf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:37.301776 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922442df-5996-4cf8-b3aa-7a39d6333963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:37.302843 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922442df-5996-4cf8-b3aa-7a39d6333963 None admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:37.303137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922442df-5996-4cf8-b3aa-7a39d6333963 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:37.303412 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922442df-5996-4cf8-b3aa-7a39d6333963 None admin] PATH_INFO: `/v3/projects/489877ae137244c5b83291671c703c99/users/3fbcf547421b42e4b520f9246326bff8/roles/1d0cb8616d7f45139d1db10e50725fe7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:37.305611 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922442df-5996-4cf8-b3aa-7a39d6333963 None admin] RBAC: Authorizing `identity:create_grant(project_id=489877ae137244c5b83291671c703c99, user_id=3fbcf547421b42e4b520f9246326bff8, role_id=1d0cb8616d7f45139d1db10e50725fe7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:37.307090 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922442df-5996-4cf8-b3aa-7a39d6333963 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:37.320508 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 533/1070] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 29 12:08:37 2022] PUT /identity/v3/projects/489877ae137244c5b83291671c703c99/users/3fbcf547421b42e4b520f9246326bff8/roles/1d0cb8616d7f45139d1db10e50725fe7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:08:37.341352 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 538/1071] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:08:37.366675 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922442df-5996-4cf8-b3aa-7a39d6333963 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:37.477000 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922442df-5996-4cf8-b3aa-7a39d6333963 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:37.494391 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:37.512718 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a265aa-581d-42f7-bec1-f16911bf5002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:37.517135 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a265aa-581d-42f7-bec1-f16911bf5002 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:37.517135 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a265aa-581d-42f7-bec1-f16911bf5002 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:37.517135 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a265aa-581d-42f7-bec1-f16911bf5002 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:37.530227 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a265aa-581d-42f7-bec1-f16911bf5002 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:37.538787 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-14a265aa-581d-42f7-bec1-f16911bf5002 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:08:37.538787 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:37.538787 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:37.538787 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:37.538787 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:37.538787 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:37.538787 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:37.538787 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:37.538787 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:37.538787 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:37.538787 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:37.538787 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:37.538787 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:37.538787 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:37.538787 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:37.538787 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:37.539996 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:37.539996 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:37.539996 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:37.539996 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:37.539996 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:37.539996 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:37.539996 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:37.539996 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:37.539996 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:37.539996 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:37.539996 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:37.539996 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:37.539996 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:37.539996 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:37.539996 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:37.539996 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:37.540970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:37.540970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:37.540970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:37.540970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:37.540970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:37.540970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:37.540970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:37.540970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:37.540970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:37.540970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:37.540970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:08:37.540970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:37.540970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 534/1072] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:08:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:37.546011 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0d1d5-e271-4df8-803c-396e8206bf8e None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:37.654858 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0d1d5-e271-4df8-803c-396e8206bf8e None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:37.659346 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:37.712128 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56d060-135e-49e0-b331-2829e4490f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:37.713252 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56d060-135e-49e0-b331-2829e4490f27 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:37.713651 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56d060-135e-49e0-b331-2829e4490f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:37.714143 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56d060-135e-49e0-b331-2829e4490f27 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:37.715488 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b56d060-135e-49e0-b331-2829e4490f27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:37.716041 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b56d060-135e-49e0-b331-2829e4490f27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:37.718522 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b56d060-135e-49e0-b331-2829e4490f27 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:37.738900 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 539/1073] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:08:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:37.740134 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a265aa-581d-42f7-bec1-f16911bf5002 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:37.847936 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a265aa-581d-42f7-bec1-f16911bf5002 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:37.881220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a510164-85e3-4576-b88f-790bd4a57984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:37.882100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a510164-85e3-4576-b88f-790bd4a57984 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:37.882385 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a510164-85e3-4576-b88f-790bd4a57984 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:37.882684 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a510164-85e3-4576-b88f-790bd4a57984 None admin] PATH_INFO: `/v3/users/17ecfadd1f71435d8750d57269638734` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:37.896538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a510164-85e3-4576-b88f-790bd4a57984 None admin] RBAC: Authorizing `identity:get_user(user_id=17ecfadd1f71435d8750d57269638734)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:37.897991 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a510164-85e3-4576-b88f-790bd4a57984 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:37.899699 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 535/1074] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:08:37 2022] GET /identity/v3/users/17ecfadd1f71435d8750d57269638734 => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:37.905556 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56d060-135e-49e0-b331-2829e4490f27 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:38.006507 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56d060-135e-49e0-b331-2829e4490f27 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:38.041425 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc26f4-6f8c-447e-a467-818fce61a909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:38.042075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc26f4-6f8c-447e-a467-818fce61a909 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:38.042355 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc26f4-6f8c-447e-a467-818fce61a909 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:38.042627 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc26f4-6f8c-447e-a467-818fce61a909 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:38.077616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:38.116277 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc26f4-6f8c-447e-a467-818fce61a909 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:38.117661 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc26f4-6f8c-447e-a467-818fce61a909 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:38.214949 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 540/1075] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:08:38.220756 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a510164-85e3-4576-b88f-790bd4a57984 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:38.254451 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:38.322008 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a510164-85e3-4576-b88f-790bd4a57984 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:38.354780 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b032547-b767-4112-a21e-752840ad95b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:38.355642 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b032547-b767-4112-a21e-752840ad95b0 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:38.355928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b032547-b767-4112-a21e-752840ad95b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:38.356203 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b032547-b767-4112-a21e-752840ad95b0 None admin] PATH_INFO: `/v3/projects/40dbc28a7b0848ca9d337aedf9acb6a8` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:38.357370 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b032547-b767-4112-a21e-752840ad95b0 None admin] RBAC: Authorizing `identity:get_project(project_id=40dbc28a7b0848ca9d337aedf9acb6a8)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:38.358826 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b032547-b767-4112-a21e-752840ad95b0 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:38.360527 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 536/1076] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:08:38 2022] GET /identity/v3/projects/40dbc28a7b0848ca9d337aedf9acb6a8 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:38.367092 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc26f4-6f8c-447e-a467-818fce61a909 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:38.447730 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:38.484259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc26f4-6f8c-447e-a467-818fce61a909 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:38.518499 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f25150-52f0-4d93-986e-5c55e9e8e696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:38.519204 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f25150-52f0-4d93-986e-5c55e9e8e696 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:38.519491 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f25150-52f0-4d93-986e-5c55e9e8e696 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:38.519775 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f25150-52f0-4d93-986e-5c55e9e8e696 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:38.520661 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f25150-52f0-4d93-986e-5c55e9e8e696 None admin] RBAC: Adding query filter params (role.id=5ef3464f4436446b88430cdf7cc1a3d7, scope.project.id=40dbc28a7b0848ca9d337aedf9acb6a8, user.id=17ecfadd1f71435d8750d57269638734) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:38.520981 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f25150-52f0-4d93-986e-5c55e9e8e696 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:38.522471 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f25150-52f0-4d93-986e-5c55e9e8e696 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:38.528181 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 541/1077] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:08:38 2022] GET /identity/v3/role_assignments?user.id=17ecfadd1f71435d8750d57269638734&scope.project.id=40dbc28a7b0848ca9d337aedf9acb6a8&role.id=5ef3464f4436446b88430cdf7cc1a3d7 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:39.363560 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc52ad-b555-4269-ba8e-82f96ba00d02 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:39.364097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc52ad-b555-4269-ba8e-82f96ba00d02 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:39.364097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc52ad-b555-4269-ba8e-82f96ba00d02 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:39.365463 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 537/1078] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:39.370679 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a1916-4d2a-430c-b63a-b98e9bf0e1cb None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:39.371101 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a1916-4d2a-430c-b63a-b98e9bf0e1cb None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:39.371238 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a1916-4d2a-430c-b63a-b98e9bf0e1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:39.388266 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-801a1916-4d2a-430c-b63a-b98e9bf0e1cb None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:39.389484 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-801a1916-4d2a-430c-b63a-b98e9bf0e1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:39.457070 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 542/1079] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:39.481634 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc52ad-b555-4269-ba8e-82f96ba00d02 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:39.585576 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc52ad-b555-4269-ba8e-82f96ba00d02 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:39.587181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:39.623524 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31745ded-71c7-43b9-bd8c-1b076da740cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:39.624275 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31745ded-71c7-43b9-bd8c-1b076da740cd None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:39.624564 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31745ded-71c7-43b9-bd8c-1b076da740cd None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:39.624842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31745ded-71c7-43b9-bd8c-1b076da740cd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:39.635262 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31745ded-71c7-43b9-bd8c-1b076da740cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:39.643545 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-31745ded-71c7-43b9-bd8c-1b076da740cd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 12:08:39.643545 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:39.643545 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:39.643545 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:39.643545 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:39.643545 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:39.643545 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:39.643545 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:39.643545 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:39.643545 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:39.643545 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:39.643545 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:39.643545 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:39.643545 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:39.643545 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:39.643545 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:39.644647 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:39.644647 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:39.644647 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:39.644647 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:39.644647 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:39.644647 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:39.644647 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:39.644647 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:39.644647 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:39.644647 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:39.644647 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:39.644647 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:39.644647 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:39.644647 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:39.644647 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:39.644647 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:39.645511 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:39.645511 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:39.645511 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:39.645511 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:39.645511 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:39.645511 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:39.645511 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:39.645511 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:39.645511 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:39.645511 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:39.645511 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 12:08:39.645511 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:39.645511 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 538/1080] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Jun 29 12:08:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:39.650655 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a1916-4d2a-430c-b63a-b98e9bf0e1cb None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:39.709518 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:39.753006 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a1916-4d2a-430c-b63a-b98e9bf0e1cb None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:39.795772 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a116ed-2f17-4a40-9d19-32705150379c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:39.796443 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a116ed-2f17-4a40-9d19-32705150379c None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:39.796728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a116ed-2f17-4a40-9d19-32705150379c None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:39.797005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a116ed-2f17-4a40-9d19-32705150379c None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:39.797748 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a116ed-2f17-4a40-9d19-32705150379c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:39.798057 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a116ed-2f17-4a40-9d19-32705150379c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:39.799566 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a116ed-2f17-4a40-9d19-32705150379c None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:39.814762 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 543/1081] 10.222.0.13 () {56 vars in 1115 bytes} [Wed Jun 29 12:08:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:39.821951 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31745ded-71c7-43b9-bd8c-1b076da740cd None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:39.937499 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31745ded-71c7-43b9-bd8c-1b076da740cd None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:39.972506 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a6039-8a55-47dc-8a9e-5e45adb832fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:39.973306 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a6039-8a55-47dc-8a9e-5e45adb832fc None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:39.973589 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a6039-8a55-47dc-8a9e-5e45adb832fc None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:39.973865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a6039-8a55-47dc-8a9e-5e45adb832fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:39.985061 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a6039-8a55-47dc-8a9e-5e45adb832fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:39.986546 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a6039-8a55-47dc-8a9e-5e45adb832fc None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:40.003765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-685a6039-8a55-47dc-8a9e-5e45adb832fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:40.003765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:40.003765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:40.003765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:40.003765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:40.003765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:40.003765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:40.003765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:40.003765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:40.003765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:40.003765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:40.003765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:40.003765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:40.003765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:40.003765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:40.004690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:40.004690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:40.004690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:40.004690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:40.004690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:40.004690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:40.004690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:40.004690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:40.004690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:40.004690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:40.004690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:40.004690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:40.004690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:40.004690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:40.004690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:40.004690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:40.004690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:40.005601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:40.005601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:40.005601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:40.005601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:40.005601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 539/1082] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:40.010709 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a116ed-2f17-4a40-9d19-32705150379c None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:40.111572 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a116ed-2f17-4a40-9d19-32705150379c None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:40.134357 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:40.147191 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c4e50-e640-42e0-9a31-5a97e2578f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:40.147861 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c4e50-e640-42e0-9a31-5a97e2578f19 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:40.148148 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c4e50-e640-42e0-9a31-5a97e2578f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:40.148425 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c4e50-e640-42e0-9a31-5a97e2578f19 None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:40.149147 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c4e50-e640-42e0-9a31-5a97e2578f19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:40.149455 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c4e50-e640-42e0-9a31-5a97e2578f19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:40.150862 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c4e50-e640-42e0-9a31-5a97e2578f19 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:40.163199 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 544/1083] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:40.168779 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a6039-8a55-47dc-8a9e-5e45adb832fc None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:40.185698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:40.270620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a6039-8a55-47dc-8a9e-5e45adb832fc None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:40.304340 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d757b8-521e-4722-a058-4b5fdf195d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:40.305143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d757b8-521e-4722-a058-4b5fdf195d10 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:40.305430 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d757b8-521e-4722-a058-4b5fdf195d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:40.305771 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d757b8-521e-4722-a058-4b5fdf195d10 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:40.313613 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d757b8-521e-4722-a058-4b5fdf195d10 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:40.315653 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d757b8-521e-4722-a058-4b5fdf195d10 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:40.330448 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-46d757b8-521e-4722-a058-4b5fdf195d10 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:08:40.330448 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:40.330448 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:40.330448 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:40.330448 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:40.330448 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:40.330448 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:40.330448 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:40.330448 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:40.330448 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:40.330448 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:40.330448 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:40.330448 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:08:40.330448 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:08:40.330448 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:08:40.330448 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:08:40.331557 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:40.331557 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:40.331557 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:40.331557 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:40.331557 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:40.331557 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:40.331557 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:40.331557 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:40.331557 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:40.331557 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:40.331557 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:40.331557 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:40.331557 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:40.331557 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:40.331557 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:40.331557 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:40.331557 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:40.331557 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:40.332595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:40.332595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:40.332595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:08:40.332595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:08:40.332595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:08:40.332595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:08:40.332595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:08:40.332595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:08:40.332595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:08:40.332595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:40.332595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 540/1084] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Jun 29 12:08:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:40.337428 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c4e50-e640-42e0-9a31-5a97e2578f19 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:40.437186 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c4e50-e640-42e0-9a31-5a97e2578f19 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:40.472095 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9baf3bc-22b4-4bef-8705-da7d1d0b23f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:40.472764 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9baf3bc-22b4-4bef-8705-da7d1d0b23f8 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:40.473051 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9baf3bc-22b4-4bef-8705-da7d1d0b23f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:40.473326 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9baf3bc-22b4-4bef-8705-da7d1d0b23f8 None admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:40.474162 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9baf3bc-22b4-4bef-8705-da7d1d0b23f8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:40.474470 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9baf3bc-22b4-4bef-8705-da7d1d0b23f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:40.475951 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9baf3bc-22b4-4bef-8705-da7d1d0b23f8 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:40.494181 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 545/1085] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Jun 29 12:08:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:40.499774 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d757b8-521e-4722-a058-4b5fdf195d10 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:40.546693 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ef3fe-e0e1-44b7-a9ae-e677e23338b8 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:40.546914 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ef3fe-e0e1-44b7-a9ae-e677e23338b8 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:40.547201 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ef3fe-e0e1-44b7-a9ae-e677e23338b8 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:40.549086 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 546/1086] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:08:40.554214 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afed836-e841-4dc1-8270-0017d26c0459 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:40.554495 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afed836-e841-4dc1-8270-0017d26c0459 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:40.554792 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afed836-e841-4dc1-8270-0017d26c0459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:40.571802 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-4afed836-e841-4dc1-8270-0017d26c0459 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:40.572980 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-4afed836-e841-4dc1-8270-0017d26c0459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:40.579505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:40.604767 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d757b8-521e-4722-a058-4b5fdf195d10 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:40.607713 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:40.638755 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99336a-b7d8-48ce-a5a1-38d1b45b9aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:40.639404 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99336a-b7d8-48ce-a5a1-38d1b45b9aae None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:40.639692 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99336a-b7d8-48ce-a5a1-38d1b45b9aae None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:40.639967 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99336a-b7d8-48ce-a5a1-38d1b45b9aae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:40.641624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 547/1087] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:08:40.664482 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afed836-e841-4dc1-8270-0017d26c0459 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:40.707349 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec99336a-b7d8-48ce-a5a1-38d1b45b9aae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:40.708794 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec99336a-b7d8-48ce-a5a1-38d1b45b9aae None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:40.767794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afed836-e841-4dc1-8270-0017d26c0459 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:40.787314 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:40.804882 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e89346-00c9-47bb-9eba-13edaece48c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:40.805590 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e89346-00c9-47bb-9eba-13edaece48c2 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:40.805872 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e89346-00c9-47bb-9eba-13edaece48c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:40.806145 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e89346-00c9-47bb-9eba-13edaece48c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:40.815477 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 541/1088] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 29 12:08:40.817238 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e89346-00c9-47bb-9eba-13edaece48c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:40.821245 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99336a-b7d8-48ce-a5a1-38d1b45b9aae None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:40.825484 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-f6e89346-00c9-47bb-9eba-13edaece48c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:08:40.825484 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:40.825484 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:40.825484 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:40.825484 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:40.825484 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:40.825484 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:40.825484 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:40.825484 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:40.825484 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:40.825484 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:40.825484 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:40.825484 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:40.825484 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:40.825484 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:40.825484 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:40.826441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:40.826441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:40.826441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:40.826441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:40.826441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:40.826441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:40.826441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:40.826441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:40.826441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:40.826441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:40.826441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:40.826441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:40.826441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:40.826441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:40.826441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:40.826441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:40.827731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:40.827731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:40.827731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:40.827731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:40.827731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:40.827731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:40.827731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:40.827731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:40.827731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:40.827731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:40.827731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:08:40.827731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:08:40.827731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 548/1089] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:08:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:40.832761 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e89346-00c9-47bb-9eba-13edaece48c2 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:40.864785 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:40.922483 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99336a-b7d8-48ce-a5a1-38d1b45b9aae None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:40.936094 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e89346-00c9-47bb-9eba-13edaece48c2 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:40.958037 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbeca4-8acc-4c3b-a63a-9de904d8c428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:40.958872 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbeca4-8acc-4c3b-a63a-9de904d8c428 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:40.959158 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbeca4-8acc-4c3b-a63a-9de904d8c428 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:40.959437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbeca4-8acc-4c3b-a63a-9de904d8c428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:40.968871 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8138306-413c-4685-8273-c20487b81876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:40.969532 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8138306-413c-4685-8273-c20487b81876 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:40.969807 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8138306-413c-4685-8273-c20487b81876 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:40.969918 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbeca4-8acc-4c3b-a63a-9de904d8c428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:40.970077 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8138306-413c-4685-8273-c20487b81876 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:40.971476 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8138306-413c-4685-8273-c20487b81876 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:40.971779 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8138306-413c-4685-8273-c20487b81876 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:40.971872 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbeca4-8acc-4c3b-a63a-9de904d8c428 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:40.973257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8138306-413c-4685-8273-c20487b81876 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:40.981386 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 549/1090] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:08:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:40.987902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8138306-413c-4685-8273-c20487b81876 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:40.990486 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-bdcbeca4-8acc-4c3b-a63a-9de904d8c428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:40.990486 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:40.990486 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:40.990486 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:40.990486 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:40.990486 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:40.990486 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:40.990486 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:40.990486 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:40.990486 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:40.990486 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:40.990486 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:40.990486 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:40.990486 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:40.990486 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:40.991416 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:40.991416 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:40.991416 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:40.991416 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:40.991416 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:40.991416 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:40.991416 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:40.991416 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:40.991416 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:40.991416 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:40.991416 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:40.991416 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:40.991416 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:40.991416 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:40.991416 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:40.991416 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:40.991416 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:40.992328 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:40.992328 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:40.992328 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:40.992328 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:40.992328 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 542/1091] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:40.997356 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbeca4-8acc-4c3b-a63a-9de904d8c428 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:41.024715 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:41.081482 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:41.090723 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8138306-413c-4685-8273-c20487b81876 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:41.105896 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbeca4-8acc-4c3b-a63a-9de904d8c428 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:41.124703 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40017caf-c143-419f-9a94-a7ac2804e5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:41.125572 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40017caf-c143-419f-9a94-a7ac2804e5cf None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:41.125857 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40017caf-c143-419f-9a94-a7ac2804e5cf None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:41.126140 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40017caf-c143-419f-9a94-a7ac2804e5cf None admin] PATH_INFO: `/v3/users/17ecfadd1f71435d8750d57269638734` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:41.127864 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40017caf-c143-419f-9a94-a7ac2804e5cf None admin] RBAC: Authorizing `identity:get_user(user_id=17ecfadd1f71435d8750d57269638734)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:41.129343 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40017caf-c143-419f-9a94-a7ac2804e5cf None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:41.131180 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 550/1092] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:08:40 2022] GET /identity/v3/users/17ecfadd1f71435d8750d57269638734 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:41.136876 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40017caf-c143-419f-9a94-a7ac2804e5cf None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:41.140008 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41a80a-d447-492d-b06f-ef64c7b8d1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:41.140678 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41a80a-d447-492d-b06f-ef64c7b8d1ca None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:41.140968 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41a80a-d447-492d-b06f-ef64c7b8d1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:41.141244 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41a80a-d447-492d-b06f-ef64c7b8d1ca None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:41.141970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d41a80a-d447-492d-b06f-ef64c7b8d1ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:41.142310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d41a80a-d447-492d-b06f-ef64c7b8d1ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:41.143728 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d41a80a-d447-492d-b06f-ef64c7b8d1ca None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:41.155081 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 543/1093] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:41.161368 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41a80a-d447-492d-b06f-ef64c7b8d1ca None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:41.236728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40017caf-c143-419f-9a94-a7ac2804e5cf None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:41.246672 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:41.259452 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41a80a-d447-492d-b06f-ef64c7b8d1ca None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:41.269939 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e6387-a955-4c2e-8b6c-2ee47fd17641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:41.270974 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e6387-a955-4c2e-8b6c-2ee47fd17641 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:41.271255 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e6387-a955-4c2e-8b6c-2ee47fd17641 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:41.271529 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e6387-a955-4c2e-8b6c-2ee47fd17641 None admin] PATH_INFO: `/v3/projects/40dbc28a7b0848ca9d337aedf9acb6a8` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:41.272696 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e6387-a955-4c2e-8b6c-2ee47fd17641 None admin] RBAC: Authorizing `identity:get_project(project_id=40dbc28a7b0848ca9d337aedf9acb6a8)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:41.274133 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e6387-a955-4c2e-8b6c-2ee47fd17641 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:41.275856 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 551/1094] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:08:41 2022] GET /identity/v3/projects/40dbc28a7b0848ca9d337aedf9acb6a8 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:41.281666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e6387-a955-4c2e-8b6c-2ee47fd17641 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:41.296081 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bab86-4662-4ddf-9543-b5c5052bf2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:41.296900 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bab86-4662-4ddf-9543-b5c5052bf2fc None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:41.297164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bab86-4662-4ddf-9543-b5c5052bf2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:41.297403 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bab86-4662-4ddf-9543-b5c5052bf2fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:41.304428 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376bab86-4662-4ddf-9543-b5c5052bf2fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:41.305864 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376bab86-4662-4ddf-9543-b5c5052bf2fc None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:41.312253 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:41.320071 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-376bab86-4662-4ddf-9543-b5c5052bf2fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:41.320071 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:41.320071 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:41.320071 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:41.320071 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:41.320071 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:41.320071 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:41.320071 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:41.320071 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:41.320071 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:41.320071 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:41.320071 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:41.320071 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:41.320071 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:41.320071 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:41.321287 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:41.321287 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:41.321287 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:41.321287 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:41.321287 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:41.321287 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:41.321287 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:41.321287 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:41.321287 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:41.321287 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:41.321287 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:41.321287 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:41.321287 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:41.321287 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:41.321287 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:41.321287 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:41.321287 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:41.322409 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:41.322409 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:41.322409 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:41.322409 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:41.322409 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:41.322409 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:41.322409 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:41.322409 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:41.322409 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 544/1095] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:41.327025 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bab86-4662-4ddf-9543-b5c5052bf2fc None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:41.413215 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e6387-a955-4c2e-8b6c-2ee47fd17641 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:41.443510 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bab86-4662-4ddf-9543-b5c5052bf2fc None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:41.462588 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86b288-c7cb-4aa1-be41-8ccc09352cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:41.463993 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86b288-c7cb-4aa1-be41-8ccc09352cfb None admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:41.464456 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86b288-c7cb-4aa1-be41-8ccc09352cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:41.464922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86b288-c7cb-4aa1-be41-8ccc09352cfb None admin] PATH_INFO: `/v3/projects/40dbc28a7b0848ca9d337aedf9acb6a8/users/17ecfadd1f71435d8750d57269638734/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:41.468148 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86b288-c7cb-4aa1-be41-8ccc09352cfb None admin] RBAC: Authorizing `identity:create_grant(project_id=40dbc28a7b0848ca9d337aedf9acb6a8, user_id=17ecfadd1f71435d8750d57269638734, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:41.471459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86b288-c7cb-4aa1-be41-8ccc09352cfb None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:41.490179 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 552/1096] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 29 12:08:41 2022] PUT /identity/v3/projects/40dbc28a7b0848ca9d337aedf9acb6a8/users/17ecfadd1f71435d8750d57269638734/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:08:41.497002 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7810ee-eb5d-466c-a5ab-48297e837feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:41.497707 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7810ee-eb5d-466c-a5ab-48297e837feb None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:41.497990 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7810ee-eb5d-466c-a5ab-48297e837feb None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:41.498264 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7810ee-eb5d-466c-a5ab-48297e837feb None admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:41.499130 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7810ee-eb5d-466c-a5ab-48297e837feb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:41.499444 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7810ee-eb5d-466c-a5ab-48297e837feb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:41.500944 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7810ee-eb5d-466c-a5ab-48297e837feb None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:41.514217 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 545/1097] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:08:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:41.521378 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86b288-c7cb-4aa1-be41-8ccc09352cfb None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:41.616718 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:41.631166 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86b288-c7cb-4aa1-be41-8ccc09352cfb None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:41.666806 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051ac97-81d3-42b3-b66a-96a1f99129ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:41.667324 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051ac97-81d3-42b3-b66a-96a1f99129ba None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:41.667607 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051ac97-81d3-42b3-b66a-96a1f99129ba None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:41.667908 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051ac97-81d3-42b3-b66a-96a1f99129ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:41.668751 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051ac97-81d3-42b3-b66a-96a1f99129ba None admin] RBAC: Adding query filter params (role.id=1d0cb8616d7f45139d1db10e50725fe7, scope.project.id=489877ae137244c5b83291671c703c99, user.id=3fbcf547421b42e4b520f9246326bff8) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:41.669067 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051ac97-81d3-42b3-b66a-96a1f99129ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:41.670551 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051ac97-81d3-42b3-b66a-96a1f99129ba None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:41.676491 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 553/1098] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:08:41 2022] GET /identity/v3/role_assignments?user.id=3fbcf547421b42e4b520f9246326bff8&scope.project.id=489877ae137244c5b83291671c703c99&role.id=1d0cb8616d7f45139d1db10e50725fe7 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:43.526914 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbf01d-8a64-46f4-bd1f-10c2f0e7ed02 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:43.527475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbf01d-8a64-46f4-bd1f-10c2f0e7ed02 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:43.527475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbf01d-8a64-46f4-bd1f-10c2f0e7ed02 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:43.528837 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 546/1099] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:43.533883 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51aebb-0a84-42a1-90a3-56b0dcf42df8 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:43.534260 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51aebb-0a84-42a1-90a3-56b0dcf42df8 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:43.534431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51aebb-0a84-42a1-90a3-56b0dcf42df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:43.551421 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-cd51aebb-0a84-42a1-90a3-56b0dcf42df8 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:43.552573 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-cd51aebb-0a84-42a1-90a3-56b0dcf42df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:43.615705 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 554/1100] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:43.639532 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbf01d-8a64-46f4-bd1f-10c2f0e7ed02 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:43.648657 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:43.739131 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbf01d-8a64-46f4-bd1f-10c2f0e7ed02 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:43.771682 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd9cfd-582f-4697-8269-eb7e1dac5b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:43.772467 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd9cfd-582f-4697-8269-eb7e1dac5b5f None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:43.772749 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd9cfd-582f-4697-8269-eb7e1dac5b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:43.773022 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd9cfd-582f-4697-8269-eb7e1dac5b5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:43.783305 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd9cfd-582f-4697-8269-eb7e1dac5b5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:43.791022 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-90bd9cfd-582f-4697-8269-eb7e1dac5b5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:08:43.791022 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:43.791022 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:43.791022 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:43.791022 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:43.791022 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:43.791022 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:43.791022 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:43.791022 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:43.791022 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:43.791022 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:43.791022 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:43.791022 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:43.791022 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:43.791022 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:43.791022 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:43.792100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:43.792100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:43.792100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:43.792100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:43.792100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:43.792100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:43.792100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:43.792100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:43.792100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:43.792100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:43.792100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:43.792100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:43.792100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:43.792100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:43.792100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:43.792100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:43.793255 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:43.793255 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:43.793255 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:43.793255 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:43.793255 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:43.793255 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:43.793255 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:43.793255 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:43.793255 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:43.793255 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:43.793255 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:08:43.793255 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:08:43.793255 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 547/1101] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:08:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:43.798620 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51aebb-0a84-42a1-90a3-56b0dcf42df8 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:43.878738 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:43.898057 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51aebb-0a84-42a1-90a3-56b0dcf42df8 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:43.933392 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37fed4-70de-4b50-9817-15d831bc2cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:43.934053 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37fed4-70de-4b50-9817-15d831bc2cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:43.934336 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37fed4-70de-4b50-9817-15d831bc2cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:43.934613 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37fed4-70de-4b50-9817-15d831bc2cf1 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:43.935381 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37fed4-70de-4b50-9817-15d831bc2cf1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:43.935689 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37fed4-70de-4b50-9817-15d831bc2cf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:43.937064 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37fed4-70de-4b50-9817-15d831bc2cf1 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:43.944910 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 555/1102] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:08:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:43.950618 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd9cfd-582f-4697-8269-eb7e1dac5b5f None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:44.013460 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:44.056559 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd9cfd-582f-4697-8269-eb7e1dac5b5f None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:44.089091 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28097724-a10a-469f-aec8-d4cebed32067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:44.089951 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28097724-a10a-469f-aec8-d4cebed32067 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:44.090232 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28097724-a10a-469f-aec8-d4cebed32067 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:44.090505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28097724-a10a-469f-aec8-d4cebed32067 None admin] PATH_INFO: `/v3/users/17ecfadd1f71435d8750d57269638734` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:44.091704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28097724-a10a-469f-aec8-d4cebed32067 None admin] RBAC: Authorizing `identity:get_user(user_id=17ecfadd1f71435d8750d57269638734)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:44.093138 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28097724-a10a-469f-aec8-d4cebed32067 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:44.094786 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 548/1103] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:08:43 2022] GET /identity/v3/users/17ecfadd1f71435d8750d57269638734 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:44.101236 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37fed4-70de-4b50-9817-15d831bc2cf1 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:44.197163 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37fed4-70de-4b50-9817-15d831bc2cf1 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:44.229173 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a4bb8-bc3b-4d02-a432-436396825752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:44.229803 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a4bb8-bc3b-4d02-a432-436396825752 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:44.230084 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a4bb8-bc3b-4d02-a432-436396825752 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:44.230357 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a4bb8-bc3b-4d02-a432-436396825752 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:44.244936 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:44.297456 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a4bb8-bc3b-4d02-a432-436396825752 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:44.298943 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a4bb8-bc3b-4d02-a432-436396825752 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:44.396912 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 556/1104] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:08:44.402611 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28097724-a10a-469f-aec8-d4cebed32067 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:44.499073 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28097724-a10a-469f-aec8-d4cebed32067 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:44.531768 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2c522-0a6f-4a4f-aae5-49eee2c5499b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:44.533218 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2c522-0a6f-4a4f-aae5-49eee2c5499b None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:44.533502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2c522-0a6f-4a4f-aae5-49eee2c5499b None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:44.533778 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2c522-0a6f-4a4f-aae5-49eee2c5499b None admin] PATH_INFO: `/v3/projects/40dbc28a7b0848ca9d337aedf9acb6a8` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:44.535232 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2c522-0a6f-4a4f-aae5-49eee2c5499b None admin] RBAC: Authorizing `identity:get_project(project_id=40dbc28a7b0848ca9d337aedf9acb6a8)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:44.536655 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2c522-0a6f-4a4f-aae5-49eee2c5499b None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:44.538324 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 549/1105] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:08:44 2022] GET /identity/v3/projects/40dbc28a7b0848ca9d337aedf9acb6a8 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:44.544238 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a4bb8-bc3b-4d02-a432-436396825752 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:44.587647 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:44.640205 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a4bb8-bc3b-4d02-a432-436396825752 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:44.673141 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10c354-0ae3-443f-8b14-9b592fa5bd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:44.673790 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10c354-0ae3-443f-8b14-9b592fa5bd1c None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:44.674073 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10c354-0ae3-443f-8b14-9b592fa5bd1c None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:44.674347 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10c354-0ae3-443f-8b14-9b592fa5bd1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:44.675199 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10c354-0ae3-443f-8b14-9b592fa5bd1c None admin] RBAC: Adding query filter params (role.id=5ef3464f4436446b88430cdf7cc1a3d7, scope.project.id=40dbc28a7b0848ca9d337aedf9acb6a8, user.id=17ecfadd1f71435d8750d57269638734) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:44.675515 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10c354-0ae3-443f-8b14-9b592fa5bd1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:44.676950 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10c354-0ae3-443f-8b14-9b592fa5bd1c None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:44.682545 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 557/1106] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:08:44 2022] GET /identity/v3/role_assignments?user.id=17ecfadd1f71435d8750d57269638734&scope.project.id=40dbc28a7b0848ca9d337aedf9acb6a8&role.id=5ef3464f4436446b88430cdf7cc1a3d7 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:46.731398 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0471b-b7c2-435a-89c2-8bf317315b4d None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:46.731838 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0471b-b7c2-435a-89c2-8bf317315b4d None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:46.731961 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0471b-b7c2-435a-89c2-8bf317315b4d None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:46.733344 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 550/1107] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:46.738573 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0cf20-bbff-4aba-891d-395a6c9756aa None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:46.739012 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0cf20-bbff-4aba-891d-395a6c9756aa None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:46.739157 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0cf20-bbff-4aba-891d-395a6c9756aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:46.755762 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-51a0cf20-bbff-4aba-891d-395a6c9756aa None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:46.757002 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-51a0cf20-bbff-4aba-891d-395a6c9756aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:46.822399 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 558/1108] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:46.847981 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0471b-b7c2-435a-89c2-8bf317315b4d None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:46.850864 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:46.946805 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0471b-b7c2-435a-89c2-8bf317315b4d None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:46.979712 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabb5e9-19c5-44a7-87da-1fbe27239542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:46.980433 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabb5e9-19c5-44a7-87da-1fbe27239542 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:46.980715 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabb5e9-19c5-44a7-87da-1fbe27239542 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:46.980990 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabb5e9-19c5-44a7-87da-1fbe27239542 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:46.982145 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fabb5e9-19c5-44a7-87da-1fbe27239542 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:46.983613 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fabb5e9-19c5-44a7-87da-1fbe27239542 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:46.985220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 551/1109] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:46.991138 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0cf20-bbff-4aba-891d-395a6c9756aa None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:47.029161 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:47.087584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0cf20-bbff-4aba-891d-395a6c9756aa None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:47.122079 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0bee2-e8fc-4685-83bd-fb1fecbcd285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:47.122991 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0bee2-e8fc-4685-83bd-fb1fecbcd285 None admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:47.123398 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0bee2-e8fc-4685-83bd-fb1fecbcd285 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:47.123795 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0bee2-e8fc-4685-83bd-fb1fecbcd285 None admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:47.124596 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0bee2-e8fc-4685-83bd-fb1fecbcd285 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:47.126542 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0bee2-e8fc-4685-83bd-fb1fecbcd285 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:47.147763 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 559/1110] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 29 12:08:46 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:08:49.193508 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccdcbf-1899-4916-aefa-799aa8a23f27 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:49.194035 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccdcbf-1899-4916-aefa-799aa8a23f27 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:49.194035 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccdcbf-1899-4916-aefa-799aa8a23f27 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:49.195471 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 552/1111] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:49.200646 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b1d68-004a-4de4-88c0-68e11b3bd428 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:49.201070 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b1d68-004a-4de4-88c0-68e11b3bd428 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:49.201204 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b1d68-004a-4de4-88c0-68e11b3bd428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:49.217539 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-b14b1d68-004a-4de4-88c0-68e11b3bd428 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:49.218756 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-b14b1d68-004a-4de4-88c0-68e11b3bd428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:49.283501 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 560/1112] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:49.307713 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccdcbf-1899-4916-aefa-799aa8a23f27 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:49.376378 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:49.408503 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccdcbf-1899-4916-aefa-799aa8a23f27 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:49.442106 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f072358-8205-4079-8a5b-1517b8ca25b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:49.442983 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f072358-8205-4079-8a5b-1517b8ca25b4 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:49.443268 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f072358-8205-4079-8a5b-1517b8ca25b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:49.443595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f072358-8205-4079-8a5b-1517b8ca25b4 None admin] PATH_INFO: `/v3/roles/b0982ad59fae4158ba9249550f6452cd` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:49.445006 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f072358-8205-4079-8a5b-1517b8ca25b4 None admin] RBAC: Authorizing `identity:get_role(role_id=b0982ad59fae4158ba9249550f6452cd)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:49.446382 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f072358-8205-4079-8a5b-1517b8ca25b4 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:49.447772 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 553/1113] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:08:49 2022] GET /identity/v3/roles/b0982ad59fae4158ba9249550f6452cd => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:49.453404 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b1d68-004a-4de4-88c0-68e11b3bd428 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:49.477535 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:49.550868 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b1d68-004a-4de4-88c0-68e11b3bd428 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:49.583456 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e50a6-d1d3-474e-81bd-82e7beef54ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:49.584316 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e50a6-d1d3-474e-81bd-82e7beef54ff None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:49.584600 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e50a6-d1d3-474e-81bd-82e7beef54ff None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:49.584877 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e50a6-d1d3-474e-81bd-82e7beef54ff None admin] PATH_INFO: `/v3/users/9201d4621269463ab08821e293f8f5ab` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:49.597411 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e50a6-d1d3-474e-81bd-82e7beef54ff None admin] RBAC: Authorizing `identity:get_user(user_id=9201d4621269463ab08821e293f8f5ab)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:49.598885 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e50a6-d1d3-474e-81bd-82e7beef54ff None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:49.600513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 561/1114] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:08:49 2022] GET /identity/v3/users/9201d4621269463ab08821e293f8f5ab => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:49.606108 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f072358-8205-4079-8a5b-1517b8ca25b4 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:49.702019 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f072358-8205-4079-8a5b-1517b8ca25b4 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:49.737212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b34da-a95c-4b06-8879-e2434ae0d439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:49.737856 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b34da-a95c-4b06-8879-e2434ae0d439 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:49.738135 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b34da-a95c-4b06-8879-e2434ae0d439 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:49.738408 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b34da-a95c-4b06-8879-e2434ae0d439 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:49.746441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:49.812105 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b34da-a95c-4b06-8879-e2434ae0d439 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:49.814204 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b34da-a95c-4b06-8879-e2434ae0d439 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:49.912044 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 554/1115] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:08:49.917892 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e50a6-d1d3-474e-81bd-82e7beef54ff None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:49.996304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:50.014461 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e50a6-d1d3-474e-81bd-82e7beef54ff None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:50.047500 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0a10b-bccf-4b17-b629-810125ea61e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:50.049024 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0a10b-bccf-4b17-b629-810125ea61e0 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:50.049299 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0a10b-bccf-4b17-b629-810125ea61e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:50.049569 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0a10b-bccf-4b17-b629-810125ea61e0 None admin] PATH_INFO: `/v3/projects/40dbc28a7b0848ca9d337aedf9acb6a8` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:50.050745 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0a10b-bccf-4b17-b629-810125ea61e0 None admin] RBAC: Authorizing `identity:get_project(project_id=40dbc28a7b0848ca9d337aedf9acb6a8)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:50.052186 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0a10b-bccf-4b17-b629-810125ea61e0 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:50.053842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 562/1116] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:08:49 2022] GET /identity/v3/projects/40dbc28a7b0848ca9d337aedf9acb6a8 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:50.059824 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b34da-a95c-4b06-8879-e2434ae0d439 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:50.098257 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:50.164465 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b34da-a95c-4b06-8879-e2434ae0d439 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:50.199053 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cedd12-b338-428e-9703-0a882e052533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:50.199696 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cedd12-b338-428e-9703-0a882e052533 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:50.199978 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cedd12-b338-428e-9703-0a882e052533 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:50.200249 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cedd12-b338-428e-9703-0a882e052533 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:50.201063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cedd12-b338-428e-9703-0a882e052533 None admin] RBAC: Adding query filter params (role.id=b0982ad59fae4158ba9249550f6452cd, scope.project.id=40dbc28a7b0848ca9d337aedf9acb6a8, user.id=9201d4621269463ab08821e293f8f5ab) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:50.201371 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cedd12-b338-428e-9703-0a882e052533 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:50.202809 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cedd12-b338-428e-9703-0a882e052533 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:50.208357 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 555/1117] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:08:50 2022] GET /identity/v3/role_assignments?user.id=9201d4621269463ab08821e293f8f5ab&scope.project.id=40dbc28a7b0848ca9d337aedf9acb6a8&role.id=b0982ad59fae4158ba9249550f6452cd => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:52.189826 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26155e-a29d-45fa-886c-44867f926cb8 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:52.190361 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26155e-a29d-45fa-886c-44867f926cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:52.190361 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26155e-a29d-45fa-886c-44867f926cb8 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:52.191763 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 563/1118] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:52.197031 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd3f0d-1678-409d-9357-69d5f9a5f92f None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:52.197429 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd3f0d-1678-409d-9357-69d5f9a5f92f None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:52.197576 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd3f0d-1678-409d-9357-69d5f9a5f92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:52.213675 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-1dcd3f0d-1678-409d-9357-69d5f9a5f92f None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:52.214875 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-1dcd3f0d-1678-409d-9357-69d5f9a5f92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:52.278149 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 556/1119] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:08:52.302972 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26155e-a29d-45fa-886c-44867f926cb8 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:52.397982 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26155e-a29d-45fa-886c-44867f926cb8 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:52.430860 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c580e-98ea-43c3-b3e3-33f2220688a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:52.431678 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c580e-98ea-43c3-b3e3-33f2220688a4 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:52.431955 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c580e-98ea-43c3-b3e3-33f2220688a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:52.432224 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c580e-98ea-43c3-b3e3-33f2220688a4 None admin] PATH_INFO: `/v3/roles/b0982ad59fae4158ba9249550f6452cd` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:52.433651 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c580e-98ea-43c3-b3e3-33f2220688a4 None admin] RBAC: Authorizing `identity:get_role(role_id=b0982ad59fae4158ba9249550f6452cd)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:52.435047 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c580e-98ea-43c3-b3e3-33f2220688a4 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:52.436379 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 564/1120] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:08:52 2022] GET /identity/v3/roles/b0982ad59fae4158ba9249550f6452cd => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:52.442094 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd3f0d-1678-409d-9357-69d5f9a5f92f None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:52.471648 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:52.538746 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd3f0d-1678-409d-9357-69d5f9a5f92f None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:52.570720 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3ffb0-52bf-4793-982c-586235a344f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:52.571576 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3ffb0-52bf-4793-982c-586235a344f2 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:52.571856 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3ffb0-52bf-4793-982c-586235a344f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:52.572129 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3ffb0-52bf-4793-982c-586235a344f2 None admin] PATH_INFO: `/v3/users/9201d4621269463ab08821e293f8f5ab` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:52.573293 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3ffb0-52bf-4793-982c-586235a344f2 None admin] RBAC: Authorizing `identity:get_user(user_id=9201d4621269463ab08821e293f8f5ab)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:52.574748 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3ffb0-52bf-4793-982c-586235a344f2 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:52.576357 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 557/1121] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:08:52 2022] GET /identity/v3/users/9201d4621269463ab08821e293f8f5ab => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:52.582703 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c580e-98ea-43c3-b3e3-33f2220688a4 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:52.601605 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:52.678649 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c580e-98ea-43c3-b3e3-33f2220688a4 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:52.710966 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b12b4-d410-427c-8970-99e732b4c268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:52.711738 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b12b4-d410-427c-8970-99e732b4c268 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:52.712017 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b12b4-d410-427c-8970-99e732b4c268 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:52.712288 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b12b4-d410-427c-8970-99e732b4c268 None admin] PATH_INFO: `/v3/projects/40dbc28a7b0848ca9d337aedf9acb6a8` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:52.713438 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b12b4-d410-427c-8970-99e732b4c268 None admin] RBAC: Authorizing `identity:get_project(project_id=40dbc28a7b0848ca9d337aedf9acb6a8)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:52.714896 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b12b4-d410-427c-8970-99e732b4c268 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:52.716555 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 565/1122] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:08:52 2022] GET /identity/v3/projects/40dbc28a7b0848ca9d337aedf9acb6a8 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:52.723435 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3ffb0-52bf-4793-982c-586235a344f2 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:52.816046 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:52.819169 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3ffb0-52bf-4793-982c-586235a344f2 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:52.853972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43f0cf-1aa1-4578-9711-8512c7337501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:52.854914 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43f0cf-1aa1-4578-9711-8512c7337501 None admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:52.855203 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43f0cf-1aa1-4578-9711-8512c7337501 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:52.855482 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43f0cf-1aa1-4578-9711-8512c7337501 None admin] PATH_INFO: `/v3/projects/40dbc28a7b0848ca9d337aedf9acb6a8/users/9201d4621269463ab08821e293f8f5ab/roles/b0982ad59fae4158ba9249550f6452cd` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:52.857687 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43f0cf-1aa1-4578-9711-8512c7337501 None admin] RBAC: Authorizing `identity:create_grant(project_id=40dbc28a7b0848ca9d337aedf9acb6a8, user_id=9201d4621269463ab08821e293f8f5ab, role_id=b0982ad59fae4158ba9249550f6452cd)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:52.859167 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43f0cf-1aa1-4578-9711-8512c7337501 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:52.871230 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 558/1123] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 29 12:08:52 2022] PUT /identity/v3/projects/40dbc28a7b0848ca9d337aedf9acb6a8/users/9201d4621269463ab08821e293f8f5ab/roles/b0982ad59fae4158ba9249550f6452cd => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:08:54.860661 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648bf0a-40ec-46b1-a84c-fb84ebf17ee3 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:54.861225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648bf0a-40ec-46b1-a84c-fb84ebf17ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:54.861225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648bf0a-40ec-46b1-a84c-fb84ebf17ee3 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:54.862557 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 566/1124] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:54.867876 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4d179-8c43-4e76-996d-35f94066a6c1 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:54.868302 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4d179-8c43-4e76-996d-35f94066a6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:54.868439 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4d179-8c43-4e76-996d-35f94066a6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:54.884718 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-d8d4d179-8c43-4e76-996d-35f94066a6c1 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:54.885896 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-d8d4d179-8c43-4e76-996d-35f94066a6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:54.950430 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 559/1125] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:08:54.974157 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648bf0a-40ec-46b1-a84c-fb84ebf17ee3 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:55.056139 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:55.070915 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648bf0a-40ec-46b1-a84c-fb84ebf17ee3 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:55.105414 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2c9753-a3f7-4661-97a2-783c695b65b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:55.106249 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c9753-a3f7-4661-97a2-783c695b65b7 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:55.106528 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c9753-a3f7-4661-97a2-783c695b65b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:55.106835 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c9753-a3f7-4661-97a2-783c695b65b7 None admin] PATH_INFO: `/v3/roles/b0982ad59fae4158ba9249550f6452cd` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:55.108284 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2c9753-a3f7-4661-97a2-783c695b65b7 None admin] RBAC: Authorizing `identity:get_role(role_id=b0982ad59fae4158ba9249550f6452cd)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:55.109646 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2c9753-a3f7-4661-97a2-783c695b65b7 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:55.111128 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 567/1126] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:08:54 2022] GET /identity/v3/roles/b0982ad59fae4158ba9249550f6452cd => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:55.116858 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4d179-8c43-4e76-996d-35f94066a6c1 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:55.203758 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:55.214762 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4d179-8c43-4e76-996d-35f94066a6c1 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:55.247531 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe366350-8a6b-42c4-aab5-f69b2709d212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:55.248389 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe366350-8a6b-42c4-aab5-f69b2709d212 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:55.248676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe366350-8a6b-42c4-aab5-f69b2709d212 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:55.248954 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe366350-8a6b-42c4-aab5-f69b2709d212 None admin] PATH_INFO: `/v3/users/9201d4621269463ab08821e293f8f5ab` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:55.250133 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe366350-8a6b-42c4-aab5-f69b2709d212 None admin] RBAC: Authorizing `identity:get_user(user_id=9201d4621269463ab08821e293f8f5ab)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:55.252184 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe366350-8a6b-42c4-aab5-f69b2709d212 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:55.253802 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 560/1127] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:08:55 2022] GET /identity/v3/users/9201d4621269463ab08821e293f8f5ab => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:55.259627 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2c9753-a3f7-4661-97a2-783c695b65b7 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:55.355043 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2c9753-a3f7-4661-97a2-783c695b65b7 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:55.387930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e583ca3-d4df-4b78-9262-01e75227ca4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:55.388575 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e583ca3-d4df-4b78-9262-01e75227ca4e None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:55.388862 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e583ca3-d4df-4b78-9262-01e75227ca4e None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:55.389140 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e583ca3-d4df-4b78-9262-01e75227ca4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:55.413493 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:55.456093 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e583ca3-d4df-4b78-9262-01e75227ca4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:55.457551 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e583ca3-d4df-4b78-9262-01e75227ca4e None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:55.550692 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 568/1128] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:08:55.556521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe366350-8a6b-42c4-aab5-f69b2709d212 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:55.651323 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe366350-8a6b-42c4-aab5-f69b2709d212 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:55.684805 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b0064-453b-47f9-81bd-95583e05c284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:55.685645 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b0064-453b-47f9-81bd-95583e05c284 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:55.685926 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b0064-453b-47f9-81bd-95583e05c284 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:55.686200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b0064-453b-47f9-81bd-95583e05c284 None admin] PATH_INFO: `/v3/projects/40dbc28a7b0848ca9d337aedf9acb6a8` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:55.687365 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b0064-453b-47f9-81bd-95583e05c284 None admin] RBAC: Authorizing `identity:get_project(project_id=40dbc28a7b0848ca9d337aedf9acb6a8)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:55.688844 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b0064-453b-47f9-81bd-95583e05c284 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:55.691034 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 561/1129] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:08:55 2022] GET /identity/v3/projects/40dbc28a7b0848ca9d337aedf9acb6a8 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:55.696995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e583ca3-d4df-4b78-9262-01e75227ca4e None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:55.750188 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:55.792775 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e583ca3-d4df-4b78-9262-01e75227ca4e None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:55.830035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a025fde-c608-4676-9a73-35b40f188cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:55.830705 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a025fde-c608-4676-9a73-35b40f188cff None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:55.830986 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a025fde-c608-4676-9a73-35b40f188cff None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:55.831258 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a025fde-c608-4676-9a73-35b40f188cff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:55.832083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a025fde-c608-4676-9a73-35b40f188cff None admin] RBAC: Adding query filter params (role.id=b0982ad59fae4158ba9249550f6452cd, scope.project.id=40dbc28a7b0848ca9d337aedf9acb6a8, user.id=9201d4621269463ab08821e293f8f5ab) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:55.832394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a025fde-c608-4676-9a73-35b40f188cff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:55.833822 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a025fde-c608-4676-9a73-35b40f188cff None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:55.839513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 569/1130] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:08:55 2022] GET /identity/v3/role_assignments?user.id=9201d4621269463ab08821e293f8f5ab&scope.project.id=40dbc28a7b0848ca9d337aedf9acb6a8&role.id=b0982ad59fae4158ba9249550f6452cd => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:57.867750 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e84e4-951c-4d93-8879-6cb41dbca579 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:57.868296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e84e4-951c-4d93-8879-6cb41dbca579 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:57.868296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e84e4-951c-4d93-8879-6cb41dbca579 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:57.869686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 562/1131] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:57.874815 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4988d93-b4cf-4701-9cdb-85a3c340d0f3 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:57.875179 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4988d93-b4cf-4701-9cdb-85a3c340d0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:57.875376 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4988d93-b4cf-4701-9cdb-85a3c340d0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:57.892053 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-f4988d93-b4cf-4701-9cdb-85a3c340d0f3 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:57.893206 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-f4988d93-b4cf-4701-9cdb-85a3c340d0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:57.957836 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 570/1132] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:57.980924 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e84e4-951c-4d93-8879-6cb41dbca579 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:58.008322 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:58.082552 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e84e4-951c-4d93-8879-6cb41dbca579 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:58.115554 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0f990-0be7-4fc5-b7cf-f39a2a0cb7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:58.116334 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0f990-0be7-4fc5-b7cf-f39a2a0cb7dc None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:58.116617 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0f990-0be7-4fc5-b7cf-f39a2a0cb7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:58.116892 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0f990-0be7-4fc5-b7cf-f39a2a0cb7dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:58.118053 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0f990-0be7-4fc5-b7cf-f39a2a0cb7dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:58.119504 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0f990-0be7-4fc5-b7cf-f39a2a0cb7dc None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:58.121119 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 563/1133] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:58.129283 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4988d93-b4cf-4701-9cdb-85a3c340d0f3 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:58.176122 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:58.223499 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4988d93-b4cf-4701-9cdb-85a3c340d0f3 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:58.256214 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b88fb9-8c5b-4e5a-a142-7cdf88ed9a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:58.256797 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b88fb9-8c5b-4e5a-a142-7cdf88ed9a9b None admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:58.257076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b88fb9-8c5b-4e5a-a142-7cdf88ed9a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:58.257349 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b88fb9-8c5b-4e5a-a142-7cdf88ed9a9b None admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:58.258036 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b88fb9-8c5b-4e5a-a142-7cdf88ed9a9b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:58.259484 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b88fb9-8c5b-4e5a-a142-7cdf88ed9a9b None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:58.284005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 571/1134] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Jun 29 12:08:58 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:09:00.316168 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97714834-4546-4756-88be-13e5159768a7 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:00.316720 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97714834-4546-4756-88be-13e5159768a7 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:00.316720 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97714834-4546-4756-88be-13e5159768a7 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:00.318089 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 564/1135] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:00.323149 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3126b8f-7b6e-4957-804f-b1600df1aeb7 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:00.323570 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3126b8f-7b6e-4957-804f-b1600df1aeb7 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:00.323702 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3126b8f-7b6e-4957-804f-b1600df1aeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:00.339978 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-b3126b8f-7b6e-4957-804f-b1600df1aeb7 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:00.341167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-b3126b8f-7b6e-4957-804f-b1600df1aeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:00.406172 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 572/1136] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:00.431885 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97714834-4546-4756-88be-13e5159768a7 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:00.523384 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:00.531570 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97714834-4546-4756-88be-13e5159768a7 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:00.565007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e42cac-eb06-4821-a0d5-867d0a81506e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:00.565787 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e42cac-eb06-4821-a0d5-867d0a81506e None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:00.566071 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e42cac-eb06-4821-a0d5-867d0a81506e None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:00.566395 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e42cac-eb06-4821-a0d5-867d0a81506e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:00.567543 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e42cac-eb06-4821-a0d5-867d0a81506e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:00.568963 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e42cac-eb06-4821-a0d5-867d0a81506e None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:00.570555 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 565/1137] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:09:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:00.576369 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3126b8f-7b6e-4957-804f-b1600df1aeb7 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:00.606884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:00.674110 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3126b8f-7b6e-4957-804f-b1600df1aeb7 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:00.706831 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306f6d2-4280-4fd3-bd8d-906b25dd84a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:00.707491 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306f6d2-4280-4fd3-bd8d-906b25dd84a3 None admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:00.707774 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306f6d2-4280-4fd3-bd8d-906b25dd84a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:00.708052 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306f6d2-4280-4fd3-bd8d-906b25dd84a3 None admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:00.708758 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306f6d2-4280-4fd3-bd8d-906b25dd84a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:00.710193 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306f6d2-4280-4fd3-bd8d-906b25dd84a3 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:00.731640 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 573/1138] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 29 12:09:00 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:09:02.791490 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b25197-3014-46fd-b96d-b96ee0214591 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:02.791966 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b25197-3014-46fd-b96d-b96ee0214591 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:02.792082 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b25197-3014-46fd-b96d-b96ee0214591 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:02.793403 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 566/1139] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:02.798841 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d933c-a701-4f19-8afe-cd7f82c6ffe5 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:02.799287 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d933c-a701-4f19-8afe-cd7f82c6ffe5 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:02.799390 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d933c-a701-4f19-8afe-cd7f82c6ffe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:02.816991 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-ad3d933c-a701-4f19-8afe-cd7f82c6ffe5 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:02.818372 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-ad3d933c-a701-4f19-8afe-cd7f82c6ffe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:02.882818 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 574/1140] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:02.906245 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b25197-3014-46fd-b96d-b96ee0214591 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:03.003030 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b25197-3014-46fd-b96d-b96ee0214591 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:03.034881 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbac239-a34e-408f-a4fb-a6d478891439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:03.035650 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbac239-a34e-408f-a4fb-a6d478891439 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:03.035931 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbac239-a34e-408f-a4fb-a6d478891439 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:03.036204 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbac239-a34e-408f-a4fb-a6d478891439 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:03.045876 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbac239-a34e-408f-a4fb-a6d478891439 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:09:03.053904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-efbac239-a34e-408f-a4fb-a6d478891439 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:09:03.053904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:03.053904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:03.053904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:03.053904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:03.053904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:03.053904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:03.053904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:03.053904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:03.053904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:03.053904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:03.053904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:03.053904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:09:03.053904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:09:03.053904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:09:03.053904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:09:03.055078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:09:03.055078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:09:03.055078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:09:03.055078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:09:03.055078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:03.055078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:03.055078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:03.055078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:03.055078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:03.055078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:03.055078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:03.055078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:03.055078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:03.055078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:03.055078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:03.055078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:03.055999 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:03.055999 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:03.055999 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:03.055999 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:03.055999 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:09:03.055999 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:09:03.055999 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:09:03.055999 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:09:03.055999 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:09:03.055999 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:09:03.055999 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:09:03.055999 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:09:03.055999 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 567/1141] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:09:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:03.061095 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d933c-a701-4f19-8afe-cd7f82c6ffe5 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:03.078342 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:03.160264 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d933c-a701-4f19-8afe-cd7f82c6ffe5 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:03.192022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc7ef8-3b97-4b99-b141-8f3f4339bbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:03.192674 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc7ef8-3b97-4b99-b141-8f3f4339bbb0 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:03.192957 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc7ef8-3b97-4b99-b141-8f3f4339bbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:03.193232 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc7ef8-3b97-4b99-b141-8f3f4339bbb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:03.193966 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc7ef8-3b97-4b99-b141-8f3f4339bbb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:03.194273 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc7ef8-3b97-4b99-b141-8f3f4339bbb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:03.195677 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc7ef8-3b97-4b99-b141-8f3f4339bbb0 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:03.203386 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 575/1142] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:09:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:03.210225 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbac239-a34e-408f-a4fb-a6d478891439 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:03.234903 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:03.307200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbac239-a34e-408f-a4fb-a6d478891439 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:03.339324 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b61d9-34dc-4d3a-b747-7213acafd3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:03.340175 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b61d9-34dc-4d3a-b747-7213acafd3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:03.340452 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b61d9-34dc-4d3a-b747-7213acafd3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:03.340719 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b61d9-34dc-4d3a-b747-7213acafd3b2 None admin] PATH_INFO: `/v3/users/d44c77174a2b42ef9b6d9f74b44551fd` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:03.353948 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b61d9-34dc-4d3a-b747-7213acafd3b2 None admin] RBAC: Authorizing `identity:get_user(user_id=d44c77174a2b42ef9b6d9f74b44551fd)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:03.355408 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b61d9-34dc-4d3a-b747-7213acafd3b2 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:03.357024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 568/1143] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:09:03 2022] GET /identity/v3/users/d44c77174a2b42ef9b6d9f74b44551fd => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:03.362879 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc7ef8-3b97-4b99-b141-8f3f4339bbb0 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:03.440513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:03.462042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc7ef8-3b97-4b99-b141-8f3f4339bbb0 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:03.493363 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651821ad-bf4d-4eb5-bbfa-d000892b4e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:03.493997 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651821ad-bf4d-4eb5-bbfa-d000892b4e71 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:03.494278 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651821ad-bf4d-4eb5-bbfa-d000892b4e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:03.494556 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651821ad-bf4d-4eb5-bbfa-d000892b4e71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:03.558331 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651821ad-bf4d-4eb5-bbfa-d000892b4e71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:03.559747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651821ad-bf4d-4eb5-bbfa-d000892b4e71 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:03.632935 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:03.654609 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 576/1144] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:09:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:09:03.660692 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b61d9-34dc-4d3a-b747-7213acafd3b2 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:03.738418 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:03.757764 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b61d9-34dc-4d3a-b747-7213acafd3b2 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:03.790094 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed0f66a-9ebc-4414-8901-20e9122d1b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:03.790985 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0f66a-9ebc-4414-8901-20e9122d1b72 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:03.791265 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0f66a-9ebc-4414-8901-20e9122d1b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:03.791535 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0f66a-9ebc-4414-8901-20e9122d1b72 None admin] PATH_INFO: `/v3/projects/e8dfed24a2d14c11be7615afc6ca9ca9` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:03.792680 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed0f66a-9ebc-4414-8901-20e9122d1b72 None admin] RBAC: Authorizing `identity:get_project(project_id=e8dfed24a2d14c11be7615afc6ca9ca9)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:03.794093 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed0f66a-9ebc-4414-8901-20e9122d1b72 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:03.795803 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 569/1145] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:09:03 2022] GET /identity/v3/projects/e8dfed24a2d14c11be7615afc6ca9ca9 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:03.802398 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651821ad-bf4d-4eb5-bbfa-d000892b4e71 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:03.896244 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651821ad-bf4d-4eb5-bbfa-d000892b4e71 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:03.928698 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b7566-bfa8-4f8f-ad40-c1c31cb32c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:03.929327 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b7566-bfa8-4f8f-ad40-c1c31cb32c05 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:03.929609 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b7566-bfa8-4f8f-ad40-c1c31cb32c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:03.929883 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b7566-bfa8-4f8f-ad40-c1c31cb32c05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:03.930726 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b7566-bfa8-4f8f-ad40-c1c31cb32c05 None admin] RBAC: Adding query filter params (role.id=5ef3464f4436446b88430cdf7cc1a3d7, scope.project.id=e8dfed24a2d14c11be7615afc6ca9ca9, user.id=d44c77174a2b42ef9b6d9f74b44551fd) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:03.931042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b7566-bfa8-4f8f-ad40-c1c31cb32c05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:03.932453 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b7566-bfa8-4f8f-ad40-c1c31cb32c05 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:03.937600 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 577/1146] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:09:03 2022] GET /identity/v3/role_assignments?user.id=d44c77174a2b42ef9b6d9f74b44551fd&scope.project.id=e8dfed24a2d14c11be7615afc6ca9ca9&role.id=5ef3464f4436446b88430cdf7cc1a3d7 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:05.929734 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67074c11-96ae-4cfd-a33f-2a61090a034c None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:05.930252 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67074c11-96ae-4cfd-a33f-2a61090a034c None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:05.930339 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67074c11-96ae-4cfd-a33f-2a61090a034c None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:05.931701 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 570/1147] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:05.937183 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b89a0c-c40a-4391-89f3-7045a054a875 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:05.937607 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b89a0c-c40a-4391-89f3-7045a054a875 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:05.937730 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b89a0c-c40a-4391-89f3-7045a054a875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:05.954843 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-d8b89a0c-c40a-4391-89f3-7045a054a875 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:05.956009 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-d8b89a0c-c40a-4391-89f3-7045a054a875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:05.989964 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:06.019730 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 578/1148] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:06.042708 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67074c11-96ae-4cfd-a33f-2a61090a034c None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:06.138813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67074c11-96ae-4cfd-a33f-2a61090a034c None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:06.171781 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938d352-f43f-4b63-92ec-db87a71850c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:06.172641 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938d352-f43f-4b63-92ec-db87a71850c7 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:06.172927 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938d352-f43f-4b63-92ec-db87a71850c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:06.173197 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938d352-f43f-4b63-92ec-db87a71850c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:06.183103 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938d352-f43f-4b63-92ec-db87a71850c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:09:06.190572 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-d938d352-f43f-4b63-92ec-db87a71850c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:09:06.190572 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:06.190572 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:06.190572 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:06.190572 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:06.190572 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:06.190572 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:06.190572 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:06.190572 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:06.190572 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:06.190572 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:06.190572 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:06.190572 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:09:06.190572 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:09:06.190572 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:09:06.190572 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:09:06.191803 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:09:06.191803 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:09:06.191803 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:09:06.191803 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:09:06.191803 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:06.191803 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:06.191803 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:06.191803 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:06.191803 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:06.191803 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:06.191803 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:06.191803 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:06.191803 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:06.191803 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:06.191803 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:06.191803 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:06.192976 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:06.192976 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:06.192976 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:06.192976 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:06.192976 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:09:06.192976 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:09:06.192976 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:09:06.192976 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:09:06.192976 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:09:06.192976 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:09:06.192976 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:09:06.192976 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:09:06.192976 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 571/1149] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:09:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:06.197632 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b89a0c-c40a-4391-89f3-7045a054a875 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:06.297622 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b89a0c-c40a-4391-89f3-7045a054a875 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:06.330272 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25fa7a1-fab3-4b61-93ec-4e55c66473d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:06.330971 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fa7a1-fab3-4b61-93ec-4e55c66473d9 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:06.331289 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fa7a1-fab3-4b61-93ec-4e55c66473d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:06.331605 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fa7a1-fab3-4b61-93ec-4e55c66473d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:06.332379 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25fa7a1-fab3-4b61-93ec-4e55c66473d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:06.332742 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25fa7a1-fab3-4b61-93ec-4e55c66473d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:06.334136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25fa7a1-fab3-4b61-93ec-4e55c66473d9 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:06.341965 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 579/1150] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:09:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:06.348420 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938d352-f43f-4b63-92ec-db87a71850c7 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:06.359503 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:06.447737 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938d352-f43f-4b63-92ec-db87a71850c7 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:06.479943 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61125a9-aa06-44ff-a2d0-f180c5b78564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:06.480798 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61125a9-aa06-44ff-a2d0-f180c5b78564 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:06.481082 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61125a9-aa06-44ff-a2d0-f180c5b78564 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:06.481358 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61125a9-aa06-44ff-a2d0-f180c5b78564 None admin] PATH_INFO: `/v3/users/d44c77174a2b42ef9b6d9f74b44551fd` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:06.482526 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61125a9-aa06-44ff-a2d0-f180c5b78564 None admin] RBAC: Authorizing `identity:get_user(user_id=d44c77174a2b42ef9b6d9f74b44551fd)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:06.483992 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61125a9-aa06-44ff-a2d0-f180c5b78564 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:06.486203 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 572/1151] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:09:06 2022] GET /identity/v3/users/d44c77174a2b42ef9b6d9f74b44551fd => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:06.492119 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25fa7a1-fab3-4b61-93ec-4e55c66473d9 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:06.524950 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:06.588646 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25fa7a1-fab3-4b61-93ec-4e55c66473d9 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:06.621130 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a0c5f-c817-4aa3-8003-dee618034fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:06.622000 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a0c5f-c817-4aa3-8003-dee618034fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:06.622289 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a0c5f-c817-4aa3-8003-dee618034fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:06.622567 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a0c5f-c817-4aa3-8003-dee618034fc4 None admin] PATH_INFO: `/v3/projects/e8dfed24a2d14c11be7615afc6ca9ca9` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:06.623765 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a0c5f-c817-4aa3-8003-dee618034fc4 None admin] RBAC: Authorizing `identity:get_project(project_id=e8dfed24a2d14c11be7615afc6ca9ca9)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:06.625204 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a0c5f-c817-4aa3-8003-dee618034fc4 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:06.626940 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 580/1152] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:09:06 2022] GET /identity/v3/projects/e8dfed24a2d14c11be7615afc6ca9ca9 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:06.632944 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61125a9-aa06-44ff-a2d0-f180c5b78564 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:06.707357 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:06.732197 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61125a9-aa06-44ff-a2d0-f180c5b78564 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:06.764829 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371f98b-0820-454f-9f55-dab2cf6f1a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:06.765708 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371f98b-0820-454f-9f55-dab2cf6f1a4b None admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:06.765991 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371f98b-0820-454f-9f55-dab2cf6f1a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:06.766819 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371f98b-0820-454f-9f55-dab2cf6f1a4b None admin] PATH_INFO: `/v3/projects/e8dfed24a2d14c11be7615afc6ca9ca9/users/d44c77174a2b42ef9b6d9f74b44551fd/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:06.768755 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371f98b-0820-454f-9f55-dab2cf6f1a4b None admin] RBAC: Authorizing `identity:create_grant(project_id=e8dfed24a2d14c11be7615afc6ca9ca9, user_id=d44c77174a2b42ef9b6d9f74b44551fd, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:06.770181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371f98b-0820-454f-9f55-dab2cf6f1a4b None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:06.783485 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 573/1153] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 29 12:09:06 2022] PUT /identity/v3/projects/e8dfed24a2d14c11be7615afc6ca9ca9/users/d44c77174a2b42ef9b6d9f74b44551fd/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:09:08.765413 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713d20a-279a-4306-980f-0b726208b7da None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:08.765901 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713d20a-279a-4306-980f-0b726208b7da None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:08.766003 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713d20a-279a-4306-980f-0b726208b7da None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:08.767998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 581/1154] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:09:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:08.773061 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6036a7e-b565-421c-8753-fbeb9a2eb582 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:08.773443 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6036a7e-b565-421c-8753-fbeb9a2eb582 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:08.773612 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6036a7e-b565-421c-8753-fbeb9a2eb582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:08.790650 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-c6036a7e-b565-421c-8753-fbeb9a2eb582 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:08.791827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-c6036a7e-b565-421c-8753-fbeb9a2eb582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:08.854843 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 574/1155] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:08.882300 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713d20a-279a-4306-980f-0b726208b7da None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:08.982591 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713d20a-279a-4306-980f-0b726208b7da None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:08.984054 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:09.017559 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45b1a6-f87e-423a-a89a-02ae8efc6cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:09.018336 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45b1a6-f87e-423a-a89a-02ae8efc6cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:09.018619 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45b1a6-f87e-423a-a89a-02ae8efc6cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:09.018924 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45b1a6-f87e-423a-a89a-02ae8efc6cd7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:09.028609 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45b1a6-f87e-423a-a89a-02ae8efc6cd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:09:09.036370 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-0f45b1a6-f87e-423a-a89a-02ae8efc6cd7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:09:09.036370 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:09.036370 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:09.036370 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:09.036370 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:09.036370 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:09.036370 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:09.036370 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:09.036370 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:09.036370 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:09.036370 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:09.036370 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:09.036370 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:09:09.036370 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:09:09.036370 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:09:09.036370 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:09:09.037465 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:09:09.037465 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:09:09.037465 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:09:09.037465 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:09:09.037465 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:09.037465 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:09.037465 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:09.037465 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:09.037465 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:09.037465 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:09.037465 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:09.037465 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:09.037465 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:09.037465 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:09.037465 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:09.037465 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:09.038517 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:09.038517 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:09.038517 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:09.038517 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:09.038517 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:09:09.038517 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:09:09.038517 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:09:09.038517 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:09:09.038517 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:09:09.038517 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:09:09.038517 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:09:09.038517 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:09:09.038517 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 582/1156] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:09:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:09.043486 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6036a7e-b565-421c-8753-fbeb9a2eb582 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:09.105834 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:09.142851 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6036a7e-b565-421c-8753-fbeb9a2eb582 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:09.176196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda96e05-1e1a-4126-8aca-a1a3caa94c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:09.176859 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda96e05-1e1a-4126-8aca-a1a3caa94c25 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:09.177145 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda96e05-1e1a-4126-8aca-a1a3caa94c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:09.177423 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda96e05-1e1a-4126-8aca-a1a3caa94c25 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:09.178165 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda96e05-1e1a-4126-8aca-a1a3caa94c25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:09.178476 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda96e05-1e1a-4126-8aca-a1a3caa94c25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:09.179875 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda96e05-1e1a-4126-8aca-a1a3caa94c25 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:09.187744 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 575/1157] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:09:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:09:09.193981 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45b1a6-f87e-423a-a89a-02ae8efc6cd7 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:09.290310 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45b1a6-f87e-423a-a89a-02ae8efc6cd7 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:09.323933 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf0b59-665c-4b3d-935a-e2024c4ed3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:09.324788 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf0b59-665c-4b3d-935a-e2024c4ed3f9 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:09.325070 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf0b59-665c-4b3d-935a-e2024c4ed3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:09.325345 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf0b59-665c-4b3d-935a-e2024c4ed3f9 None admin] PATH_INFO: `/v3/users/d44c77174a2b42ef9b6d9f74b44551fd` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:09.326514 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf0b59-665c-4b3d-935a-e2024c4ed3f9 None admin] RBAC: Authorizing `identity:get_user(user_id=d44c77174a2b42ef9b6d9f74b44551fd)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:09.328010 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf0b59-665c-4b3d-935a-e2024c4ed3f9 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:09.329618 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 583/1158] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:09:09 2022] GET /identity/v3/users/d44c77174a2b42ef9b6d9f74b44551fd => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:09.335263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda96e05-1e1a-4126-8aca-a1a3caa94c25 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:09.431636 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda96e05-1e1a-4126-8aca-a1a3caa94c25 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:09.455923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:09.463739 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b182d9-0431-4574-9614-b7b0682a2983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:09.464380 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b182d9-0431-4574-9614-b7b0682a2983 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:09.464657 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b182d9-0431-4574-9614-b7b0682a2983 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:09.464926 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b182d9-0431-4574-9614-b7b0682a2983 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:09.530798 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b182d9-0431-4574-9614-b7b0682a2983 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:09.532260 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b182d9-0431-4574-9614-b7b0682a2983 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:09.626470 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 576/1159] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:09:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:09:09.632274 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf0b59-665c-4b3d-935a-e2024c4ed3f9 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:09.662533 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:09.732390 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf0b59-665c-4b3d-935a-e2024c4ed3f9 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:09.765287 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c06f25-1122-4a8a-ae2a-66d6c60518a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:09.766131 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c06f25-1122-4a8a-ae2a-66d6c60518a5 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:09.766667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c06f25-1122-4a8a-ae2a-66d6c60518a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:09.766762 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c06f25-1122-4a8a-ae2a-66d6c60518a5 None admin] PATH_INFO: `/v3/projects/e8dfed24a2d14c11be7615afc6ca9ca9` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:09.767836 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c06f25-1122-4a8a-ae2a-66d6c60518a5 None admin] RBAC: Authorizing `identity:get_project(project_id=e8dfed24a2d14c11be7615afc6ca9ca9)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:09.769262 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c06f25-1122-4a8a-ae2a-66d6c60518a5 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:09.770963 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 584/1160] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:09:09 2022] GET /identity/v3/projects/e8dfed24a2d14c11be7615afc6ca9ca9 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:09.776962 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b182d9-0431-4574-9614-b7b0682a2983 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:09.804532 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:09.873604 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b182d9-0431-4574-9614-b7b0682a2983 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:09.906383 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254b71a-a041-4c74-85be-5ea598590134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:09.907007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254b71a-a041-4c74-85be-5ea598590134 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:09.907289 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254b71a-a041-4c74-85be-5ea598590134 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:09.907562 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254b71a-a041-4c74-85be-5ea598590134 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:09.908391 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254b71a-a041-4c74-85be-5ea598590134 None admin] RBAC: Adding query filter params (role.id=5ef3464f4436446b88430cdf7cc1a3d7, scope.project.id=e8dfed24a2d14c11be7615afc6ca9ca9, user.id=d44c77174a2b42ef9b6d9f74b44551fd) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:09.908701 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254b71a-a041-4c74-85be-5ea598590134 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:09.910381 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254b71a-a041-4c74-85be-5ea598590134 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:09.916111 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 577/1161] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:09:09 2022] GET /identity/v3/role_assignments?user.id=d44c77174a2b42ef9b6d9f74b44551fd&scope.project.id=e8dfed24a2d14c11be7615afc6ca9ca9&role.id=5ef3464f4436446b88430cdf7cc1a3d7 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:12.013419 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4087b-c143-4423-b595-8cc28e698ead None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:12.013939 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4087b-c143-4423-b595-8cc28e698ead None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:12.013939 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4087b-c143-4423-b595-8cc28e698ead None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:12.015277 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 585/1162] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:12.020877 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30dd48-6b84-423a-91ef-456e228bbc6a None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:12.021315 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30dd48-6b84-423a-91ef-456e228bbc6a None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:12.021419 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30dd48-6b84-423a-91ef-456e228bbc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:12.038617 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-7a30dd48-6b84-423a-91ef-456e228bbc6a None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:12.039818 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-7a30dd48-6b84-423a-91ef-456e228bbc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:12.103026 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 578/1163] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:12.125136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba4087b-c143-4423-b595-8cc28e698ead None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:12.218776 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:12.224319 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba4087b-c143-4423-b595-8cc28e698ead None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:12.256463 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032ccdd-beb8-49c7-9b45-e4926153220f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:12.257114 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032ccdd-beb8-49c7-9b45-e4926153220f None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:12.257401 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032ccdd-beb8-49c7-9b45-e4926153220f None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:12.257680 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032ccdd-beb8-49c7-9b45-e4926153220f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:12.326321 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032ccdd-beb8-49c7-9b45-e4926153220f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:12.327740 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032ccdd-beb8-49c7-9b45-e4926153220f None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:12.418235 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:12.423768 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 586/1164] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:09:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:09:12.429487 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30dd48-6b84-423a-91ef-456e228bbc6a None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:12.452228 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:12.527345 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30dd48-6b84-423a-91ef-456e228bbc6a None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:12.564544 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec8ec99-fdaa-4022-b975-8abf037fe1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:12.565340 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8ec99-fdaa-4022-b975-8abf037fe1d1 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:12.565617 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8ec99-fdaa-4022-b975-8abf037fe1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:12.565885 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8ec99-fdaa-4022-b975-8abf037fe1d1 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:12.572310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec8ec99-fdaa-4022-b975-8abf037fe1d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:12.573734 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec8ec99-fdaa-4022-b975-8abf037fe1d1 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:12.589504 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-5ec8ec99-fdaa-4022-b975-8abf037fe1d1 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 29 12:09:12.589504 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:12.589504 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 29 12:09:12.589504 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 29 12:09:12.589504 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:09:12.589504 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:09:12.589504 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:09:12.589504 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:09:12.589504 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 29 12:09:12.589504 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:09:12.589504 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:09:12.589504 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:09:12.589504 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:12.589504 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:12.589504 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:12.589504 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:12.589504 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:12.590754 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:12.590754 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:12.590754 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:12.590754 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:12.590754 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:12.590754 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:12.590754 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:09:12.590754 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:09:12.590754 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:09:12.590754 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:09:12.590754 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:12.590754 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:12.590754 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:12.590754 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:12.590754 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:12.590754 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:12.591829 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:12.591829 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:12.591829 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:12.591829 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:12.591829 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:12.591829 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:12.591829 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:12.591829 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:12.591829 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:12.591829 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:12.591829 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 29 12:09:12.591829 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:09:12.591829 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 29 12:09:12.591829 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:09:12.591829 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 579/1165] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Jun 29 12:09:12 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:12.597130 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032ccdd-beb8-49c7-9b45-e4926153220f None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:12.692369 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032ccdd-beb8-49c7-9b45-e4926153220f None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:12.726119 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6b786-b1dc-406f-aad7-c54b6aac852b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:12.726810 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6b786-b1dc-406f-aad7-c54b6aac852b None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:12.727100 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6b786-b1dc-406f-aad7-c54b6aac852b None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:12.727377 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6b786-b1dc-406f-aad7-c54b6aac852b None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:12.728090 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6b786-b1dc-406f-aad7-c54b6aac852b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:12.728398 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6b786-b1dc-406f-aad7-c54b6aac852b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:12.729773 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6b786-b1dc-406f-aad7-c54b6aac852b None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:12.737695 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 587/1166] 10.222.0.13 () {56 vars in 1115 bytes} [Wed Jun 29 12:09:12 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:14.826457 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ca828-0d20-4e61-af37-b8d7a18f59e4 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:14.827035 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ca828-0d20-4e61-af37-b8d7a18f59e4 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:14.827035 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ca828-0d20-4e61-af37-b8d7a18f59e4 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:14.829089 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 580/1167] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:09:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:14.834163 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3836c3-73e8-45f0-b6cb-2b2a0782bf4f None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:14.834568 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3836c3-73e8-45f0-b6cb-2b2a0782bf4f None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:14.834747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3836c3-73e8-45f0-b6cb-2b2a0782bf4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:14.853154 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-7b3836c3-73e8-45f0-b6cb-2b2a0782bf4f None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:14.854311 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-7b3836c3-73e8-45f0-b6cb-2b2a0782bf4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:14.913253 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:14.923956 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 588/1168] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:14.947875 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ca828-0d20-4e61-af37-b8d7a18f59e4 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:15.032137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:15.051257 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ca828-0d20-4e61-af37-b8d7a18f59e4 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:15.085830 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939e8d7-1f95-4377-968a-800e27381404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:15.086486 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939e8d7-1f95-4377-968a-800e27381404 None admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:15.086807 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939e8d7-1f95-4377-968a-800e27381404 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:15.087079 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939e8d7-1f95-4377-968a-800e27381404 None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:15.087827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939e8d7-1f95-4377-968a-800e27381404 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:15.089194 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939e8d7-1f95-4377-968a-800e27381404 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:15.103580 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 581/1169] 10.222.0.13 () {60 vars in 1138 bytes} [Wed Jun 29 12:09:14 2022] POST /identity/v3/domains => generated 267 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:09:17.190115 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e4611-e213-4b0a-91c6-b4b63152f0f0 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:17.190706 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e4611-e213-4b0a-91c6-b4b63152f0f0 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:17.190706 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e4611-e213-4b0a-91c6-b4b63152f0f0 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:17.192081 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 589/1170] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:17.197319 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32426b0-b7fe-4168-99e0-b194307ab255 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:17.197729 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32426b0-b7fe-4168-99e0-b194307ab255 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:17.197875 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32426b0-b7fe-4168-99e0-b194307ab255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:17.215452 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-b32426b0-b7fe-4168-99e0-b194307ab255 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:17.216640 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-b32426b0-b7fe-4168-99e0-b194307ab255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:17.287830 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 582/1171] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:17.311498 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e4611-e213-4b0a-91c6-b4b63152f0f0 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:17.414327 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e4611-e213-4b0a-91c6-b4b63152f0f0 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:17.446587 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bec1ec-706a-4d6a-a6e1-f47c4fba7b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:17.447400 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bec1ec-706a-4d6a-a6e1-f47c4fba7b87 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:17.447679 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bec1ec-706a-4d6a-a6e1-f47c4fba7b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:17.447950 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bec1ec-706a-4d6a-a6e1-f47c4fba7b87 None admin] PATH_INFO: `/v3/domains/ab41a7df81b64e0fb004c90e8012eada` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:17.458660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bec1ec-706a-4d6a-a6e1-f47c4fba7b87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ab41a7df81b64e0fb004c90e8012eada)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:17.460115 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bec1ec-706a-4d6a-a6e1-f47c4fba7b87 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:17.461754 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 590/1172] 10.222.0.13 () {56 vars in 1183 bytes} [Wed Jun 29 12:09:17 2022] GET /identity/v3/domains/ab41a7df81b64e0fb004c90e8012eada => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:17.467799 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32426b0-b7fe-4168-99e0-b194307ab255 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:17.548638 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:17.584707 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32426b0-b7fe-4168-99e0-b194307ab255 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:17.620587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e170a-7a54-4015-9bef-4fa9975f3724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:17.621239 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e170a-7a54-4015-9bef-4fa9975f3724 None admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:17.621518 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e170a-7a54-4015-9bef-4fa9975f3724 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:17.621789 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e170a-7a54-4015-9bef-4fa9975f3724 None admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:17.622495 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e170a-7a54-4015-9bef-4fa9975f3724 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:17.623951 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e170a-7a54-4015-9bef-4fa9975f3724 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:17.649601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 583/1173] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Jun 29 12:09:17 2022] POST /identity/v3/projects => generated 361 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:09:19.717021 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b872609-738e-43c7-b812-01b8888ac67a None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:19.717574 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b872609-738e-43c7-b812-01b8888ac67a None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:19.717574 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b872609-738e-43c7-b812-01b8888ac67a None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:19.719525 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 591/1174] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:09:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:19.724676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3701db-a1f4-4176-9b58-96a9afe8ea95 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:19.725101 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3701db-a1f4-4176-9b58-96a9afe8ea95 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:19.725229 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3701db-a1f4-4176-9b58-96a9afe8ea95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:19.741699 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-7f3701db-a1f4-4176-9b58-96a9afe8ea95 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:19.742904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-7f3701db-a1f4-4176-9b58-96a9afe8ea95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:19.807481 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 584/1175] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:19.832472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b872609-738e-43c7-b812-01b8888ac67a None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:19.884629 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:19.931761 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b872609-738e-43c7-b812-01b8888ac67a None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:19.963775 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1388d-31c5-4675-acf9-c7a2072eca15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:19.964626 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1388d-31c5-4675-acf9-c7a2072eca15 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:19.964908 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1388d-31c5-4675-acf9-c7a2072eca15 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:19.965179 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1388d-31c5-4675-acf9-c7a2072eca15 None admin] PATH_INFO: `/v3/domains/ab41a7df81b64e0fb004c90e8012eada` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:19.966333 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d1388d-31c5-4675-acf9-c7a2072eca15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ab41a7df81b64e0fb004c90e8012eada)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:19.967850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d1388d-31c5-4675-acf9-c7a2072eca15 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:19.970011 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 592/1176] 10.222.0.13 () {56 vars in 1183 bytes} [Wed Jun 29 12:09:19 2022] GET /identity/v3/domains/ab41a7df81b64e0fb004c90e8012eada => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:19.975707 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3701db-a1f4-4176-9b58-96a9afe8ea95 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:20.029392 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:20.073052 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3701db-a1f4-4176-9b58-96a9afe8ea95 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:20.105475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1847cb9-72a3-47a5-a301-90ea3df1bb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:20.106143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1847cb9-72a3-47a5-a301-90ea3df1bb26 None admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:20.106428 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1847cb9-72a3-47a5-a301-90ea3df1bb26 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:20.106737 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1847cb9-72a3-47a5-a301-90ea3df1bb26 None admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:20.107456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1847cb9-72a3-47a5-a301-90ea3df1bb26 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:20.108892 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1847cb9-72a3-47a5-a301-90ea3df1bb26 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:20.129798 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 585/1177] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 29 12:09:19 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:09:22.232204 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bfd80-8e85-4fc4-a54d-b936080c1d96 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:22.232773 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bfd80-8e85-4fc4-a54d-b936080c1d96 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:22.232773 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bfd80-8e85-4fc4-a54d-b936080c1d96 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:22.234178 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 593/1178] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:22.239366 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4c65f-4607-4599-a51a-6a731a4dceec None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:22.239757 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4c65f-4607-4599-a51a-6a731a4dceec None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:22.239923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4c65f-4607-4599-a51a-6a731a4dceec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:22.256711 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-eee4c65f-4607-4599-a51a-6a731a4dceec None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:22.257891 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-eee4c65f-4607-4599-a51a-6a731a4dceec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:22.328406 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 586/1179] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:09:22.352853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3bfd80-8e85-4fc4-a54d-b936080c1d96 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:22.453499 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3bfd80-8e85-4fc4-a54d-b936080c1d96 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:22.472893 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:22.487659 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90281ba-e507-421e-b4a4-f127d1f23c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:22.488382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90281ba-e507-421e-b4a4-f127d1f23c22 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:22.488661 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90281ba-e507-421e-b4a4-f127d1f23c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:22.488932 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90281ba-e507-421e-b4a4-f127d1f23c22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:22.498568 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90281ba-e507-421e-b4a4-f127d1f23c22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:09:22.507257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-b90281ba-e507-421e-b4a4-f127d1f23c22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:09:22.507257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:22.507257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:22.507257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:22.507257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:22.507257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:22.507257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:22.507257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:22.507257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:22.507257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:22.507257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:22.507257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:22.507257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:09:22.507257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:09:22.507257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:09:22.507257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:09:22.508444 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:09:22.508444 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:09:22.508444 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:09:22.508444 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:09:22.508444 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:22.508444 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:22.508444 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:22.508444 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:22.508444 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:22.508444 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:22.508444 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:22.508444 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:22.508444 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:22.508444 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:22.508444 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:22.508444 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:22.509560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:22.509560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:22.509560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:22.509560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:22.509560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:09:22.509560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:09:22.509560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:09:22.509560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:09:22.509560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:09:22.509560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:09:22.509560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:09:22.509560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:09:22.509560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 594/1180] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:09:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:22.514487 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4c65f-4607-4599-a51a-6a731a4dceec None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:22.555287 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:22.612500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4c65f-4607-4599-a51a-6a731a4dceec None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:22.645100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987de26-0d6b-443a-8e0f-bba02e88cc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:22.645764 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987de26-0d6b-443a-8e0f-bba02e88cc55 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:22.646053 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987de26-0d6b-443a-8e0f-bba02e88cc55 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:22.646328 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987de26-0d6b-443a-8e0f-bba02e88cc55 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:22.647096 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987de26-0d6b-443a-8e0f-bba02e88cc55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:22.647404 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987de26-0d6b-443a-8e0f-bba02e88cc55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:22.648775 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987de26-0d6b-443a-8e0f-bba02e88cc55 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:22.657295 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 587/1181] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:09:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:22.663456 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90281ba-e507-421e-b4a4-f127d1f23c22 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:22.762424 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90281ba-e507-421e-b4a4-f127d1f23c22 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:22.795727 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf131f9-a793-4453-86de-3224025b0b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:22.796665 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf131f9-a793-4453-86de-3224025b0b4e None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:22.796947 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf131f9-a793-4453-86de-3224025b0b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:22.797221 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf131f9-a793-4453-86de-3224025b0b4e None admin] PATH_INFO: `/v3/users/1a80b296d2e04074bf4b28fea8c5b4d2` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:22.810790 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf131f9-a793-4453-86de-3224025b0b4e None admin] RBAC: Authorizing `identity:get_user(user_id=1a80b296d2e04074bf4b28fea8c5b4d2)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:22.812300 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf131f9-a793-4453-86de-3224025b0b4e None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:22.813939 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 595/1182] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:09:22 2022] GET /identity/v3/users/1a80b296d2e04074bf4b28fea8c5b4d2 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:22.819688 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987de26-0d6b-443a-8e0f-bba02e88cc55 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:22.918272 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987de26-0d6b-443a-8e0f-bba02e88cc55 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:22.919800 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:22.951592 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce363b6-0d70-4dd0-a1a3-1902d7a5fadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:22.952238 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce363b6-0d70-4dd0-a1a3-1902d7a5fadb None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:22.952524 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce363b6-0d70-4dd0-a1a3-1902d7a5fadb None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:22.953333 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce363b6-0d70-4dd0-a1a3-1902d7a5fadb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:23.018394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce363b6-0d70-4dd0-a1a3-1902d7a5fadb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:23.019796 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce363b6-0d70-4dd0-a1a3-1902d7a5fadb None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:23.113744 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 588/1183] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:09:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:09:23.119877 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf131f9-a793-4453-86de-3224025b0b4e None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:23.159292 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:23.218653 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf131f9-a793-4453-86de-3224025b0b4e None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:23.251307 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227489e7-62fc-41b9-aafb-f9057ca36706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:23.252156 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227489e7-62fc-41b9-aafb-f9057ca36706 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:23.252431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227489e7-62fc-41b9-aafb-f9057ca36706 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:23.252702 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227489e7-62fc-41b9-aafb-f9057ca36706 None admin] PATH_INFO: `/v3/projects/209cc00c6b934d44b3c03559b3d3dd95` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:23.253841 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227489e7-62fc-41b9-aafb-f9057ca36706 None admin] RBAC: Authorizing `identity:get_project(project_id=209cc00c6b934d44b3c03559b3d3dd95)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:23.255387 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227489e7-62fc-41b9-aafb-f9057ca36706 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:23.257062 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 596/1184] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:09:23 2022] GET /identity/v3/projects/209cc00c6b934d44b3c03559b3d3dd95 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:23.263176 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce363b6-0d70-4dd0-a1a3-1902d7a5fadb None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:23.265327 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:23.362963 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce363b6-0d70-4dd0-a1a3-1902d7a5fadb None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:23.396285 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6dbd2-33fe-4579-9062-4f87f6493aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:23.396932 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6dbd2-33fe-4579-9062-4f87f6493aef None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:23.397217 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6dbd2-33fe-4579-9062-4f87f6493aef None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:23.397492 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6dbd2-33fe-4579-9062-4f87f6493aef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:23.398326 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6dbd2-33fe-4579-9062-4f87f6493aef None admin] RBAC: Adding query filter params (role.id=5ef3464f4436446b88430cdf7cc1a3d7, scope.project.id=209cc00c6b934d44b3c03559b3d3dd95, user.id=1a80b296d2e04074bf4b28fea8c5b4d2) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:23.398667 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6dbd2-33fe-4579-9062-4f87f6493aef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:23.400103 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6dbd2-33fe-4579-9062-4f87f6493aef None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:23.405412 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 589/1185] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:09:23 2022] GET /identity/v3/role_assignments?user.id=1a80b296d2e04074bf4b28fea8c5b4d2&scope.project.id=209cc00c6b934d44b3c03559b3d3dd95&role.id=5ef3464f4436446b88430cdf7cc1a3d7 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:09:25.402118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d15ac1-1024-4b6d-894f-8d7b8fbd9664 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:25.402701 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d15ac1-1024-4b6d-894f-8d7b8fbd9664 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:25.402701 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d15ac1-1024-4b6d-894f-8d7b8fbd9664 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:25.404036 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 597/1186] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:25.410398 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40387f0-7d4e-421c-b81c-04ee8915da66 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:25.410837 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40387f0-7d4e-421c-b81c-04ee8915da66 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:25.410969 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40387f0-7d4e-421c-b81c-04ee8915da66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:25.427879 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-d40387f0-7d4e-421c-b81c-04ee8915da66 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:25.429039 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-d40387f0-7d4e-421c-b81c-04ee8915da66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:25.486113 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:25.493560 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 590/1187] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:09:25.516154 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d15ac1-1024-4b6d-894f-8d7b8fbd9664 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:25.615342 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d15ac1-1024-4b6d-894f-8d7b8fbd9664 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:25.622367 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:25.648345 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfcbbe-ff74-46ad-8fd4-488c1bd69ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:25.649125 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfcbbe-ff74-46ad-8fd4-488c1bd69ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:25.649407 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfcbbe-ff74-46ad-8fd4-488c1bd69ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:25.649681 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfcbbe-ff74-46ad-8fd4-488c1bd69ec6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:25.660345 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bfcbbe-ff74-46ad-8fd4-488c1bd69ec6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:09:25.667769 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-a2bfcbbe-ff74-46ad-8fd4-488c1bd69ec6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:09:25.667769 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:25.667769 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:25.667769 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:25.667769 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:25.667769 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:25.667769 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:25.667769 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:25.667769 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:25.667769 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:25.667769 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:25.667769 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:25.667769 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:09:25.667769 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:09:25.667769 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:09:25.667769 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:09:25.668885 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:09:25.668885 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:09:25.668885 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:09:25.668885 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:09:25.668885 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:25.668885 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:25.668885 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:25.668885 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:25.668885 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:25.668885 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:25.668885 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:25.668885 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:25.668885 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:25.668885 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:25.668885 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:25.668885 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:25.670088 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:25.670088 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:25.670088 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:25.670088 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:25.670088 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:09:25.670088 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:09:25.670088 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:09:25.670088 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:09:25.670088 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:09:25.670088 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:09:25.670088 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:09:25.670088 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:09:25.670088 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 598/1188] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:09:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:25.675423 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40387f0-7d4e-421c-b81c-04ee8915da66 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:25.772701 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40387f0-7d4e-421c-b81c-04ee8915da66 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:25.805304 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110ff61-a4e1-4353-9714-cec03219eac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:25.805956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110ff61-a4e1-4353-9714-cec03219eac4 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:25.806238 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110ff61-a4e1-4353-9714-cec03219eac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:25.806510 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110ff61-a4e1-4353-9714-cec03219eac4 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:25.807269 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110ff61-a4e1-4353-9714-cec03219eac4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:25.807574 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110ff61-a4e1-4353-9714-cec03219eac4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:25.808929 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110ff61-a4e1-4353-9714-cec03219eac4 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:25.816679 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 591/1189] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:09:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:25.822624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfcbbe-ff74-46ad-8fd4-488c1bd69ec6 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:25.918684 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfcbbe-ff74-46ad-8fd4-488c1bd69ec6 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:25.950603 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78bae9-2280-4fa3-b2bf-c2497238a6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:25.951501 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78bae9-2280-4fa3-b2bf-c2497238a6ff None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:25.951780 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78bae9-2280-4fa3-b2bf-c2497238a6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:25.952051 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78bae9-2280-4fa3-b2bf-c2497238a6ff None admin] PATH_INFO: `/v3/users/1a80b296d2e04074bf4b28fea8c5b4d2` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:25.953752 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78bae9-2280-4fa3-b2bf-c2497238a6ff None admin] RBAC: Authorizing `identity:get_user(user_id=1a80b296d2e04074bf4b28fea8c5b4d2)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:25.955202 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78bae9-2280-4fa3-b2bf-c2497238a6ff None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:25.957274 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 599/1190] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:09:25 2022] GET /identity/v3/users/1a80b296d2e04074bf4b28fea8c5b4d2 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:25.962964 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110ff61-a4e1-4353-9714-cec03219eac4 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:26.019449 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:26.060183 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110ff61-a4e1-4353-9714-cec03219eac4 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:26.094041 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca499d27-6349-4c8f-87e0-6836ff190cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:26.094919 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca499d27-6349-4c8f-87e0-6836ff190cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:26.095203 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca499d27-6349-4c8f-87e0-6836ff190cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:26.095478 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca499d27-6349-4c8f-87e0-6836ff190cf4 None admin] PATH_INFO: `/v3/projects/209cc00c6b934d44b3c03559b3d3dd95` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:26.096642 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca499d27-6349-4c8f-87e0-6836ff190cf4 None admin] RBAC: Authorizing `identity:get_project(project_id=209cc00c6b934d44b3c03559b3d3dd95)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:26.098078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca499d27-6349-4c8f-87e0-6836ff190cf4 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:26.099812 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 592/1191] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:09:25 2022] GET /identity/v3/projects/209cc00c6b934d44b3c03559b3d3dd95 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:26.105843 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78bae9-2280-4fa3-b2bf-c2497238a6ff None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:26.139405 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:26.204425 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78bae9-2280-4fa3-b2bf-c2497238a6ff None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:26.236210 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300225c6-9ecf-43a7-92a9-9688cd541017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:26.237078 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300225c6-9ecf-43a7-92a9-9688cd541017 None admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:26.237359 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300225c6-9ecf-43a7-92a9-9688cd541017 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:26.237631 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300225c6-9ecf-43a7-92a9-9688cd541017 None admin] PATH_INFO: `/v3/projects/209cc00c6b934d44b3c03559b3d3dd95/users/1a80b296d2e04074bf4b28fea8c5b4d2/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:26.239565 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300225c6-9ecf-43a7-92a9-9688cd541017 None admin] RBAC: Authorizing `identity:create_grant(project_id=209cc00c6b934d44b3c03559b3d3dd95, user_id=1a80b296d2e04074bf4b28fea8c5b4d2, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:26.240998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300225c6-9ecf-43a7-92a9-9688cd541017 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:26.253964 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 600/1192] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 29 12:09:26 2022] PUT /identity/v3/projects/209cc00c6b934d44b3c03559b3d3dd95/users/1a80b296d2e04074bf4b28fea8c5b4d2/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:09:28.258656 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a024152-10df-49fa-95a3-49605763865f None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:28.259203 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a024152-10df-49fa-95a3-49605763865f None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:28.259315 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a024152-10df-49fa-95a3-49605763865f None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:28.260609 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 593/1193] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:09:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:28.266492 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6b51a-87df-46a2-8270-27db06b40d52 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:28.266937 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6b51a-87df-46a2-8270-27db06b40d52 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:28.267075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6b51a-87df-46a2-8270-27db06b40d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:28.283823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-30d6b51a-87df-46a2-8270-27db06b40d52 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:28.284979 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-30d6b51a-87df-46a2-8270-27db06b40d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:28.350402 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 601/1194] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:09:28.373617 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a024152-10df-49fa-95a3-49605763865f None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:28.473488 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a024152-10df-49fa-95a3-49605763865f None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:28.497754 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:28.506948 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10df96b-4a89-4348-a987-682c09e5fe69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:28.507733 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10df96b-4a89-4348-a987-682c09e5fe69 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:28.508015 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10df96b-4a89-4348-a987-682c09e5fe69 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:28.508293 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10df96b-4a89-4348-a987-682c09e5fe69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:28.518585 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10df96b-4a89-4348-a987-682c09e5fe69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:09:28.526015 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-c10df96b-4a89-4348-a987-682c09e5fe69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:09:28.526015 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:28.526015 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:28.526015 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:28.526015 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:28.526015 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:28.526015 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:28.526015 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:28.526015 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:28.526015 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:28.526015 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:28.526015 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:28.526015 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:09:28.526015 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:09:28.526015 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:09:28.526015 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:09:28.527146 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:09:28.527146 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:09:28.527146 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:09:28.527146 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:09:28.527146 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:28.527146 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:28.527146 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:28.527146 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:28.527146 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:28.527146 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:28.527146 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:28.527146 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:28.527146 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:28.527146 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:28.527146 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:28.527146 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:28.528367 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:28.528367 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:28.528367 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:28.528367 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:28.528367 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:09:28.528367 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:09:28.528367 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:09:28.528367 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:09:28.528367 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:09:28.528367 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:09:28.528367 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:09:28.528367 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:09:28.528367 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 594/1195] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:09:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:28.533150 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6b51a-87df-46a2-8270-27db06b40d52 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:28.565461 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:28.637965 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6b51a-87df-46a2-8270-27db06b40d52 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:28.670528 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8866eee-b886-440e-9a46-caddce683484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:28.671720 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8866eee-b886-440e-9a46-caddce683484 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:28.671999 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8866eee-b886-440e-9a46-caddce683484 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:28.672274 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8866eee-b886-440e-9a46-caddce683484 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:28.673005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8866eee-b886-440e-9a46-caddce683484 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:28.673309 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8866eee-b886-440e-9a46-caddce683484 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:28.674714 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8866eee-b886-440e-9a46-caddce683484 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:28.682465 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 602/1196] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:09:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:28.688848 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10df96b-4a89-4348-a987-682c09e5fe69 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:28.808015 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10df96b-4a89-4348-a987-682c09e5fe69 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:28.847359 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988a5b5-1c3c-418c-9be0-7139d50c8548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:28.848224 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988a5b5-1c3c-418c-9be0-7139d50c8548 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:28.848506 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988a5b5-1c3c-418c-9be0-7139d50c8548 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:28.848781 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988a5b5-1c3c-418c-9be0-7139d50c8548 None admin] PATH_INFO: `/v3/users/1a80b296d2e04074bf4b28fea8c5b4d2` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:28.849951 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988a5b5-1c3c-418c-9be0-7139d50c8548 None admin] RBAC: Authorizing `identity:get_user(user_id=1a80b296d2e04074bf4b28fea8c5b4d2)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:28.851413 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988a5b5-1c3c-418c-9be0-7139d50c8548 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:28.853030 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 595/1197] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 29 12:09:28 2022] GET /identity/v3/users/1a80b296d2e04074bf4b28fea8c5b4d2 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:28.859863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8866eee-b886-440e-9a46-caddce683484 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:28.948824 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:28.963934 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8866eee-b886-440e-9a46-caddce683484 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:28.996066 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2e5cf-fc01-4645-9363-4bb52ad76580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:28.996711 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2e5cf-fc01-4645-9363-4bb52ad76580 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:28.996989 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2e5cf-fc01-4645-9363-4bb52ad76580 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:28.997255 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2e5cf-fc01-4645-9363-4bb52ad76580 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:29.063818 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2e5cf-fc01-4645-9363-4bb52ad76580 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:29.065197 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2e5cf-fc01-4645-9363-4bb52ad76580 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:29.148530 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:29.164252 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 603/1198] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:09:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 29 12:09:29.170851 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988a5b5-1c3c-418c-9be0-7139d50c8548 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:29.227527 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:29.275850 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988a5b5-1c3c-418c-9be0-7139d50c8548 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:29.309079 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38452109-e541-4f83-b792-803edc852e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:29.309921 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38452109-e541-4f83-b792-803edc852e45 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:29.310202 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38452109-e541-4f83-b792-803edc852e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:29.310472 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38452109-e541-4f83-b792-803edc852e45 None admin] PATH_INFO: `/v3/projects/209cc00c6b934d44b3c03559b3d3dd95` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:29.312265 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38452109-e541-4f83-b792-803edc852e45 None admin] RBAC: Authorizing `identity:get_project(project_id=209cc00c6b934d44b3c03559b3d3dd95)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:29.313689 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38452109-e541-4f83-b792-803edc852e45 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:29.315433 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 596/1199] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 29 12:09:29 2022] GET /identity/v3/projects/209cc00c6b934d44b3c03559b3d3dd95 => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:29.321454 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2e5cf-fc01-4645-9363-4bb52ad76580 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:29.415045 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2e5cf-fc01-4645-9363-4bb52ad76580 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:29.447638 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a8688-6ce0-4090-989d-55234815b185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:29.448275 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a8688-6ce0-4090-989d-55234815b185 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:29.448558 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a8688-6ce0-4090-989d-55234815b185 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:29.448831 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a8688-6ce0-4090-989d-55234815b185 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:29.449651 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a8688-6ce0-4090-989d-55234815b185 None admin] RBAC: Adding query filter params (role.id=5ef3464f4436446b88430cdf7cc1a3d7, scope.project.id=209cc00c6b934d44b3c03559b3d3dd95, user.id=1a80b296d2e04074bf4b28fea8c5b4d2) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:29.449962 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a8688-6ce0-4090-989d-55234815b185 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:29.451413 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a8688-6ce0-4090-989d-55234815b185 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:29.457562 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 604/1200] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:09:29 2022] GET /identity/v3/role_assignments?user.id=1a80b296d2e04074bf4b28fea8c5b4d2&scope.project.id=209cc00c6b934d44b3c03559b3d3dd95&role.id=5ef3464f4436446b88430cdf7cc1a3d7 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:39.305110 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=39 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:39.455480 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=75 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:26.750829 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc7ac1-1783-4a6f-aea4-1c9011ee39be None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:26.751812 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc7ac1-1783-4a6f-aea4-1c9011ee39be None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:26.752103 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc7ac1-1783-4a6f-aea4-1c9011ee39be None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:26.753912 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 597/1201] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:10:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:10:26.760165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaac459-1ac1-41f8-afca-a8e7c3068ceb None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:26.761431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaac459-1ac1-41f8-afca-a8e7c3068ceb None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:26.761431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaac459-1ac1-41f8-afca-a8e7c3068ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:26.780483 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-fdaac459-1ac1-41f8-afca-a8e7c3068ceb None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:10:26.781990 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-fdaac459-1ac1-41f8-afca-a8e7c3068ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:10:26.873979 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 605/1202] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:10:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:10:26.902228 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc7ac1-1783-4a6f-aea4-1c9011ee39be None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:27.066482 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc7ac1-1783-4a6f-aea4-1c9011ee39be None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:27.107087 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f515d-8de7-4eb2-8f82-3c867c6ebc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:27.107922 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f515d-8de7-4eb2-8f82-3c867c6ebc46 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:27.108227 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f515d-8de7-4eb2-8f82-3c867c6ebc46 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:27.108595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f515d-8de7-4eb2-8f82-3c867c6ebc46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:27.121109 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f515d-8de7-4eb2-8f82-3c867c6ebc46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:27.122580 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f515d-8de7-4eb2-8f82-3c867c6ebc46 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:27.150441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-2e5f515d-8de7-4eb2-8f82-3c867c6ebc46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:10:27.150441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:27.150441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:27.150441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:27.150441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:27.150441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:27.150441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:27.150441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:27.150441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:27.150441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:27.150441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:27.150441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:27.150441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:10:27.150441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:10:27.150441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:10:27.153078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:10:27.153078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:27.153078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:27.153078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:27.153078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:27.153078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:27.153078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:27.153078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:27.153078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:27.153078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:27.153078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:27.153078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:27.153078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:27.153078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:27.153078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:27.153078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:27.153078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:27.155216 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:10:27.155216 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:10:27.155216 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:10:27.155216 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:10:27.157758 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 598/1203] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:10:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:10:27.158827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaac459-1ac1-41f8-afca-a8e7c3068ceb None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:27.328082 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaac459-1ac1-41f8-afca-a8e7c3068ceb None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:27.365245 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:27.374437 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1bf38-bacf-4c54-b9b5-c82e4ef5a15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:27.375229 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1bf38-bacf-4c54-b9b5-c82e4ef5a15a None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:27.375557 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1bf38-bacf-4c54-b9b5-c82e4ef5a15a None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:27.375786 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1bf38-bacf-4c54-b9b5-c82e4ef5a15a None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:27.376528 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb1bf38-bacf-4c54-b9b5-c82e4ef5a15a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:27.376835 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb1bf38-bacf-4c54-b9b5-c82e4ef5a15a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:27.378218 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb1bf38-bacf-4c54-b9b5-c82e4ef5a15a None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:27.394944 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 606/1204] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:10:27.398500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f515d-8de7-4eb2-8f82-3c867c6ebc46 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:27.481892 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:27.558154 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f515d-8de7-4eb2-8f82-3c867c6ebc46 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:27.599784 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a15d5e-66af-4d18-b4c0-2f7195c81bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:27.600526 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a15d5e-66af-4d18-b4c0-2f7195c81bc6 None admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:27.600963 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a15d5e-66af-4d18-b4c0-2f7195c81bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:27.601181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a15d5e-66af-4d18-b4c0-2f7195c81bc6 None admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:27.601913 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a15d5e-66af-4d18-b4c0-2f7195c81bc6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:27.603462 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a15d5e-66af-4d18-b4c0-2f7195c81bc6 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:27.629414 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 599/1205] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 29 12:10:27 2022] POST /identity/v3/users => generated 251 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:10:30.049670 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971181c6-62f5-4f8b-ad41-3d7e79c4798f None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:30.050309 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971181c6-62f5-4f8b-ad41-3d7e79c4798f None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:30.050309 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971181c6-62f5-4f8b-ad41-3d7e79c4798f None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:30.051863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 607/1206] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:10:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:10:30.058257 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4a0ab-2d9f-4671-9eef-f449c7eb1211 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:30.058869 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4a0ab-2d9f-4671-9eef-f449c7eb1211 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:30.064634 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4a0ab-2d9f-4671-9eef-f449c7eb1211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:30.083517 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-7cd4a0ab-2d9f-4671-9eef-f449c7eb1211 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:10:30.084888 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-7cd4a0ab-2d9f-4671-9eef-f449c7eb1211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:10:30.174449 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 600/1207] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:10:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:10:30.207579 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971181c6-62f5-4f8b-ad41-3d7e79c4798f None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:30.360413 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971181c6-62f5-4f8b-ad41-3d7e79c4798f None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:30.417833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6292f26-e948-4cb9-ae57-e73d32c77df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:30.418911 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6292f26-e948-4cb9-ae57-e73d32c77df0 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:30.419251 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6292f26-e948-4cb9-ae57-e73d32c77df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:30.419640 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6292f26-e948-4cb9-ae57-e73d32c77df0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:30.436598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6292f26-e948-4cb9-ae57-e73d32c77df0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:10:30.445904 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-a6292f26-e948-4cb9-ae57-e73d32c77df0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:10:30.445904 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:30.445904 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:30.445904 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:30.445904 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:30.445904 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:30.445904 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:30.445904 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:30.445904 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:30.445904 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:30.445904 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:30.445904 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:30.445904 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:10:30.445904 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:10:30.445904 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:10:30.445904 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:10:30.447961 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:10:30.447961 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:10:30.447961 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:10:30.447961 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:10:30.447961 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:30.447961 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:30.447961 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:30.447961 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:30.447961 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:30.447961 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:30.447961 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:30.447961 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:30.447961 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:30.447961 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:30.447961 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:30.447961 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:30.450504 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:30.450504 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:30.450504 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:30.450504 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:30.450504 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:10:30.450504 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:10:30.450504 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:10:30.450504 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:10:30.450504 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:10:30.450504 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:10:30.450504 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:10:30.450504 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:10:30.452777 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 608/1208] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 29 12:10:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:10:30.454097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4a0ab-2d9f-4671-9eef-f449c7eb1211 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:30.502950 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:30.595352 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4a0ab-2d9f-4671-9eef-f449c7eb1211 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:30.649246 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb53c6-046a-4b6d-af68-0e0693651d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:30.649933 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb53c6-046a-4b6d-af68-0e0693651d00 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:30.650237 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb53c6-046a-4b6d-af68-0e0693651d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:30.650515 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb53c6-046a-4b6d-af68-0e0693651d00 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:30.651321 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb53c6-046a-4b6d-af68-0e0693651d00 None admin] RBAC: Adding query filter params (name=service) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:30.651630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb53c6-046a-4b6d-af68-0e0693651d00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:30.657575 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb53c6-046a-4b6d-af68-0e0693651d00 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:30.664911 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 601/1209] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 29 12:10:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:30.671904 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6292f26-e948-4cb9-ae57-e73d32c77df0 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:30.757372 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:30.832440 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6292f26-e948-4cb9-ae57-e73d32c77df0 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:30.882609 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d26505-2970-4ff9-8ed7-63d3c86ede88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:30.883687 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d26505-2970-4ff9-8ed7-63d3c86ede88 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:30.883970 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d26505-2970-4ff9-8ed7-63d3c86ede88 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:30.884248 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d26505-2970-4ff9-8ed7-63d3c86ede88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:30.896643 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d26505-2970-4ff9-8ed7-63d3c86ede88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:30.898221 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d26505-2970-4ff9-8ed7-63d3c86ede88 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:30.924083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-26d26505-2970-4ff9-8ed7-63d3c86ede88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:10:30.924083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:30.924083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:30.924083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:30.924083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:30.924083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:30.924083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:30.924083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:30.924083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:30.924083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:30.924083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:30.924083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:30.924083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:10:30.924083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:10:30.924083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:10:30.925111 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:10:30.925111 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:30.925111 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:30.925111 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:30.925111 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:30.925111 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:30.925111 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:30.925111 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:30.925111 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:30.925111 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:30.925111 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:30.925111 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:30.925111 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:30.925111 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:30.925111 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:30.925111 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:30.925111 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:30.926072 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:10:30.926072 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:10:30.926072 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:10:30.926072 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:10:30.934386 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb53c6-046a-4b6d-af68-0e0693651d00 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:30.934718 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 609/1210] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:10:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:10:31.087185 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:31.090883 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb53c6-046a-4b6d-af68-0e0693651d00 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:31.143030 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9de29-1679-45cb-8d31-b767528f77e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:31.144173 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9de29-1679-45cb-8d31-b767528f77e6 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:31.144747 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9de29-1679-45cb-8d31-b767528f77e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:31.145345 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9de29-1679-45cb-8d31-b767528f77e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:31.146605 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9de29-1679-45cb-8d31-b767528f77e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:31.147271 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9de29-1679-45cb-8d31-b767528f77e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:31.149868 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9de29-1679-45cb-8d31-b767528f77e6 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:31.168100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 602/1211] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:31.176124 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d26505-2970-4ff9-8ed7-63d3c86ede88 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:31.358457 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d26505-2970-4ff9-8ed7-63d3c86ede88 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:31.361292 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:31.419076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34ad24-2232-4c63-8436-89ef0acc614e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:31.420418 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34ad24-2232-4c63-8436-89ef0acc614e None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:31.420919 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34ad24-2232-4c63-8436-89ef0acc614e None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:31.421397 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34ad24-2232-4c63-8436-89ef0acc614e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:31.434987 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34ad24-2232-4c63-8436-89ef0acc614e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:31.437214 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34ad24-2232-4c63-8436-89ef0acc614e None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:31.462432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-de34ad24-2232-4c63-8436-89ef0acc614e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 12:10:31.462432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:31.462432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:31.462432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:31.462432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:31.462432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:31.462432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:31.462432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:31.462432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:31.462432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:31.462432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:31.462432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:31.462432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:10:31.462432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:10:31.462432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:10:31.462432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:10:31.464889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:31.464889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:31.464889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:10:31.464889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:10:31.464889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:10:31.464889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:10:31.464889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:31.464889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:31.464889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:31.464889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:31.464889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:31.464889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:31.464889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:31.464889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:31.464889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:31.464889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:31.464889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:31.464889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:31.465963 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:31.465963 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:31.465963 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:10:31.465963 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:10:31.465963 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:10:31.465963 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:10:31.465963 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:10:31.465963 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:10:31.465963 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 12:10:31.465963 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:10:31.465963 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 610/1212] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:10:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:10:31.470580 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9de29-1679-45cb-8d31-b767528f77e6 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:31.593144 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9de29-1679-45cb-8d31-b767528f77e6 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:31.641624 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493eef4f-b4b3-4b09-a2b9-51bcd82b20e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:31.642882 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493eef4f-b4b3-4b09-a2b9-51bcd82b20e0 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:31.643346 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493eef4f-b4b3-4b09-a2b9-51bcd82b20e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:31.643912 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493eef4f-b4b3-4b09-a2b9-51bcd82b20e0 None admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:31.645044 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493eef4f-b4b3-4b09-a2b9-51bcd82b20e0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:31.645604 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493eef4f-b4b3-4b09-a2b9-51bcd82b20e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:31.648107 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493eef4f-b4b3-4b09-a2b9-51bcd82b20e0 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:31.678149 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 603/1213] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Jun 29 12:10:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:10:31.685586 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34ad24-2232-4c63-8436-89ef0acc614e None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:31.816600 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34ad24-2232-4c63-8436-89ef0acc614e None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:31.855056 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7314bbd-d400-4770-9138-7219f13ce32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:31.855711 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7314bbd-d400-4770-9138-7219f13ce32e None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:31.855993 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7314bbd-d400-4770-9138-7219f13ce32e None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:31.856308 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7314bbd-d400-4770-9138-7219f13ce32e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:31.893643 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:31.938582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7314bbd-d400-4770-9138-7219f13ce32e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:31.940038 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7314bbd-d400-4770-9138-7219f13ce32e None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:32.070346 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 611/1214] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:10:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:10:32.072583 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493eef4f-b4b3-4b09-a2b9-51bcd82b20e0 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:32.096823 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:32.204618 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493eef4f-b4b3-4b09-a2b9-51bcd82b20e0 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:32.267261 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d1ea1-1b8f-48f3-9ff5-529f0ac1019d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:32.268654 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d1ea1-1b8f-48f3-9ff5-529f0ac1019d None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:32.269171 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d1ea1-1b8f-48f3-9ff5-529f0ac1019d None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:32.269684 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d1ea1-1b8f-48f3-9ff5-529f0ac1019d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:32.287176 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d1ea1-1b8f-48f3-9ff5-529f0ac1019d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:32.289690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d1ea1-1b8f-48f3-9ff5-529f0ac1019d None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:32.317970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-e65d1ea1-1b8f-48f3-9ff5-529f0ac1019d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:10:32.317970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:32.317970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:32.317970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:32.317970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:32.317970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:32.317970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:32.317970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:32.317970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:32.317970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:32.317970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:32.317970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:32.317970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:10:32.317970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:10:32.317970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:10:32.324979 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:10:32.324979 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:32.324979 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:32.324979 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:32.324979 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:32.324979 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:32.324979 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:32.324979 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:32.324979 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:32.324979 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:32.324979 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:32.324979 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:32.324979 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:32.324979 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:32.324979 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:32.324979 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:32.324979 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:32.326111 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:10:32.326111 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:10:32.326111 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:10:32.326111 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:10:32.326111 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 604/1215] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:10:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:10:32.326478 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7314bbd-d400-4770-9138-7219f13ce32e None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:32.421411 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:32.487393 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7314bbd-d400-4770-9138-7219f13ce32e None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:32.550852 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602f15a-e97b-4f7d-ba84-d74fb9c30057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:32.551737 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602f15a-e97b-4f7d-ba84-d74fb9c30057 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:32.552122 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602f15a-e97b-4f7d-ba84-d74fb9c30057 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:32.552498 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602f15a-e97b-4f7d-ba84-d74fb9c30057 None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:32.553355 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d602f15a-e97b-4f7d-ba84-d74fb9c30057 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:32.553774 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d602f15a-e97b-4f7d-ba84-d74fb9c30057 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:32.555497 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d602f15a-e97b-4f7d-ba84-d74fb9c30057 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:32.576534 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 612/1216] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:32.577863 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d1ea1-1b8f-48f3-9ff5-529f0ac1019d None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:32.660731 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:32.695269 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d1ea1-1b8f-48f3-9ff5-529f0ac1019d None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:32.737086 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281f031-9d01-47bd-9333-8cbc0fff9e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:32.737951 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281f031-9d01-47bd-9333-8cbc0fff9e1d None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:32.738181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281f031-9d01-47bd-9333-8cbc0fff9e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:32.738445 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281f031-9d01-47bd-9333-8cbc0fff9e1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:32.746110 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281f031-9d01-47bd-9333-8cbc0fff9e1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:32.747591 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281f031-9d01-47bd-9333-8cbc0fff9e1d None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:32.762928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-1281f031-9d01-47bd-9333-8cbc0fff9e1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:10:32.762928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:32.762928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:32.762928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:32.762928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:32.762928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:32.762928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:32.762928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:32.762928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:32.762928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:32.762928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:32.762928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:32.762928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:10:32.762928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:10:32.762928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:10:32.764623 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:10:32.764623 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:32.764623 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:32.764623 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:32.764623 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:32.764623 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:32.764623 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:32.764623 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:32.764623 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:32.764623 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:32.764623 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:32.764623 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:32.764623 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:32.764623 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:32.764623 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:32.764623 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:32.764623 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:32.766033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:10:32.766033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:10:32.766033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:10:32.766033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:10:32.766033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:10:32.766033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:10:32.766033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:10:32.766033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:10:32.766033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 605/1217] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:10:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:10:32.770315 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602f15a-e97b-4f7d-ba84-d74fb9c30057 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:32.874661 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602f15a-e97b-4f7d-ba84-d74fb9c30057 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:32.898502 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:32.911450 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c986e7d-92dc-466c-930e-ee70d6e90760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:32.912114 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c986e7d-92dc-466c-930e-ee70d6e90760 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:32.912394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c986e7d-92dc-466c-930e-ee70d6e90760 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:32.912665 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c986e7d-92dc-466c-930e-ee70d6e90760 None admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:32.913487 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c986e7d-92dc-466c-930e-ee70d6e90760 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:32.913793 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c986e7d-92dc-466c-930e-ee70d6e90760 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:32.915399 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c986e7d-92dc-466c-930e-ee70d6e90760 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:32.927341 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 613/1218] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:10:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:32.934114 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281f031-9d01-47bd-9333-8cbc0fff9e1d None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:33.052350 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281f031-9d01-47bd-9333-8cbc0fff9e1d None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:33.085304 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:33.092363 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4648757-be8f-4a77-85cf-b9a363b6cc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:33.093054 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4648757-be8f-4a77-85cf-b9a363b6cc9c None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:33.093338 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4648757-be8f-4a77-85cf-b9a363b6cc9c None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:33.093726 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4648757-be8f-4a77-85cf-b9a363b6cc9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:33.094496 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4648757-be8f-4a77-85cf-b9a363b6cc9c None admin] RBAC: Adding query filter params (role.id=0be824a9ecd0492f984e3b3b991e3984, scope.project.id=489877ae137244c5b83291671c703c99, user.id=cd57c8b894e74c709ea389ed462184fb) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:33.094923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4648757-be8f-4a77-85cf-b9a363b6cc9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:33.096516 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4648757-be8f-4a77-85cf-b9a363b6cc9c None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:33.103064 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 606/1219] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:10:32 2022] GET /identity/v3/role_assignments?user.id=cd57c8b894e74c709ea389ed462184fb&scope.project.id=489877ae137244c5b83291671c703c99&role.id=0be824a9ecd0492f984e3b3b991e3984 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:35.215904 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57e2bb-140b-4e60-ae68-05baef80038b None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:35.216439 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57e2bb-140b-4e60-ae68-05baef80038b None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:35.216439 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57e2bb-140b-4e60-ae68-05baef80038b None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:35.217810 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 614/1220] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:10:35.223176 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8088c4-3785-46ee-9fde-5c902b841624 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:35.223588 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8088c4-3785-46ee-9fde-5c902b841624 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:35.223732 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8088c4-3785-46ee-9fde-5c902b841624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:35.241766 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-1d8088c4-3785-46ee-9fde-5c902b841624 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:10:35.242994 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-1d8088c4-3785-46ee-9fde-5c902b841624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:10:35.322672 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 607/1221] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:10:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:10:35.345898 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57e2bb-140b-4e60-ae68-05baef80038b None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:35.477562 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57e2bb-140b-4e60-ae68-05baef80038b None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:35.513914 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a8ee0-e1aa-481a-9b2a-bf8bf34cc1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:35.514738 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a8ee0-e1aa-481a-9b2a-bf8bf34cc1e2 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:35.515022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a8ee0-e1aa-481a-9b2a-bf8bf34cc1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:35.515296 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a8ee0-e1aa-481a-9b2a-bf8bf34cc1e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:35.528046 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a8ee0-e1aa-481a-9b2a-bf8bf34cc1e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:10:35.537426 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-0d4a8ee0-e1aa-481a-9b2a-bf8bf34cc1e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:10:35.537426 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:35.537426 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:35.537426 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:35.537426 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:35.537426 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:35.537426 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:35.537426 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:35.537426 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:35.537426 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:35.537426 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:35.537426 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:35.537426 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:10:35.537426 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:10:35.537426 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:10:35.537426 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:10:35.538459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:10:35.538459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:10:35.538459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:10:35.538459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:10:35.538459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:35.538459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:35.538459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:35.538459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:35.538459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:35.538459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:35.538459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:35.538459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:35.538459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:35.538459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:35.538459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:35.538459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:35.539353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:35.539353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:35.539353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:35.539353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:35.539353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:10:35.539353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:10:35.539353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:10:35.539353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:10:35.539353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:10:35.539353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:10:35.539353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:10:35.539353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:10:35.539353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 615/1222] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 29 12:10:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:10:35.545958 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8088c4-3785-46ee-9fde-5c902b841624 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:35.644673 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8088c4-3785-46ee-9fde-5c902b841624 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:35.671929 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:35.683404 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027705b-6e25-492a-b5e7-76e1768f5192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:35.684083 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027705b-6e25-492a-b5e7-76e1768f5192 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:35.684368 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027705b-6e25-492a-b5e7-76e1768f5192 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:35.684641 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027705b-6e25-492a-b5e7-76e1768f5192 None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:35.685385 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d027705b-6e25-492a-b5e7-76e1768f5192 None admin] RBAC: Adding query filter params (name=service) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:35.685702 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d027705b-6e25-492a-b5e7-76e1768f5192 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:35.687324 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d027705b-6e25-492a-b5e7-76e1768f5192 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:35.696545 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 608/1223] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 29 12:10:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:35.702713 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a8ee0-e1aa-481a-9b2a-bf8bf34cc1e2 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:35.749764 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:35.817677 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a8ee0-e1aa-481a-9b2a-bf8bf34cc1e2 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:35.855427 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5443ddd-3eb8-4f38-b239-e96e284ed0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:35.856446 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5443ddd-3eb8-4f38-b239-e96e284ed0a9 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:35.856839 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5443ddd-3eb8-4f38-b239-e96e284ed0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:35.857352 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5443ddd-3eb8-4f38-b239-e96e284ed0a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:35.871346 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5443ddd-3eb8-4f38-b239-e96e284ed0a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:35.873292 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5443ddd-3eb8-4f38-b239-e96e284ed0a9 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:35.897318 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-d5443ddd-3eb8-4f38-b239-e96e284ed0a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:10:35.897318 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:35.897318 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:35.897318 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:35.897318 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:35.897318 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:35.897318 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:35.897318 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:35.897318 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:35.897318 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:35.897318 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:35.897318 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:35.897318 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:10:35.897318 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:10:35.897318 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:10:35.898414 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:10:35.898414 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:35.898414 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:35.898414 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:35.898414 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:35.898414 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:35.898414 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:35.898414 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:35.898414 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:35.898414 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:35.898414 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:35.898414 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:35.898414 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:35.898414 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:35.898414 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:35.898414 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:35.898414 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:35.899423 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:10:35.899423 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:10:35.899423 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:10:35.899423 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:10:35.899423 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 616/1224] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:10:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:10:35.906159 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027705b-6e25-492a-b5e7-76e1768f5192 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:36.025759 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027705b-6e25-492a-b5e7-76e1768f5192 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:36.067833 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9b616-6674-4b18-9069-388e2a58669a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:36.068651 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9b616-6674-4b18-9069-388e2a58669a None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:36.069017 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9b616-6674-4b18-9069-388e2a58669a None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:36.069299 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9b616-6674-4b18-9069-388e2a58669a None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:36.070019 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9b616-6674-4b18-9069-388e2a58669a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:36.070329 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9b616-6674-4b18-9069-388e2a58669a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:36.071929 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9b616-6674-4b18-9069-388e2a58669a None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:36.085403 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 609/1225] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:10:36.092146 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5443ddd-3eb8-4f38-b239-e96e284ed0a9 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:36.187986 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:36.195193 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5443ddd-3eb8-4f38-b239-e96e284ed0a9 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:36.236401 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8937d7-3471-42b5-bad1-408fe5bc4328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:36.237269 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8937d7-3471-42b5-bad1-408fe5bc4328 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:36.237650 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8937d7-3471-42b5-bad1-408fe5bc4328 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:36.237986 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8937d7-3471-42b5-bad1-408fe5bc4328 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:36.246451 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8937d7-3471-42b5-bad1-408fe5bc4328 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:36.248651 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8937d7-3471-42b5-bad1-408fe5bc4328 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:36.267564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-af8937d7-3471-42b5-bad1-408fe5bc4328 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 12:10:36.267564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:36.267564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:36.267564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:36.267564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:36.267564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:36.267564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:36.267564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:36.267564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:36.267564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:36.267564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:36.267564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:36.267564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:10:36.267564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:10:36.267564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:10:36.267564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:10:36.268693 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:36.268693 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:36.268693 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:10:36.268693 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:10:36.268693 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:10:36.268693 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:10:36.268693 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:36.268693 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:36.268693 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:36.268693 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:36.268693 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:36.268693 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:36.268693 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:36.268693 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:36.268693 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:36.268693 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:36.268693 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:36.268693 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:36.269621 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:36.269621 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:36.269621 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:10:36.269621 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:10:36.269621 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:10:36.269621 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:10:36.269621 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:10:36.269621 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:10:36.269621 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 12:10:36.269621 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:10:36.269621 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 617/1226] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:10:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:10:36.274745 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9b616-6674-4b18-9069-388e2a58669a None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:36.345727 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:36.403662 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9b616-6674-4b18-9069-388e2a58669a None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:36.444300 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560731b2-4ee7-493a-95f9-5cca7cfafc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:36.445065 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560731b2-4ee7-493a-95f9-5cca7cfafc2b None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:36.445372 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560731b2-4ee7-493a-95f9-5cca7cfafc2b None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:36.445759 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560731b2-4ee7-493a-95f9-5cca7cfafc2b None admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:36.446668 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560731b2-4ee7-493a-95f9-5cca7cfafc2b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:36.446996 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560731b2-4ee7-493a-95f9-5cca7cfafc2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:36.448981 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560731b2-4ee7-493a-95f9-5cca7cfafc2b None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:36.468622 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 610/1227] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Jun 29 12:10:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:36.474468 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8937d7-3471-42b5-bad1-408fe5bc4328 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:36.584834 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8937d7-3471-42b5-bad1-408fe5bc4328 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:36.626345 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d64385-1f0f-4848-b480-e85a397cec79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:36.627183 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d64385-1f0f-4848-b480-e85a397cec79 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:36.627450 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d64385-1f0f-4848-b480-e85a397cec79 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:36.627783 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d64385-1f0f-4848-b480-e85a397cec79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:36.639364 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d64385-1f0f-4848-b480-e85a397cec79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:36.641166 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d64385-1f0f-4848-b480-e85a397cec79 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:36.661261 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-73d64385-1f0f-4848-b480-e85a397cec79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:10:36.661261 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:36.661261 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:36.661261 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:36.661261 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:36.661261 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:36.661261 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:36.661261 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:36.661261 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:36.661261 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:36.661261 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:36.661261 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:36.661261 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:10:36.661261 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:10:36.661261 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:10:36.662412 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:10:36.662412 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:36.662412 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:36.662412 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:36.662412 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:36.662412 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:36.662412 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:36.662412 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:36.662412 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:36.662412 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:36.662412 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:36.662412 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:36.662412 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:36.662412 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:36.662412 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:36.662412 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:36.662412 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:36.663736 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:10:36.663736 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:10:36.663736 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:10:36.663736 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:10:36.663736 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 618/1228] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:10:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:10:36.669001 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560731b2-4ee7-493a-95f9-5cca7cfafc2b None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:36.774365 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560731b2-4ee7-493a-95f9-5cca7cfafc2b None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:36.777893 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:36.812385 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62d775-6854-4a45-a201-25319242689b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:36.813053 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62d775-6854-4a45-a201-25319242689b None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:36.813337 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62d775-6854-4a45-a201-25319242689b None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:36.813607 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62d775-6854-4a45-a201-25319242689b None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:36.814312 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62d775-6854-4a45-a201-25319242689b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:36.814615 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62d775-6854-4a45-a201-25319242689b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:36.816002 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62d775-6854-4a45-a201-25319242689b None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:36.829850 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 611/1229] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:36.835685 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d64385-1f0f-4848-b480-e85a397cec79 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:36.844720 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:36.950995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d64385-1f0f-4848-b480-e85a397cec79 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:36.989118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e5975-7096-4326-829c-46767bb7aafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:36.989902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e5975-7096-4326-829c-46767bb7aafb None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:36.990186 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e5975-7096-4326-829c-46767bb7aafb None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:36.990467 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e5975-7096-4326-829c-46767bb7aafb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:36.998747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e5975-7096-4326-829c-46767bb7aafb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:37.000570 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e5975-7096-4326-829c-46767bb7aafb None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:37.016663 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-749e5975-7096-4326-829c-46767bb7aafb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:10:37.016663 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:37.016663 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:37.016663 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:37.016663 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:37.016663 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:37.016663 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:37.016663 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:37.016663 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:37.016663 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:37.016663 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:37.016663 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:37.016663 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:10:37.016663 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:10:37.016663 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:10:37.017805 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:10:37.017805 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:37.017805 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:37.017805 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:37.017805 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:37.017805 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:37.017805 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:37.017805 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:37.017805 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:37.017805 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:37.017805 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:37.017805 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:37.017805 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:37.017805 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:37.017805 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:37.017805 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:37.017805 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:37.018788 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:10:37.018788 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:10:37.018788 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:10:37.018788 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:10:37.018788 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:10:37.018788 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:10:37.018788 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:10:37.018788 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:10:37.018788 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 619/1230] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:10:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:10:37.024012 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62d775-6854-4a45-a201-25319242689b None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:37.139598 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62d775-6854-4a45-a201-25319242689b None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:37.180137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f4d8b-e226-41c7-8013-3fe6303ae72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:37.180955 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f4d8b-e226-41c7-8013-3fe6303ae72f None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:37.181338 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f4d8b-e226-41c7-8013-3fe6303ae72f None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:37.181747 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f4d8b-e226-41c7-8013-3fe6303ae72f None admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:37.182655 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f4d8b-e226-41c7-8013-3fe6303ae72f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:37.183164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f4d8b-e226-41c7-8013-3fe6303ae72f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:37.184707 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f4d8b-e226-41c7-8013-3fe6303ae72f None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:37.198033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 612/1231] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:10:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:37.204226 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e5975-7096-4326-829c-46767bb7aafb None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:37.278281 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:37.312902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e5975-7096-4326-829c-46767bb7aafb None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:37.349873 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1105b48-2b7a-4b57-b6de-bb0051410e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:37.350815 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1105b48-2b7a-4b57-b6de-bb0051410e0d None admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:37.351098 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1105b48-2b7a-4b57-b6de-bb0051410e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:37.351374 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1105b48-2b7a-4b57-b6de-bb0051410e0d None admin] PATH_INFO: `/v3/projects/489877ae137244c5b83291671c703c99/users/cd57c8b894e74c709ea389ed462184fb/roles/0be824a9ecd0492f984e3b3b991e3984` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:37.369581 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1105b48-2b7a-4b57-b6de-bb0051410e0d None admin] RBAC: Authorizing `identity:create_grant(project_id=489877ae137244c5b83291671c703c99, user_id=cd57c8b894e74c709ea389ed462184fb, role_id=0be824a9ecd0492f984e3b3b991e3984)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:37.371319 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1105b48-2b7a-4b57-b6de-bb0051410e0d None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:37.384232 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 620/1232] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 29 12:10:37 2022] PUT /identity/v3/projects/489877ae137244c5b83291671c703c99/users/cd57c8b894e74c709ea389ed462184fb/roles/0be824a9ecd0492f984e3b3b991e3984 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:10:39.482616 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3854e1d-be12-4518-a124-b28e88fca939 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:39.483294 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3854e1d-be12-4518-a124-b28e88fca939 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:39.483294 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3854e1d-be12-4518-a124-b28e88fca939 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:39.485773 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 613/1233] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:10:39.490346 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed6148-c064-44e5-b891-e510ea00de96 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:39.490845 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed6148-c064-44e5-b891-e510ea00de96 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:39.490941 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed6148-c064-44e5-b891-e510ea00de96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:39.509305 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-3eed6148-c064-44e5-b891-e510ea00de96 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:10:39.510719 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-3eed6148-c064-44e5-b891-e510ea00de96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:10:39.583863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 621/1234] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:10:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:10:39.610230 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3854e1d-be12-4518-a124-b28e88fca939 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:39.635551 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:39.721568 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3854e1d-be12-4518-a124-b28e88fca939 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:39.762853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb020d-6499-4a67-b56f-ce6de41db325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:39.763700 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb020d-6499-4a67-b56f-ce6de41db325 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:39.764004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb020d-6499-4a67-b56f-ce6de41db325 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:39.764333 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb020d-6499-4a67-b56f-ce6de41db325 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:39.776348 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb020d-6499-4a67-b56f-ce6de41db325 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:10:39.785489 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-a5bb020d-6499-4a67-b56f-ce6de41db325 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:10:39.785489 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:39.785489 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:39.785489 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:39.785489 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:39.785489 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:39.785489 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:39.785489 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:39.785489 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:39.785489 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:39.785489 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:39.785489 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:39.785489 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:10:39.785489 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:10:39.785489 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:10:39.785489 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:10:39.786550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:10:39.786550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:10:39.786550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:10:39.786550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:10:39.786550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:39.786550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:39.786550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:39.786550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:39.786550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:39.786550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:39.786550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:39.786550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:39.786550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:39.786550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:39.786550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:39.786550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:39.787456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:39.787456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:39.787456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:39.787456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:39.787456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:10:39.787456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:10:39.787456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:10:39.787456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:10:39.787456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:10:39.787456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:10:39.787456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:10:39.787456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:10:39.787456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 614/1235] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 29 12:10:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:10:39.793521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed6148-c064-44e5-b891-e510ea00de96 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:39.845107 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:39.903256 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed6148-c064-44e5-b891-e510ea00de96 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:39.942087 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505a7b7-0b49-470b-adc8-55f2272b2697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:39.942784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505a7b7-0b49-470b-adc8-55f2272b2697 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:39.943093 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505a7b7-0b49-470b-adc8-55f2272b2697 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:39.943349 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505a7b7-0b49-470b-adc8-55f2272b2697 None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:39.944066 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505a7b7-0b49-470b-adc8-55f2272b2697 None admin] RBAC: Adding query filter params (name=service) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:39.944371 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505a7b7-0b49-470b-adc8-55f2272b2697 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:39.945759 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505a7b7-0b49-470b-adc8-55f2272b2697 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:39.954249 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 622/1236] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 29 12:10:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:39.960241 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb020d-6499-4a67-b56f-ce6de41db325 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:40.053712 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:40.071265 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb020d-6499-4a67-b56f-ce6de41db325 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:40.110072 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f489d2-cc27-452f-b381-464ee8309f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:40.111167 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f489d2-cc27-452f-b381-464ee8309f23 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:40.111605 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f489d2-cc27-452f-b381-464ee8309f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:40.111887 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f489d2-cc27-452f-b381-464ee8309f23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:40.127660 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f489d2-cc27-452f-b381-464ee8309f23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:40.128952 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f489d2-cc27-452f-b381-464ee8309f23 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:40.146529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-d0f489d2-cc27-452f-b381-464ee8309f23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:10:40.146529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:40.146529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:40.146529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:40.146529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:40.146529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:40.146529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:40.146529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:40.146529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:40.146529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:40.146529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:40.146529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:40.146529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:10:40.146529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:10:40.146529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:10:40.147554 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:10:40.147554 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:40.147554 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:40.147554 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:40.147554 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:40.147554 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:40.147554 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:40.147554 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:40.147554 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:40.147554 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:40.147554 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:40.147554 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:40.147554 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:40.147554 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:40.147554 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:40.147554 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:40.147554 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:40.148461 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:10:40.148461 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:10:40.148461 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:10:40.148461 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:10:40.148461 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 615/1237] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:10:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:10:40.154117 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505a7b7-0b49-470b-adc8-55f2272b2697 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:40.258004 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505a7b7-0b49-470b-adc8-55f2272b2697 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:40.267583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:40.295281 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4696d0c-16b8-4794-b766-76998441f83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:40.296012 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4696d0c-16b8-4794-b766-76998441f83e None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:40.296627 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4696d0c-16b8-4794-b766-76998441f83e None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:40.296943 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4696d0c-16b8-4794-b766-76998441f83e None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:40.297764 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4696d0c-16b8-4794-b766-76998441f83e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:40.298101 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4696d0c-16b8-4794-b766-76998441f83e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:40.299543 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4696d0c-16b8-4794-b766-76998441f83e None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:40.313863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 623/1238] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:10:40.322247 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f489d2-cc27-452f-b381-464ee8309f23 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:40.434587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f489d2-cc27-452f-b381-464ee8309f23 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:40.470061 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528b275-f3a1-4ac5-b28e-9a31d7f1367c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:40.470903 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528b275-f3a1-4ac5-b28e-9a31d7f1367c None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:40.471185 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528b275-f3a1-4ac5-b28e-9a31d7f1367c None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:40.471452 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528b275-f3a1-4ac5-b28e-9a31d7f1367c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:40.474201 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:40.480600 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528b275-f3a1-4ac5-b28e-9a31d7f1367c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:40.482034 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528b275-f3a1-4ac5-b28e-9a31d7f1367c None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:40.496020 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-1528b275-f3a1-4ac5-b28e-9a31d7f1367c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 12:10:40.496020 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:40.496020 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:40.496020 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:40.496020 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:40.496020 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:40.496020 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:40.496020 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:40.496020 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:40.496020 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:40.496020 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:40.496020 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:40.496020 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:10:40.496020 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:10:40.496020 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:10:40.496020 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:10:40.497582 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:40.497582 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:40.497582 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:10:40.497582 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:10:40.497582 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:10:40.497582 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:10:40.497582 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:40.497582 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:40.497582 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:40.497582 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:40.497582 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:40.497582 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:40.497582 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:40.497582 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:40.497582 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:40.497582 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:40.497582 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:40.497582 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:40.498729 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:40.498729 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:40.498729 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:10:40.498729 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:10:40.498729 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:10:40.498729 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:10:40.498729 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:10:40.498729 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:10:40.498729 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 12:10:40.498729 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:10:40.498729 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 616/1239] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:10:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:10:40.503310 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4696d0c-16b8-4794-b766-76998441f83e None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:40.611834 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4696d0c-16b8-4794-b766-76998441f83e None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:40.662254 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175982f5-faf4-4c6d-89dc-c40e216fa3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:40.663380 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175982f5-faf4-4c6d-89dc-c40e216fa3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:40.663881 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175982f5-faf4-4c6d-89dc-c40e216fa3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:40.664366 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175982f5-faf4-4c6d-89dc-c40e216fa3a3 None admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:40.665737 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175982f5-faf4-4c6d-89dc-c40e216fa3a3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:40.666304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175982f5-faf4-4c6d-89dc-c40e216fa3a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:40.668525 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175982f5-faf4-4c6d-89dc-c40e216fa3a3 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:40.693617 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 624/1240] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Jun 29 12:10:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:40.704709 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528b275-f3a1-4ac5-b28e-9a31d7f1367c None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:40.810077 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528b275-f3a1-4ac5-b28e-9a31d7f1367c None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:40.844771 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca597137-cb48-41c5-865d-45d06eb2a744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:40.845426 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca597137-cb48-41c5-865d-45d06eb2a744 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:40.845711 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca597137-cb48-41c5-865d-45d06eb2a744 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:40.845988 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca597137-cb48-41c5-865d-45d06eb2a744 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:40.919944 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:40.928611 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca597137-cb48-41c5-865d-45d06eb2a744 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:40.930607 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca597137-cb48-41c5-865d-45d06eb2a744 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:41.039627 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 617/1241] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:10:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:10:41.045495 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175982f5-faf4-4c6d-89dc-c40e216fa3a3 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:41.074780 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:41.159307 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175982f5-faf4-4c6d-89dc-c40e216fa3a3 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:41.193235 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03bb2f-0c1d-4aa6-a271-b4d8df8f2f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:41.193955 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03bb2f-0c1d-4aa6-a271-b4d8df8f2f96 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:41.194237 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03bb2f-0c1d-4aa6-a271-b4d8df8f2f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:41.194515 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03bb2f-0c1d-4aa6-a271-b4d8df8f2f96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:41.205427 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03bb2f-0c1d-4aa6-a271-b4d8df8f2f96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:41.207033 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03bb2f-0c1d-4aa6-a271-b4d8df8f2f96 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:41.224538 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-9b03bb2f-0c1d-4aa6-a271-b4d8df8f2f96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:10:41.224538 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:41.224538 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:41.224538 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:41.224538 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:41.224538 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:41.224538 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:41.224538 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:41.224538 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:41.224538 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:41.224538 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:41.224538 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:41.224538 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:10:41.224538 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:10:41.224538 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:10:41.225660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:10:41.225660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:41.225660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:41.225660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:41.225660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:41.225660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:41.225660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:41.225660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:41.225660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:41.225660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:41.225660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:41.225660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:41.225660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:41.225660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:41.225660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:41.225660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:41.225660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:41.226589 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:10:41.226589 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:10:41.226589 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:10:41.226589 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:10:41.226589 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 625/1242] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:10:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:10:41.231906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca597137-cb48-41c5-865d-45d06eb2a744 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:41.344541 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:41.351069 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca597137-cb48-41c5-865d-45d06eb2a744 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:41.388553 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790215b-c374-429a-8211-c03e6e426a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:41.389210 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790215b-c374-429a-8211-c03e6e426a4a None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:41.389500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790215b-c374-429a-8211-c03e6e426a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:41.389791 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790215b-c374-429a-8211-c03e6e426a4a None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:41.390494 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9790215b-c374-429a-8211-c03e6e426a4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:41.390834 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9790215b-c374-429a-8211-c03e6e426a4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:41.392200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9790215b-c374-429a-8211-c03e6e426a4a None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:41.404877 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 618/1243] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:41.411478 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03bb2f-0c1d-4aa6-a271-b4d8df8f2f96 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:41.506559 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:41.532532 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03bb2f-0c1d-4aa6-a271-b4d8df8f2f96 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:41.569881 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b657169-0941-40a8-9b7e-ff70994f664e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:41.570780 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b657169-0941-40a8-9b7e-ff70994f664e None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:41.571086 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b657169-0941-40a8-9b7e-ff70994f664e None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:41.571359 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b657169-0941-40a8-9b7e-ff70994f664e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:41.579476 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b657169-0941-40a8-9b7e-ff70994f664e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:41.580926 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b657169-0941-40a8-9b7e-ff70994f664e None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:41.596039 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-0b657169-0941-40a8-9b7e-ff70994f664e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:10:41.596039 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:41.596039 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:41.596039 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:41.596039 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:41.596039 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:41.596039 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:41.596039 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:41.596039 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:41.596039 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:41.596039 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:41.596039 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:41.596039 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:10:41.596039 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:10:41.596039 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:10:41.597165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:10:41.597165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:41.597165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:41.597165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:41.597165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:41.597165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:41.597165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:41.597165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:41.597165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:41.597165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:41.597165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:41.597165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:41.597165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:41.597165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:41.597165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:41.597165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:41.597165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:41.598413 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:10:41.598413 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:10:41.598413 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:10:41.598413 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:10:41.598413 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:10:41.598413 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:10:41.598413 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:10:41.598413 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:10:41.598413 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 626/1244] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:10:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:10:41.602992 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790215b-c374-429a-8211-c03e6e426a4a None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:41.709469 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790215b-c374-429a-8211-c03e6e426a4a None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:41.750314 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f561b8-39f5-4b76-bc49-d9418ef2c9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:41.751061 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f561b8-39f5-4b76-bc49-d9418ef2c9ce None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:41.751347 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f561b8-39f5-4b76-bc49-d9418ef2c9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:41.751618 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f561b8-39f5-4b76-bc49-d9418ef2c9ce None admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:41.752403 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f561b8-39f5-4b76-bc49-d9418ef2c9ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:41.752712 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f561b8-39f5-4b76-bc49-d9418ef2c9ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:41.754153 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f561b8-39f5-4b76-bc49-d9418ef2c9ce None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:41.768400 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 619/1245] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:10:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:10:41.775053 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b657169-0941-40a8-9b7e-ff70994f664e None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:41.883443 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b657169-0941-40a8-9b7e-ff70994f664e None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:41.929817 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1c0eb-7377-400a-b58a-e6d9ba74beb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:41.930583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1c0eb-7377-400a-b58a-e6d9ba74beb1 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:41.930907 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1c0eb-7377-400a-b58a-e6d9ba74beb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:41.931190 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1c0eb-7377-400a-b58a-e6d9ba74beb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:41.932546 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e1c0eb-7377-400a-b58a-e6d9ba74beb1 None admin] RBAC: Adding query filter params (role.id=0be824a9ecd0492f984e3b3b991e3984, scope.project.id=489877ae137244c5b83291671c703c99, user.id=cd57c8b894e74c709ea389ed462184fb) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:41.932864 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e1c0eb-7377-400a-b58a-e6d9ba74beb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:41.934318 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e1c0eb-7377-400a-b58a-e6d9ba74beb1 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:41.940368 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 627/1246] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:10:41 2022] GET /identity/v3/role_assignments?user.id=cd57c8b894e74c709ea389ed462184fb&scope.project.id=489877ae137244c5b83291671c703c99&role.id=0be824a9ecd0492f984e3b3b991e3984 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:44.058378 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34b123-7ddf-468f-9cc6-c761d27e2224 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:44.058953 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34b123-7ddf-468f-9cc6-c761d27e2224 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:44.058953 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34b123-7ddf-468f-9cc6-c761d27e2224 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:44.060226 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 620/1247] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:10:44.065459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0a21a-d9de-41fa-af59-e7bcce14d17a None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:44.065891 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0a21a-d9de-41fa-af59-e7bcce14d17a None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:44.066103 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0a21a-d9de-41fa-af59-e7bcce14d17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:44.071498 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:44.084542 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-23c0a21a-d9de-41fa-af59-e7bcce14d17a None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:10:44.085773 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-23c0a21a-d9de-41fa-af59-e7bcce14d17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:10:44.162272 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 628/1248] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:10:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:10:44.186484 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34b123-7ddf-468f-9cc6-c761d27e2224 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:44.206304 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:44.302592 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34b123-7ddf-468f-9cc6-c761d27e2224 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:44.340698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8d73a-f063-47c0-839f-fe42fe3e5836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:44.341501 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8d73a-f063-47c0-839f-fe42fe3e5836 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:44.341814 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8d73a-f063-47c0-839f-fe42fe3e5836 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:44.342106 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8d73a-f063-47c0-839f-fe42fe3e5836 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:44.353760 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb8d73a-f063-47c0-839f-fe42fe3e5836 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:10:44.362236 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-8fb8d73a-f063-47c0-839f-fe42fe3e5836 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:10:44.362236 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:44.362236 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:44.362236 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:44.362236 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:44.362236 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:44.362236 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:44.362236 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:44.362236 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:44.362236 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:44.362236 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:44.362236 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:44.362236 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:10:44.362236 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:10:44.362236 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:10:44.362236 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:10:44.363310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:10:44.363310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:10:44.363310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:10:44.363310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:10:44.363310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:44.363310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:44.363310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:44.363310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:44.363310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:44.363310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:44.363310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:44.363310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:44.363310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:44.363310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:44.363310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:44.363310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:44.364254 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:44.364254 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:44.364254 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:44.364254 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:44.364254 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:10:44.364254 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:10:44.364254 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:10:44.364254 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:10:44.364254 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:10:44.364254 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:10:44.364254 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:10:44.364254 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:10:44.364254 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 621/1249] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:10:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:10:44.370508 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0a21a-d9de-41fa-af59-e7bcce14d17a None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:44.500234 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0a21a-d9de-41fa-af59-e7bcce14d17a None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:44.541110 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:44.548306 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd90b9-66b9-4d0a-9400-47ea755052ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:44.550220 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd90b9-66b9-4d0a-9400-47ea755052ce None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:44.550542 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd90b9-66b9-4d0a-9400-47ea755052ce None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:44.550928 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd90b9-66b9-4d0a-9400-47ea755052ce None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:44.551792 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd90b9-66b9-4d0a-9400-47ea755052ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:44.552107 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd90b9-66b9-4d0a-9400-47ea755052ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:44.553662 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd90b9-66b9-4d0a-9400-47ea755052ce None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:44.566402 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 629/1250] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:10:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:10:44.572975 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8d73a-f063-47c0-839f-fe42fe3e5836 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:44.675725 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:44.701113 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8d73a-f063-47c0-839f-fe42fe3e5836 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:44.747930 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f791acd-54e6-433a-8d2e-2523a3e348e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:44.748925 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f791acd-54e6-433a-8d2e-2523a3e348e6 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:44.749276 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f791acd-54e6-433a-8d2e-2523a3e348e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:44.749681 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f791acd-54e6-433a-8d2e-2523a3e348e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:44.765914 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f791acd-54e6-433a-8d2e-2523a3e348e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:44.767949 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f791acd-54e6-433a-8d2e-2523a3e348e6 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:44.792467 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-7f791acd-54e6-433a-8d2e-2523a3e348e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:10:44.792467 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:44.792467 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:44.792467 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:44.792467 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:44.792467 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:44.792467 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:44.792467 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:44.792467 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:44.792467 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:44.792467 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:44.792467 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:44.792467 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:10:44.792467 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:10:44.792467 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:10:44.793619 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:10:44.793619 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:44.793619 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:44.793619 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:44.793619 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:44.793619 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:44.793619 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:44.793619 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:44.793619 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:44.793619 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:44.793619 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:44.793619 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:44.793619 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:44.793619 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:44.793619 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:44.793619 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:44.793619 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:44.794689 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:10:44.794689 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:10:44.794689 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:10:44.794689 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:10:44.794689 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 622/1251] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:10:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:10:44.799565 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd90b9-66b9-4d0a-9400-47ea755052ce None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:44.919450 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd90b9-66b9-4d0a-9400-47ea755052ce None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:44.969920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e689c-c6c8-4207-9051-ffc830d3f617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:44.970664 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e689c-c6c8-4207-9051-ffc830d3f617 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:44.970964 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e689c-c6c8-4207-9051-ffc830d3f617 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:44.971264 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e689c-c6c8-4207-9051-ffc830d3f617 None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:44.972119 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e689c-c6c8-4207-9051-ffc830d3f617 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:44.972474 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e689c-c6c8-4207-9051-ffc830d3f617 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:44.973859 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e689c-c6c8-4207-9051-ffc830d3f617 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:44.988121 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 630/1252] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:44.993733 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f791acd-54e6-433a-8d2e-2523a3e348e6 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:45.104188 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f791acd-54e6-433a-8d2e-2523a3e348e6 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:45.133048 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:45.145630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e3539-7d47-4b4c-b939-0263463a3a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:45.146834 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e3539-7d47-4b4c-b939-0263463a3a60 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:45.147180 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e3539-7d47-4b4c-b939-0263463a3a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:45.147500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e3539-7d47-4b4c-b939-0263463a3a60 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:45.157242 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e3539-7d47-4b4c-b939-0263463a3a60 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:45.158885 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e3539-7d47-4b4c-b939-0263463a3a60 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:45.174695 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-b17e3539-7d47-4b4c-b939-0263463a3a60 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 12:10:45.174695 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:45.174695 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:45.174695 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:45.174695 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:45.174695 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:45.174695 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:45.174695 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:45.174695 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:45.174695 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:45.174695 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:45.174695 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:45.174695 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:10:45.174695 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:10:45.174695 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:10:45.174695 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:10:45.175928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:45.175928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:45.175928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:10:45.175928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:10:45.175928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:10:45.175928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:10:45.175928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:45.175928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:45.175928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:45.175928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:45.175928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:45.175928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:45.175928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:45.175928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:45.175928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:45.175928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:45.175928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:45.175928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:45.177097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:45.177097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:45.177097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:10:45.177097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:10:45.177097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:10:45.177097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:10:45.177097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:10:45.177097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:10:45.177097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 12:10:45.177097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:10:45.177097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 623/1253] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:10:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:10:45.182301 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e689c-c6c8-4207-9051-ffc830d3f617 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:45.251274 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:45.305307 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e689c-c6c8-4207-9051-ffc830d3f617 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:45.343388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de423e2-a3d2-4a8f-8cc3-bf4cfbec74b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:45.344059 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de423e2-a3d2-4a8f-8cc3-bf4cfbec74b8 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:45.344364 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de423e2-a3d2-4a8f-8cc3-bf4cfbec74b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:45.344609 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de423e2-a3d2-4a8f-8cc3-bf4cfbec74b8 None admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:45.345481 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de423e2-a3d2-4a8f-8cc3-bf4cfbec74b8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:45.345748 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de423e2-a3d2-4a8f-8cc3-bf4cfbec74b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:45.347249 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de423e2-a3d2-4a8f-8cc3-bf4cfbec74b8 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:45.365514 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 631/1254] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Jun 29 12:10:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:45.371783 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e3539-7d47-4b4c-b939-0263463a3a60 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:45.503304 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e3539-7d47-4b4c-b939-0263463a3a60 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:45.544682 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d78886-f029-4553-b72f-281aa6036f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:45.545352 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d78886-f029-4553-b72f-281aa6036f4a None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:45.545629 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d78886-f029-4553-b72f-281aa6036f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:45.545901 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d78886-f029-4553-b72f-281aa6036f4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:45.612334 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:45.625325 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d78886-f029-4553-b72f-281aa6036f4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:45.626844 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d78886-f029-4553-b72f-281aa6036f4a None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:45.753855 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 624/1255] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:10:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:10:45.761883 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de423e2-a3d2-4a8f-8cc3-bf4cfbec74b8 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:45.911564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de423e2-a3d2-4a8f-8cc3-bf4cfbec74b8 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:45.926556 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:45.958035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa304a9-f0e5-4e6e-97b8-5dbb6a9abc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:45.958992 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa304a9-f0e5-4e6e-97b8-5dbb6a9abc07 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:45.959358 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa304a9-f0e5-4e6e-97b8-5dbb6a9abc07 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:45.959772 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa304a9-f0e5-4e6e-97b8-5dbb6a9abc07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:45.972486 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa304a9-f0e5-4e6e-97b8-5dbb6a9abc07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:45.973996 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa304a9-f0e5-4e6e-97b8-5dbb6a9abc07 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:45.993571 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-5aa304a9-f0e5-4e6e-97b8-5dbb6a9abc07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:10:45.993571 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:45.993571 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:45.993571 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:45.993571 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:45.993571 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:45.993571 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:45.993571 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:45.993571 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:45.993571 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:45.993571 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:45.993571 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:45.993571 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:10:45.993571 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:10:45.993571 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:10:45.995073 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:10:45.995073 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:45.995073 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:45.995073 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:45.995073 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:45.995073 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:45.995073 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:45.995073 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:45.995073 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:45.995073 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:45.995073 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:45.995073 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:45.995073 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:45.995073 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:45.995073 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:45.995073 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:45.995073 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:45.996505 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:10:45.996505 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:10:45.996505 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:10:45.996505 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:10:45.996505 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 632/1256] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:10:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:10:46.001152 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d78886-f029-4553-b72f-281aa6036f4a None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:46.104909 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:46.117587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d78886-f029-4553-b72f-281aa6036f4a None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:46.157466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3ccff-262c-467c-b26c-5f894220615b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:46.158152 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3ccff-262c-467c-b26c-5f894220615b None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:46.158434 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3ccff-262c-467c-b26c-5f894220615b None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:46.158739 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3ccff-262c-467c-b26c-5f894220615b None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:46.159505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3ccff-262c-467c-b26c-5f894220615b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:46.159767 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3ccff-262c-467c-b26c-5f894220615b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:46.161155 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3ccff-262c-467c-b26c-5f894220615b None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:46.173082 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 625/1257] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:46.179716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa304a9-f0e5-4e6e-97b8-5dbb6a9abc07 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:46.291447 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa304a9-f0e5-4e6e-97b8-5dbb6a9abc07 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:46.326657 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544068c1-ad99-4294-98bb-30a4102a76c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:46.327471 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544068c1-ad99-4294-98bb-30a4102a76c3 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:46.327755 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544068c1-ad99-4294-98bb-30a4102a76c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:46.328029 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544068c1-ad99-4294-98bb-30a4102a76c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:46.335235 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544068c1-ad99-4294-98bb-30a4102a76c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:46.336710 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544068c1-ad99-4294-98bb-30a4102a76c3 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:46.351809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-544068c1-ad99-4294-98bb-30a4102a76c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:10:46.351809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:46.351809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:46.351809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:46.351809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:46.351809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:46.351809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:46.351809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:46.351809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:46.351809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:46.351809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:46.351809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:46.351809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:10:46.351809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:10:46.351809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:10:46.354042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:10:46.354042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:46.354042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:46.354042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:46.354042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:46.354042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:46.354042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:46.354042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:46.354042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:46.354042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:46.354042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:46.354042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:46.354042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:46.354042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:46.354042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:46.354042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:46.354042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:46.356375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:10:46.356375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:10:46.356375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:10:46.356375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:10:46.356375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:10:46.356375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:10:46.356375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:10:46.356375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:10:46.356375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 633/1258] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:10:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:10:46.361642 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3ccff-262c-467c-b26c-5f894220615b None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:46.506519 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3ccff-262c-467c-b26c-5f894220615b None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:46.551690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b383e52-017b-4164-8dc3-ee9aca550093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:46.552369 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b383e52-017b-4164-8dc3-ee9aca550093 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:46.552651 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b383e52-017b-4164-8dc3-ee9aca550093 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:46.552929 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b383e52-017b-4164-8dc3-ee9aca550093 None admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:46.553733 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b383e52-017b-4164-8dc3-ee9aca550093 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:46.554037 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b383e52-017b-4164-8dc3-ee9aca550093 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:46.555538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b383e52-017b-4164-8dc3-ee9aca550093 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:46.570124 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 626/1259] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:10:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:46.577087 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544068c1-ad99-4294-98bb-30a4102a76c3 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:46.605385 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:46.691364 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544068c1-ad99-4294-98bb-30a4102a76c3 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:46.738174 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac36d4b-02a2-4fde-837a-0f1eadf6ff08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:46.738960 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac36d4b-02a2-4fde-837a-0f1eadf6ff08 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:46.739243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac36d4b-02a2-4fde-837a-0f1eadf6ff08 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:46.739519 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac36d4b-02a2-4fde-837a-0f1eadf6ff08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:46.740382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac36d4b-02a2-4fde-837a-0f1eadf6ff08 None admin] RBAC: Adding query filter params (role.id=5ef3464f4436446b88430cdf7cc1a3d7, scope.project.id=489877ae137244c5b83291671c703c99, user.id=cd57c8b894e74c709ea389ed462184fb) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:46.740700 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac36d4b-02a2-4fde-837a-0f1eadf6ff08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:46.742206 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac36d4b-02a2-4fde-837a-0f1eadf6ff08 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:46.762677 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 634/1260] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:10:46 2022] GET /identity/v3/role_assignments?user.id=cd57c8b894e74c709ea389ed462184fb&scope.project.id=489877ae137244c5b83291671c703c99&role.id=5ef3464f4436446b88430cdf7cc1a3d7 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:48.795234 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641ac33-dac4-4b08-a8de-81f87a69edac None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:48.795814 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641ac33-dac4-4b08-a8de-81f87a69edac None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:48.795814 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641ac33-dac4-4b08-a8de-81f87a69edac None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:48.797165 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 627/1261] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:10:48.802426 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395b1fb-ec64-49cf-a596-79ff382ead27 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:48.802856 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395b1fb-ec64-49cf-a596-79ff382ead27 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:48.803018 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395b1fb-ec64-49cf-a596-79ff382ead27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:48.819303 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-5395b1fb-ec64-49cf-a596-79ff382ead27 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:10:48.820475 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-5395b1fb-ec64-49cf-a596-79ff382ead27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:10:48.885537 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 635/1262] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:10:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:10:48.908797 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641ac33-dac4-4b08-a8de-81f87a69edac None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:48.919397 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:49.014329 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641ac33-dac4-4b08-a8de-81f87a69edac None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:49.046871 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b7e03-955d-4029-8f95-a7bf4fcdf1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:49.047655 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b7e03-955d-4029-8f95-a7bf4fcdf1e4 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:49.047938 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b7e03-955d-4029-8f95-a7bf4fcdf1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:49.048213 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b7e03-955d-4029-8f95-a7bf4fcdf1e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:49.057925 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b7e03-955d-4029-8f95-a7bf4fcdf1e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:10:49.065419 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-ba8b7e03-955d-4029-8f95-a7bf4fcdf1e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:10:49.065419 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:49.065419 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:49.065419 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:49.065419 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:49.065419 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:49.065419 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:49.065419 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:49.065419 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:49.065419 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:49.065419 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:49.065419 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:49.065419 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:10:49.065419 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:10:49.065419 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:10:49.065419 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:10:49.066563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:10:49.066563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:10:49.066563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:10:49.066563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:10:49.066563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:49.066563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:49.066563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:49.066563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:49.066563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:49.066563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:49.066563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:49.066563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:49.066563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:49.066563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:49.066563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:49.066563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:49.067698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:49.067698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:49.067698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:49.067698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:49.067698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:10:49.067698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:10:49.067698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:10:49.067698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:10:49.067698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:10:49.067698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:10:49.067698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:10:49.067698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:10:49.067698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 628/1263] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:10:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:10:49.073275 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395b1fb-ec64-49cf-a596-79ff382ead27 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:49.091783 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:49.170652 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395b1fb-ec64-49cf-a596-79ff382ead27 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:49.203731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1128ba13-0f76-47e3-81b9-e87afbabefbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:49.204389 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128ba13-0f76-47e3-81b9-e87afbabefbb None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:49.204671 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128ba13-0f76-47e3-81b9-e87afbabefbb None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:49.204945 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128ba13-0f76-47e3-81b9-e87afbabefbb None admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:49.205679 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1128ba13-0f76-47e3-81b9-e87afbabefbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:49.205984 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1128ba13-0f76-47e3-81b9-e87afbabefbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:49.207389 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1128ba13-0f76-47e3-81b9-e87afbabefbb None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:49.215159 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 636/1264] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:10:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:49.220928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b7e03-955d-4029-8f95-a7bf4fcdf1e4 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:49.286682 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:49.319107 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b7e03-955d-4029-8f95-a7bf4fcdf1e4 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:49.352818 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47947b2-f3ad-4dec-a6bd-820ade2c787b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:49.353605 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47947b2-f3ad-4dec-a6bd-820ade2c787b None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:49.353885 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47947b2-f3ad-4dec-a6bd-820ade2c787b None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:49.354157 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47947b2-f3ad-4dec-a6bd-820ade2c787b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:49.365073 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47947b2-f3ad-4dec-a6bd-820ade2c787b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:49.366506 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47947b2-f3ad-4dec-a6bd-820ade2c787b None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:49.383434 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-a47947b2-f3ad-4dec-a6bd-820ade2c787b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:10:49.383434 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:49.383434 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:49.383434 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:49.383434 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:49.383434 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:49.383434 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:49.383434 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:49.383434 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:49.383434 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:49.383434 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:49.383434 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:49.383434 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:10:49.383434 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:10:49.383434 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:10:49.385143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:10:49.385143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:49.385143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:49.385143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:49.385143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:49.385143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:49.385143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:49.385143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:49.385143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:49.385143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:49.385143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:49.385143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:49.385143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:49.385143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:49.385143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:49.385143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:49.385143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:49.386380 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:10:49.386380 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:10:49.386380 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:10:49.386380 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:10:49.386380 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 629/1265] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:10:49.391228 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1128ba13-0f76-47e3-81b9-e87afbabefbb None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:49.480546 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:49.500096 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1128ba13-0f76-47e3-81b9-e87afbabefbb None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:49.533040 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ef08c-e954-459e-b8b3-7073ad046c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:49.533700 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ef08c-e954-459e-b8b3-7073ad046c6b None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:49.534050 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ef08c-e954-459e-b8b3-7073ad046c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:49.534238 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ef08c-e954-459e-b8b3-7073ad046c6b None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:49.535036 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ef08c-e954-459e-b8b3-7073ad046c6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:49.535378 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ef08c-e954-459e-b8b3-7073ad046c6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:49.536743 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ef08c-e954-459e-b8b3-7073ad046c6b None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:49.548631 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 637/1266] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:49.555045 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47947b2-f3ad-4dec-a6bd-820ade2c787b None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:49.651237 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47947b2-f3ad-4dec-a6bd-820ade2c787b None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:49.670596 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:49.685216 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24206572-a169-40b5-96d7-e14c7aebea4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:49.686004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24206572-a169-40b5-96d7-e14c7aebea4d None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:49.686288 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24206572-a169-40b5-96d7-e14c7aebea4d None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:49.686565 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24206572-a169-40b5-96d7-e14c7aebea4d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:49.693841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24206572-a169-40b5-96d7-e14c7aebea4d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:49.695304 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24206572-a169-40b5-96d7-e14c7aebea4d None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:49.709159 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-24206572-a169-40b5-96d7-e14c7aebea4d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 12:10:49.709159 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:49.709159 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:49.709159 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:49.709159 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:49.709159 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:49.709159 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:49.709159 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:49.709159 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:49.709159 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:49.709159 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:49.709159 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:49.709159 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:10:49.709159 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:10:49.709159 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:10:49.709159 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:10:49.710294 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:49.710294 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:49.710294 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:10:49.710294 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:10:49.710294 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:10:49.710294 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:10:49.710294 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:49.710294 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:49.710294 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:49.710294 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:49.710294 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:49.710294 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:49.710294 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:49.710294 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:49.710294 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:49.710294 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:49.710294 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:49.710294 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:49.711508 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:49.711508 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:49.711508 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:10:49.711508 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:10:49.711508 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:10:49.711508 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:10:49.711508 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:10:49.711508 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:10:49.711508 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 12:10:49.711508 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:10:49.711508 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 630/1267] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:10:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:10:49.716031 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ef08c-e954-459e-b8b3-7073ad046c6b None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:49.822343 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ef08c-e954-459e-b8b3-7073ad046c6b None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:49.855593 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e30bc2-a693-485c-880b-c4e7a354f5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:49.856269 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e30bc2-a693-485c-880b-c4e7a354f5ad None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:49.856556 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e30bc2-a693-485c-880b-c4e7a354f5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:49.856833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e30bc2-a693-485c-880b-c4e7a354f5ad None admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:49.857672 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e30bc2-a693-485c-880b-c4e7a354f5ad None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:49.857985 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e30bc2-a693-485c-880b-c4e7a354f5ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:49.859473 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e30bc2-a693-485c-880b-c4e7a354f5ad None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:49.869152 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:49.878023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 638/1268] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Jun 29 12:10:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:49.884295 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24206572-a169-40b5-96d7-e14c7aebea4d None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:49.983263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24206572-a169-40b5-96d7-e14c7aebea4d None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:50.015153 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d210b1-6381-4003-8666-3f278f99b338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:50.015936 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d210b1-6381-4003-8666-3f278f99b338 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:50.016215 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d210b1-6381-4003-8666-3f278f99b338 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:50.016488 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d210b1-6381-4003-8666-3f278f99b338 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:50.027138 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d210b1-6381-4003-8666-3f278f99b338 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:50.028575 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d210b1-6381-4003-8666-3f278f99b338 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:50.045755 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-20d210b1-6381-4003-8666-3f278f99b338 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:10:50.045755 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:50.045755 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:50.045755 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:50.045755 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:50.045755 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:50.045755 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:50.045755 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:50.045755 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:50.045755 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:50.045755 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:50.045755 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:50.045755 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:10:50.045755 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:10:50.045755 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:10:50.046820 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:10:50.046820 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:50.046820 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:50.046820 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:50.046820 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:50.046820 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:50.046820 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:50.046820 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:50.046820 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:50.046820 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:50.046820 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:50.046820 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:50.046820 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:50.046820 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:50.046820 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:50.046820 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:50.046820 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:50.047874 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:10:50.047874 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:10:50.047874 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:10:50.047874 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:10:50.047874 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 631/1269] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:10:50.052902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e30bc2-a693-485c-880b-c4e7a354f5ad None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:50.158054 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e30bc2-a693-485c-880b-c4e7a354f5ad None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:50.191969 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9f4aa-d6b7-4c09-9d2f-43bb9e9cb452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:50.192637 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9f4aa-d6b7-4c09-9d2f-43bb9e9cb452 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:50.192924 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9f4aa-d6b7-4c09-9d2f-43bb9e9cb452 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:50.193215 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9f4aa-d6b7-4c09-9d2f-43bb9e9cb452 None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:50.193927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d9f4aa-d6b7-4c09-9d2f-43bb9e9cb452 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:50.194234 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d9f4aa-d6b7-4c09-9d2f-43bb9e9cb452 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:50.195646 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d9f4aa-d6b7-4c09-9d2f-43bb9e9cb452 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:50.208590 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 639/1270] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:50.214870 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d210b1-6381-4003-8666-3f278f99b338 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:50.246837 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:50.323405 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d210b1-6381-4003-8666-3f278f99b338 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:50.355413 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0991d7c-abe2-424c-add2-b65de5f4086f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:50.356193 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0991d7c-abe2-424c-add2-b65de5f4086f None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:50.356474 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0991d7c-abe2-424c-add2-b65de5f4086f None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:50.356748 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0991d7c-abe2-424c-add2-b65de5f4086f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:50.363114 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0991d7c-abe2-424c-add2-b65de5f4086f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:50.364545 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0991d7c-abe2-424c-add2-b65de5f4086f None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:50.378934 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-f0991d7c-abe2-424c-add2-b65de5f4086f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:10:50.378934 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:50.378934 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:50.378934 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:50.378934 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:50.378934 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:50.378934 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:50.378934 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:50.378934 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:50.378934 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:50.378934 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:50.378934 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:50.378934 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:10:50.378934 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:10:50.378934 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:10:50.379990 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:10:50.379990 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:50.379990 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:50.379990 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:50.379990 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:50.379990 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:50.379990 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:50.379990 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:50.379990 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:50.379990 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:50.379990 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:50.379990 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:50.379990 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:50.379990 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:50.379990 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:50.379990 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:50.379990 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:50.381164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:10:50.381164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:10:50.381164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:10:50.381164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:10:50.381164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:10:50.381164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:10:50.381164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:10:50.381164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:10:50.381164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 632/1271] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:10:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:10:50.385923 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9f4aa-d6b7-4c09-9d2f-43bb9e9cb452 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:50.447699 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:50.488061 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9f4aa-d6b7-4c09-9d2f-43bb9e9cb452 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:50.520378 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd32fa-1540-4bb5-a94c-5a0de9937651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:50.521033 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd32fa-1540-4bb5-a94c-5a0de9937651 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:50.521321 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd32fa-1540-4bb5-a94c-5a0de9937651 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:50.521599 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd32fa-1540-4bb5-a94c-5a0de9937651 None admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:50.522374 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd32fa-1540-4bb5-a94c-5a0de9937651 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:50.522710 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd32fa-1540-4bb5-a94c-5a0de9937651 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:50.524161 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd32fa-1540-4bb5-a94c-5a0de9937651 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:50.536022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 640/1272] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:10:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:50.542440 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0991d7c-abe2-424c-add2-b65de5f4086f None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:50.632252 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:50.640930 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0991d7c-abe2-424c-add2-b65de5f4086f None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:50.674214 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c30d2-14ba-421d-a613-ae63fd19ca62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:50.675109 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c30d2-14ba-421d-a613-ae63fd19ca62 None admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:50.675394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c30d2-14ba-421d-a613-ae63fd19ca62 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:50.675664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c30d2-14ba-421d-a613-ae63fd19ca62 None admin] PATH_INFO: `/v3/projects/489877ae137244c5b83291671c703c99/users/cd57c8b894e74c709ea389ed462184fb/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:50.677555 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c30d2-14ba-421d-a613-ae63fd19ca62 None admin] RBAC: Authorizing `identity:create_grant(project_id=489877ae137244c5b83291671c703c99, user_id=cd57c8b894e74c709ea389ed462184fb, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:50.679010 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c30d2-14ba-421d-a613-ae63fd19ca62 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:50.691155 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 633/1273] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 29 12:10:50 2022] PUT /identity/v3/projects/489877ae137244c5b83291671c703c99/users/cd57c8b894e74c709ea389ed462184fb/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:10:52.717933 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b45f9-ab3f-48a5-a329-32e485f28bf3 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:52.718493 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b45f9-ab3f-48a5-a329-32e485f28bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:52.718493 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b45f9-ab3f-48a5-a329-32e485f28bf3 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:52.719872 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 641/1274] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:10:52.724957 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f146cc-319e-4546-a55e-23d8f9f8f492 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:52.725365 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f146cc-319e-4546-a55e-23d8f9f8f492 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:52.725562 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f146cc-319e-4546-a55e-23d8f9f8f492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:52.744407 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-84f146cc-319e-4546-a55e-23d8f9f8f492 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:10:52.745587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-84f146cc-319e-4546-a55e-23d8f9f8f492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:10:52.809139 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 634/1275] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:10:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:10:52.832487 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b45f9-ab3f-48a5-a329-32e485f28bf3 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:52.940533 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b45f9-ab3f-48a5-a329-32e485f28bf3 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:52.965640 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:52.988897 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307a4a8-307f-4c81-9958-0f70c3d782fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:52.989609 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307a4a8-307f-4c81-9958-0f70c3d782fe None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:52.989889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307a4a8-307f-4c81-9958-0f70c3d782fe None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:52.990163 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307a4a8-307f-4c81-9958-0f70c3d782fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:53.000468 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307a4a8-307f-4c81-9958-0f70c3d782fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:10:53.007975 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-f307a4a8-307f-4c81-9958-0f70c3d782fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:10:53.007975 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:53.007975 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:53.007975 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:53.007975 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:53.007975 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:53.007975 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:53.007975 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:53.007975 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:53.007975 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:53.007975 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:53.007975 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:53.007975 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:10:53.007975 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:10:53.007975 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:10:53.007975 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:10:53.009090 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:10:53.009090 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:10:53.009090 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:10:53.009090 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:10:53.009090 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:53.009090 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:53.009090 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:53.009090 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:53.009090 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:53.009090 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:53.009090 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:53.009090 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:53.009090 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:53.009090 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:53.009090 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:53.009090 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:53.009979 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:53.009979 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:53.009979 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:53.009979 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:53.009979 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:10:53.009979 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:10:53.009979 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:10:53.009979 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:10:53.009979 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:10:53.009979 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:10:53.009979 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:10:53.009979 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:10:53.009979 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 642/1276] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 29 12:10:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:10:53.015516 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f146cc-319e-4546-a55e-23d8f9f8f492 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:53.101272 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:53.122096 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f146cc-319e-4546-a55e-23d8f9f8f492 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:53.155615 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c07459-80ad-41a4-b094-8b2dd53fa82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:53.156282 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c07459-80ad-41a4-b094-8b2dd53fa82d None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:53.156566 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c07459-80ad-41a4-b094-8b2dd53fa82d None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:53.156842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c07459-80ad-41a4-b094-8b2dd53fa82d None admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:53.157592 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c07459-80ad-41a4-b094-8b2dd53fa82d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:53.157900 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c07459-80ad-41a4-b094-8b2dd53fa82d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:53.159301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c07459-80ad-41a4-b094-8b2dd53fa82d None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:53.168118 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 635/1277] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 29 12:10:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:53.174004 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307a4a8-307f-4c81-9958-0f70c3d782fe None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:53.273255 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307a4a8-307f-4c81-9958-0f70c3d782fe None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:53.305525 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2f568-813c-448b-8c81-1581f544aee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:53.306875 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2f568-813c-448b-8c81-1581f544aee9 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:53.307153 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2f568-813c-448b-8c81-1581f544aee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:53.307424 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2f568-813c-448b-8c81-1581f544aee9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:53.317724 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2f568-813c-448b-8c81-1581f544aee9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:53.319208 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2f568-813c-448b-8c81-1581f544aee9 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:53.340136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-6ed2f568-813c-448b-8c81-1581f544aee9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:10:53.340136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:53.340136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:53.340136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:53.340136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:53.340136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:53.340136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:53.340136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:53.340136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:53.340136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:53.340136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:53.340136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:53.340136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:10:53.340136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:10:53.340136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:10:53.341320 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:10:53.341320 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:53.341320 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:53.341320 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:53.341320 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:53.341320 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:53.341320 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:53.341320 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:53.341320 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:53.341320 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:53.341320 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:53.341320 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:53.341320 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:53.341320 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:53.341320 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:53.341320 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:53.341320 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:53.342352 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:10:53.342352 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:10:53.342352 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:10:53.342352 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:10:53.342352 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 643/1278] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:10:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:10:53.347334 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c07459-80ad-41a4-b094-8b2dd53fa82d None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:53.467304 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c07459-80ad-41a4-b094-8b2dd53fa82d None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:53.503219 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cd02d-740b-47d4-9deb-b55461a03999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:53.503886 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cd02d-740b-47d4-9deb-b55461a03999 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:53.504173 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cd02d-740b-47d4-9deb-b55461a03999 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:53.504451 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cd02d-740b-47d4-9deb-b55461a03999 None admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:53.505170 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435cd02d-740b-47d4-9deb-b55461a03999 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:53.505477 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435cd02d-740b-47d4-9deb-b55461a03999 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:53.506877 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435cd02d-740b-47d4-9deb-b55461a03999 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:53.519109 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 636/1279] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:53.525711 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2f568-813c-448b-8c81-1581f544aee9 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:53.563119 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:53.636155 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2f568-813c-448b-8c81-1581f544aee9 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:53.670439 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116e2f3-facc-4805-aefb-6826d0d2b2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:53.671267 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116e2f3-facc-4805-aefb-6826d0d2b2ca None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:53.671551 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116e2f3-facc-4805-aefb-6826d0d2b2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:53.671827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116e2f3-facc-4805-aefb-6826d0d2b2ca None admin] PATH_INFO: `/v3/users/placement` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:53.680306 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116e2f3-facc-4805-aefb-6826d0d2b2ca None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:53.681807 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116e2f3-facc-4805-aefb-6826d0d2b2ca None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:53.699344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-2116e2f3-facc-4805-aefb-6826d0d2b2ca None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 12:10:53.699344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:53.699344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:53.699344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:53.699344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:53.699344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:53.699344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:53.699344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:53.699344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:53.699344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:53.699344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:53.699344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:53.699344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:10:53.699344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:10:53.699344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:10:53.699344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:10:53.700560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:53.700560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:53.700560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:10:53.700560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:10:53.700560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:10:53.700560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:10:53.700560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:53.700560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:53.700560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:53.700560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:53.700560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:53.700560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:53.700560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:53.700560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:53.700560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:53.700560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:53.700560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:53.700560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:53.701740 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:53.701740 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:53.701740 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:10:53.701740 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:10:53.701740 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:10:53.701740 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:10:53.701740 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:10:53.701740 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:10:53.701740 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 12:10:53.701740 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:10:53.701740 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 644/1280] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:10:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:10:53.706553 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cd02d-740b-47d4-9deb-b55461a03999 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:53.710477 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:53.808040 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cd02d-740b-47d4-9deb-b55461a03999 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:53.842438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc458f92-7f56-4426-832e-adc68985735f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:53.843197 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc458f92-7f56-4426-832e-adc68985735f None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:53.843478 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc458f92-7f56-4426-832e-adc68985735f None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:53.843754 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc458f92-7f56-4426-832e-adc68985735f None admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:53.844571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc458f92-7f56-4426-832e-adc68985735f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:53.844880 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc458f92-7f56-4426-832e-adc68985735f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:53.846302 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc458f92-7f56-4426-832e-adc68985735f None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:53.863776 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 637/1281] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Jun 29 12:10:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:53.870065 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116e2f3-facc-4805-aefb-6826d0d2b2ca None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:53.961665 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:53.974940 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116e2f3-facc-4805-aefb-6826d0d2b2ca None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:54.007892 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0848a-545d-496d-9a8b-c1cd0b602c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:54.008535 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0848a-545d-496d-9a8b-c1cd0b602c01 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:54.009385 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0848a-545d-496d-9a8b-c1cd0b602c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:54.009628 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0848a-545d-496d-9a8b-c1cd0b602c01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:54.077317 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0848a-545d-496d-9a8b-c1cd0b602c01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:54.078756 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0848a-545d-496d-9a8b-c1cd0b602c01 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:54.179104 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:54.189753 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 645/1282] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 29 12:10:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:10:54.195566 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc458f92-7f56-4426-832e-adc68985735f None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:54.254446 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:54.293593 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc458f92-7f56-4426-832e-adc68985735f None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:54.329811 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecf9b5-ea86-4015-8a5d-852b00452fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:54.330528 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecf9b5-ea86-4015-8a5d-852b00452fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:54.330842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecf9b5-ea86-4015-8a5d-852b00452fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:54.331118 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecf9b5-ea86-4015-8a5d-852b00452fb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:54.341664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ecf9b5-ea86-4015-8a5d-852b00452fb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:54.343152 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ecf9b5-ea86-4015-8a5d-852b00452fb1 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:54.360815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-c5ecf9b5-ea86-4015-8a5d-852b00452fb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:10:54.360815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:54.360815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:54.360815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:54.360815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:54.360815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:54.360815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:54.360815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:54.360815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:54.360815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:54.360815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:54.360815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:54.360815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:10:54.360815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:10:54.360815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:10:54.361875 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:10:54.361875 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:54.361875 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:54.361875 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:54.361875 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:54.361875 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:54.361875 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:54.361875 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:54.361875 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:54.361875 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:54.361875 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:54.361875 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:54.361875 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:54.361875 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:54.361875 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:54.361875 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:54.361875 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:54.362878 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:10:54.362878 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:10:54.362878 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:10:54.362878 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:10:54.362878 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 638/1283] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:10:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:10:54.367651 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0848a-545d-496d-9a8b-c1cd0b602c01 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:54.466321 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0848a-545d-496d-9a8b-c1cd0b602c01 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:54.504307 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e7888-d76f-4357-aed1-d4c0e51373e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:54.504963 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e7888-d76f-4357-aed1-d4c0e51373e2 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:54.505243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e7888-d76f-4357-aed1-d4c0e51373e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:54.505518 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e7888-d76f-4357-aed1-d4c0e51373e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:54.506237 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e7888-d76f-4357-aed1-d4c0e51373e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:54.506547 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e7888-d76f-4357-aed1-d4c0e51373e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:54.507960 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e7888-d76f-4357-aed1-d4c0e51373e2 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:54.519976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 646/1284] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 29 12:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:54.525883 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecf9b5-ea86-4015-8a5d-852b00452fb1 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:54.630597 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecf9b5-ea86-4015-8a5d-852b00452fb1 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:54.645264 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:54.675983 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7547f-78f0-47d3-8842-6c45a7266017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:54.676779 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7547f-78f0-47d3-8842-6c45a7266017 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:54.677062 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7547f-78f0-47d3-8842-6c45a7266017 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:54.677334 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7547f-78f0-47d3-8842-6c45a7266017 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:54.684263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7547f-78f0-47d3-8842-6c45a7266017 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:54.685737 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7547f-78f0-47d3-8842-6c45a7266017 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:54.700284 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-46c7547f-78f0-47d3-8842-6c45a7266017 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:10:54.700284 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:54.700284 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:54.700284 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:54.700284 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:54.700284 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:54.700284 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:54.700284 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:54.700284 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:54.700284 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:54.700284 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:54.700284 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:54.700284 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:10:54.700284 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:10:54.700284 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:10:54.701466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:10:54.701466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:54.701466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:54.701466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:54.701466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:54.701466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:54.701466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:54.701466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:54.701466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:54.701466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:54.701466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:54.701466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:54.701466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:54.701466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:54.701466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:54.701466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:54.701466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:54.702758 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:10:54.702758 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:10:54.702758 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:10:54.702758 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:10:54.702758 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:10:54.702758 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:10:54.702758 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:10:54.702758 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:10:54.702758 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 639/1285] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 29 12:10:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:10:54.707435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e7888-d76f-4357-aed1-d4c0e51373e2 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:54.762291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:54.813860 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e7888-d76f-4357-aed1-d4c0e51373e2 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:54.847373 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1f077-e7ab-4748-b147-2adac0073b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:54.848039 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1f077-e7ab-4748-b147-2adac0073b07 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:54.848321 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1f077-e7ab-4748-b147-2adac0073b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:54.848599 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1f077-e7ab-4748-b147-2adac0073b07 None admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:54.849390 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1f077-e7ab-4748-b147-2adac0073b07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:54.849704 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1f077-e7ab-4748-b147-2adac0073b07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:54.851188 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1f077-e7ab-4748-b147-2adac0073b07 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:54.864907 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 647/1286] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 29 12:10:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:54.871790 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7547f-78f0-47d3-8842-6c45a7266017 None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:54.985346 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7547f-78f0-47d3-8842-6c45a7266017 None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:55.019200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135025de-a727-40ad-a85b-6a2b145d0421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:55.019856 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135025de-a727-40ad-a85b-6a2b145d0421 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:55.020144 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135025de-a727-40ad-a85b-6a2b145d0421 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:55.020422 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135025de-a727-40ad-a85b-6a2b145d0421 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:55.021256 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135025de-a727-40ad-a85b-6a2b145d0421 None admin] RBAC: Adding query filter params (role.id=5ef3464f4436446b88430cdf7cc1a3d7, scope.project.id=489877ae137244c5b83291671c703c99, user.id=cd57c8b894e74c709ea389ed462184fb) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:55.021571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135025de-a727-40ad-a85b-6a2b145d0421 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:55.023039 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135025de-a727-40ad-a85b-6a2b145d0421 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:55.029558 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 640/1287] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 29 12:10:54 2022] GET /identity/v3/role_assignments?user.id=cd57c8b894e74c709ea389ed462184fb&scope.project.id=489877ae137244c5b83291671c703c99&role.id=5ef3464f4436446b88430cdf7cc1a3d7 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:10:57.070338 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2335947-01a1-4fc1-ba0f-ac8c64798e27 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:57.070903 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2335947-01a1-4fc1-ba0f-ac8c64798e27 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:57.070903 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2335947-01a1-4fc1-ba0f-ac8c64798e27 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:57.072716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 648/1288] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:10:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:10:57.077951 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2be28-2958-4fa1-aa15-1e4570ab7e00 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:57.078380 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2be28-2958-4fa1-aa15-1e4570ab7e00 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:57.078511 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2be28-2958-4fa1-aa15-1e4570ab7e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:57.096685 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-e8c2be28-2958-4fa1-aa15-1e4570ab7e00 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:10:57.097915 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-e8c2be28-2958-4fa1-aa15-1e4570ab7e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:10:57.127170 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:57.166946 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 641/1289] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:10:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:10:57.189351 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2335947-01a1-4fc1-ba0f-ac8c64798e27 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:57.293527 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2335947-01a1-4fc1-ba0f-ac8c64798e27 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:57.305325 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:57.328866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a362c-86af-4bf2-8da1-072dc871ac35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:57.329578 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a362c-86af-4bf2-8da1-072dc871ac35 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:57.329854 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a362c-86af-4bf2-8da1-072dc871ac35 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:57.330121 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a362c-86af-4bf2-8da1-072dc871ac35 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:57.330793 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a362c-86af-4bf2-8da1-072dc871ac35 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:57.332155 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a362c-86af-4bf2-8da1-072dc871ac35 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:57.343695 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-d04a362c-86af-4bf2-8da1-072dc871ac35 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 12:10:57.343695 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:57.343695 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:10:57.343695 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:10:57.343695 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:10:57.343695 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:10:57.343695 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:10:57.343695 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:10:57.343695 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 12:10:57.343695 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:10:57.343695 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:10:57.343695 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:10:57.343695 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:57.343695 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:57.343695 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:57.343695 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:57.343695 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:57.344922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:57.344922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:57.344922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:57.344922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:57.344922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:57.344922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:57.344922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:10:57.344922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:10:57.344922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:10:57.344922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:10:57.344922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:57.344922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:57.344922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:57.344922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:57.344922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:57.344922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:57.346049 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:57.346049 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:57.346049 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:57.346049 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:57.346049 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:57.346049 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:57.346049 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:57.346049 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:57.346049 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:57.346049 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:57.346049 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:10:57.346049 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:10:57.346049 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 12:10:57.346049 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:10:57.346049 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 649/1290] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Jun 29 12:10:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:10:57.350933 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2be28-2958-4fa1-aa15-1e4570ab7e00 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:57.472807 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2be28-2958-4fa1-aa15-1e4570ab7e00 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:57.507058 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13898675-1456-4b45-a911-15a384810ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:57.507736 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13898675-1456-4b45-a911-15a384810ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:57.508021 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13898675-1456-4b45-a911-15a384810ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:57.508294 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13898675-1456-4b45-a911-15a384810ca7 None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:57.509014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13898675-1456-4b45-a911-15a384810ca7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:57.509320 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13898675-1456-4b45-a911-15a384810ca7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:57.510706 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13898675-1456-4b45-a911-15a384810ca7 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:57.515433 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 642/1291] 10.222.0.13 () {56 vars in 1116 bytes} [Wed Jun 29 12:10:57 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:57.521198 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a362c-86af-4bf2-8da1-072dc871ac35 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:57.618493 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a362c-86af-4bf2-8da1-072dc871ac35 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:57.650878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03836db-76bc-42f9-9f08-50a18f958d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:57.651536 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03836db-76bc-42f9-9f08-50a18f958d05 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:57.651818 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03836db-76bc-42f9-9f08-50a18f958d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:57.652095 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03836db-76bc-42f9-9f08-50a18f958d05 None admin] PATH_INFO: `/v3/services` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:57.652799 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03836db-76bc-42f9-9f08-50a18f958d05 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:57.653106 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03836db-76bc-42f9-9f08-50a18f958d05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:57.654494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03836db-76bc-42f9-9f08-50a18f958d05 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:57.659391 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 650/1292] 10.222.0.13 () {56 vars in 1116 bytes} [Wed Jun 29 12:10:57 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:59.669446 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f91d8-f016-45e4-88e9-75b513991e4f None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:59.670004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f91d8-f016-45e4-88e9-75b513991e4f None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:59.670004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f91d8-f016-45e4-88e9-75b513991e4f None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:59.671377 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 643/1293] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:10:59.676341 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79820ec7-3883-45d1-8607-9aa728e304ef None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:59.676731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79820ec7-3883-45d1-8607-9aa728e304ef None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:59.676902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79820ec7-3883-45d1-8607-9aa728e304ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:59.693197 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-79820ec7-3883-45d1-8607-9aa728e304ef None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:10:59.694368 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-79820ec7-3883-45d1-8607-9aa728e304ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:10:59.722856 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:59.760088 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 651/1294] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:10:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:10:59.783253 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f91d8-f016-45e4-88e9-75b513991e4f None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:59.813505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:59.881031 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f91d8-f016-45e4-88e9-75b513991e4f None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:59.913553 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9eeb94-ecbe-4547-a141-264023aecbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:59.914200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9eeb94-ecbe-4547-a141-264023aecbc6 None admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:59.914479 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9eeb94-ecbe-4547-a141-264023aecbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:59.915412 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9eeb94-ecbe-4547-a141-264023aecbc6 None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:59.916129 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9eeb94-ecbe-4547-a141-264023aecbc6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:59.917485 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9eeb94-ecbe-4547-a141-264023aecbc6 None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:59.929442 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 644/1295] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Jun 29 12:10:59 2022] POST /identity/v3/services => generated 246 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:11:01.991580 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4676a-a161-4311-9e2f-444167b8bd8d None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:01.992085 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4676a-a161-4311-9e2f-444167b8bd8d None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:01.992085 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4676a-a161-4311-9e2f-444167b8bd8d None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:01.993420 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 652/1296] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:11:01.998600 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eaa7d2-ea04-41d1-a7af-46a08932812c None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:01.999078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eaa7d2-ea04-41d1-a7af-46a08932812c None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:01.999173 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eaa7d2-ea04-41d1-a7af-46a08932812c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:02.015702 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-74eaa7d2-ea04-41d1-a7af-46a08932812c None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:11:02.016894 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-74eaa7d2-ea04-41d1-a7af-46a08932812c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:11:02.090523 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 645/1297] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:11:01 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:11:02.114113 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4676a-a161-4311-9e2f-444167b8bd8d None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:02.213763 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4676a-a161-4311-9e2f-444167b8bd8d None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:02.247038 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebad24-f874-4b52-815a-4515b5c18be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:02.247753 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebad24-f874-4b52-815a-4515b5c18be1 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:02.248038 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebad24-f874-4b52-815a-4515b5c18be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:02.248318 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebad24-f874-4b52-815a-4515b5c18be1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:02.248972 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ebad24-f874-4b52-815a-4515b5c18be1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:02.250353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ebad24-f874-4b52-815a-4515b5c18be1 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:02.262510 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-97ebad24-f874-4b52-815a-4515b5c18be1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 12:11:02.262510 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:02.262510 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:11:02.262510 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:11:02.262510 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:11:02.262510 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:11:02.262510 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:11:02.262510 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:11:02.262510 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 12:11:02.262510 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:11:02.262510 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:11:02.262510 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:11:02.262510 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:02.262510 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:02.262510 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:02.262510 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:02.262510 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:02.263724 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:02.263724 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:02.263724 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:02.263724 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:02.263724 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:02.263724 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:02.263724 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:11:02.263724 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:11:02.263724 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:11:02.263724 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:11:02.263724 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:02.263724 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:02.263724 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:02.263724 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:02.263724 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:02.263724 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:02.264796 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:02.264796 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:02.264796 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:02.264796 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:02.264796 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:02.264796 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:02.264796 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:02.264796 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:02.264796 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:02.264796 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:02.264796 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:11:02.264796 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:11:02.264796 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 12:11:02.264796 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:11:02.264796 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 653/1298] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Jun 29 12:11:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:11:02.269853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eaa7d2-ea04-41d1-a7af-46a08932812c None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:02.288702 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:02.371870 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eaa7d2-ea04-41d1-a7af-46a08932812c None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:02.411057 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e23cc6-a034-48fc-bc7c-e55705e20d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:02.411875 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e23cc6-a034-48fc-bc7c-e55705e20d8f None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:02.412193 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e23cc6-a034-48fc-bc7c-e55705e20d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:02.412538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e23cc6-a034-48fc-bc7c-e55705e20d8f None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:02.413385 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e23cc6-a034-48fc-bc7c-e55705e20d8f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:02.413796 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e23cc6-a034-48fc-bc7c-e55705e20d8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:02.416016 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e23cc6-a034-48fc-bc7c-e55705e20d8f None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:02.422884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 646/1299] 10.222.0.13 () {56 vars in 1116 bytes} [Wed Jun 29 12:11:02 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:02.430971 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebad24-f874-4b52-815a-4515b5c18be1 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:02.468119 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:02.534699 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebad24-f874-4b52-815a-4515b5c18be1 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:02.567053 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d2e2e-574a-478a-bfde-1e8fb02e4ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:02.567700 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d2e2e-574a-478a-bfde-1e8fb02e4ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:02.567982 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d2e2e-574a-478a-bfde-1e8fb02e4ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:02.568257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d2e2e-574a-478a-bfde-1e8fb02e4ee8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:02.569037 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d2e2e-574a-478a-bfde-1e8fb02e4ee8 None admin] RBAC: Adding query filter params (interface=public, service_id=aee4101aeaeb48fa982dbbc5e2a74aa3, region_id=RegionOne) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:02.569346 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d2e2e-574a-478a-bfde-1e8fb02e4ee8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:02.570783 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d2e2e-574a-478a-bfde-1e8fb02e4ee8 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:02.575634 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 654/1300] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Jun 29 12:11:02 2022] GET /identity/v3/endpoints?service_id=aee4101aeaeb48fa982dbbc5e2a74aa3&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:02.581242 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e23cc6-a034-48fc-bc7c-e55705e20d8f None admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:02.663941 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:02.682452 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e23cc6-a034-48fc-bc7c-e55705e20d8f None admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:02.715172 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c8557-a644-49f1-bbfa-b5b4e777e80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:02.715825 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c8557-a644-49f1-bbfa-b5b4e777e80d None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:02.716106 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c8557-a644-49f1-bbfa-b5b4e777e80d None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:02.716381 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c8557-a644-49f1-bbfa-b5b4e777e80d None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:02.717081 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c8557-a644-49f1-bbfa-b5b4e777e80d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:02.718440 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c8557-a644-49f1-bbfa-b5b4e777e80d None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:02.726375 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 647/1301] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Jun 29 12:11:02 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:11:04.761312 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e19fe-285b-4c5d-bdff-2235e36a8eb0 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:04.761844 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e19fe-285b-4c5d-bdff-2235e36a8eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:04.761844 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e19fe-285b-4c5d-bdff-2235e36a8eb0 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:04.763285 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 655/1302] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:11:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:11:04.768771 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e9e6b-6d48-4673-84f4-c0e66ce17dc0 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:04.769216 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e9e6b-6d48-4673-84f4-c0e66ce17dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:04.769307 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e9e6b-6d48-4673-84f4-c0e66ce17dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:04.788051 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-d74e9e6b-6d48-4673-84f4-c0e66ce17dc0 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:11:04.789752 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-d74e9e6b-6d48-4673-84f4-c0e66ce17dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:11:04.862495 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 648/1303] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:11:04 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:11:04.886264 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e19fe-285b-4c5d-bdff-2235e36a8eb0 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:04.983970 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:04.997268 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e19fe-285b-4c5d-bdff-2235e36a8eb0 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:05.031300 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ebd6e-ff2e-4235-bfb8-e3f91f0030a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:05.032444 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ebd6e-ff2e-4235-bfb8-e3f91f0030a4 None admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:05.032937 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ebd6e-ff2e-4235-bfb8-e3f91f0030a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:05.033440 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ebd6e-ff2e-4235-bfb8-e3f91f0030a4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:05.034677 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ebd6e-ff2e-4235-bfb8-e3f91f0030a4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:05.037172 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ebd6e-ff2e-4235-bfb8-e3f91f0030a4 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:05.050494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-296ebd6e-ff2e-4235-bfb8-e3f91f0030a4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 12:11:05.050494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:05.050494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:11:05.050494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:11:05.050494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:11:05.050494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:11:05.050494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:11:05.050494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:11:05.050494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 12:11:05.050494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:11:05.050494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:11:05.050494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:11:05.050494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:05.050494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:05.050494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:05.050494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:05.050494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:05.051791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:05.051791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:05.051791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:05.051791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:05.051791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:05.051791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:05.051791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:11:05.051791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:11:05.051791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:11:05.051791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:11:05.051791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:05.051791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:05.051791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:05.051791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:05.051791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:05.051791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:05.052649 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:05.052649 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:05.052649 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:05.052649 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:05.052649 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:05.052649 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:05.052649 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:05.052649 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:05.052649 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:05.052649 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:05.052649 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:11:05.052649 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:11:05.052649 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 12:11:05.052649 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:11:05.052649 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 656/1304] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Jun 29 12:11:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:11:05.058430 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e9e6b-6d48-4673-84f4-c0e66ce17dc0 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:05.137953 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:05.162305 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e9e6b-6d48-4673-84f4-c0e66ce17dc0 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:05.196624 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9e1fc-d19e-4c44-bd61-7bc8843e981b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:05.197298 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9e1fc-d19e-4c44-bd61-7bc8843e981b None admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:05.197581 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9e1fc-d19e-4c44-bd61-7bc8843e981b None admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:05.197855 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9e1fc-d19e-4c44-bd61-7bc8843e981b None admin] PATH_INFO: `/v3/services` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:05.198564 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9e1fc-d19e-4c44-bd61-7bc8843e981b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:05.198906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9e1fc-d19e-4c44-bd61-7bc8843e981b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:05.200286 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9e1fc-d19e-4c44-bd61-7bc8843e981b None admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:05.206991 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 649/1305] 10.222.0.13 () {56 vars in 1116 bytes} [Wed Jun 29 12:11:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:05.212750 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ebd6e-ff2e-4235-bfb8-e3f91f0030a4 None admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:05.311645 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ebd6e-ff2e-4235-bfb8-e3f91f0030a4 None admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:05.343371 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d90585-c767-475f-b898-cfe037ee3ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:05.344114 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d90585-c767-475f-b898-cfe037ee3ae8 None admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:05.344302 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d90585-c767-475f-b898-cfe037ee3ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:05.344579 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d90585-c767-475f-b898-cfe037ee3ae8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:05.345310 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d90585-c767-475f-b898-cfe037ee3ae8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:05.346716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d90585-c767-475f-b898-cfe037ee3ae8 None admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:05.365602 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 657/1306] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Jun 29 12:11:05 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:11:15.202436 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=30 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:15.361308 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:12:10.557802 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c8078-f0f6-4a88-933d-d8c0ebc73f85 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:10.558286 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c8078-f0f6-4a88-933d-d8c0ebc73f85 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:10.558612 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c8078-f0f6-4a88-933d-d8c0ebc73f85 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:10.568161 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb79da6-527a-4835-9302-a5ee9352261c None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:10.568701 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb79da6-527a-4835-9302-a5ee9352261c None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:10.569057 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb79da6-527a-4835-9302-a5ee9352261c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:10.573315 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 650/1307] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:12:10 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:12:10.695667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-6fb79da6-527a-4835-9302-a5ee9352261c None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:12:10.698067 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-6fb79da6-527a-4835-9302-a5ee9352261c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:10.845799 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 658/1308] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:12:10.908594 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e5f37-6f12-45f4-a50f-8988e16dacf2 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:10.908945 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e5f37-6f12-45f4-a50f-8988e16dacf2 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:10.909158 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e5f37-6f12-45f4-a50f-8988e16dacf2 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:10.912978 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 651/1309] 10.222.0.13 () {54 vars in 964 bytes} [Wed Jun 29 12:12:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:12:10.918381 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3727c-77bc-43cf-b87f-dc6fbe8b55cf None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:10.918700 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3727c-77bc-43cf-b87f-dc6fbe8b55cf None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:10.918989 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3727c-77bc-43cf-b87f-dc6fbe8b55cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:11.015320 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-2aa3727c-77bc-43cf-b87f-dc6fbe8b55cf None None] MFA Rules not processed for user `50f5cc247f6b445f81fc3715d7bce92d`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:12:11.016562 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-2aa3727c-77bc-43cf-b87f-dc6fbe8b55cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:11.040665 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:12:11.103298 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 659/1310] 10.222.0.13 () {58 vars in 1061 bytes} [Wed Jun 29 12:12:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:12:11.112987 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e5f37-6f12-45f4-a50f-8988e16dacf2 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:12:11.114930 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-098e5f37-6f12-45f4-a50f-8988e16dacf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:11.252995 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e5f37-6f12-45f4-a50f-8988e16dacf2 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:12:11.339105 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be3c3b-c4bc-4979-92da-ddcebc36970b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:12:11.339772 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be3c3b-c4bc-4979-92da-ddcebc36970b service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:11.340059 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be3c3b-c4bc-4979-92da-ddcebc36970b service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:11.340339 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be3c3b-c4bc-4979-92da-ddcebc36970b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:11.342107 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-55be3c3b-c4bc-4979-92da-ddcebc36970b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:11.403159 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:12:11.470330 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be3c3b-c4bc-4979-92da-ddcebc36970b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:12:11.471891 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be3c3b-c4bc-4979-92da-ddcebc36970b service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:12:11.491922 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 652/1311] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:12:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:12:13.932413 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48089981-f03a-45db-8782-02bcc6859077 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:13.932915 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48089981-f03a-45db-8782-02bcc6859077 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:13.933067 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48089981-f03a-45db-8782-02bcc6859077 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:13.934561 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 660/1312] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:12:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:12:13.941437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a8833-8105-459a-94a9-bf5d5a3119d1 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:13.942344 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a8833-8105-459a-94a9-bf5d5a3119d1 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:13.942344 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a8833-8105-459a-94a9-bf5d5a3119d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:14.042037 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-124a8833-8105-459a-94a9-bf5d5a3119d1 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:12:14.043290 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-124a8833-8105-459a-94a9-bf5d5a3119d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:14.148565 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 653/1313] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:12:14.187047 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48089981-f03a-45db-8782-02bcc6859077 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:12:14.188585 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-48089981-f03a-45db-8782-02bcc6859077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:14.303517 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48089981-f03a-45db-8782-02bcc6859077 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:12:14.379087 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:12:14.382326 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dca75f-86b9-4876-97f9-1dbb6833cf75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:12:14.383200 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dca75f-86b9-4876-97f9-1dbb6833cf75 service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:14.383647 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dca75f-86b9-4876-97f9-1dbb6833cf75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:14.384122 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dca75f-86b9-4876-97f9-1dbb6833cf75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:14.385782 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-96dca75f-86b9-4876-97f9-1dbb6833cf75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:14.496693 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dca75f-86b9-4876-97f9-1dbb6833cf75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:12:14.498184 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dca75f-86b9-4876-97f9-1dbb6833cf75 service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:12:14.518171 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 661/1314] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:12:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:12:16.873749 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9179ef1-1ecf-4062-aa7c-4550525fe367 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:16.874284 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9179ef1-1ecf-4062-aa7c-4550525fe367 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:16.874284 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9179ef1-1ecf-4062-aa7c-4550525fe367 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:16.875844 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 654/1315] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:12:16.880950 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2c735-bef1-4368-b3c5-dc41395e12d7 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:16.881382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2c735-bef1-4368-b3c5-dc41395e12d7 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:16.881475 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2c735-bef1-4368-b3c5-dc41395e12d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:16.947177 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-acc2c735-bef1-4368-b3c5-dc41395e12d7 None None] MFA Rules not processed for user `831d3cfb8ffd4317a4ffe611c92f5d05`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:12:16.948386 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-acc2c735-bef1-4368-b3c5-dc41395e12d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:17.000887 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:12:17.045975 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 662/1316] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:12:16 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:12:17.099296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abdcfd-20cb-472e-bcd0-cbe5c32410ad None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:17.099577 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abdcfd-20cb-472e-bcd0-cbe5c32410ad None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:17.099854 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abdcfd-20cb-472e-bcd0-cbe5c32410ad None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:17.101237 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 655/1317] 10.222.0.13 () {54 vars in 964 bytes} [Wed Jun 29 12:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:12:17.107584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29085f-ff8a-48c3-b400-eab2d52f2e87 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:17.107849 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29085f-ff8a-48c3-b400-eab2d52f2e87 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:17.108124 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29085f-ff8a-48c3-b400-eab2d52f2e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:17.194869 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-fc29085f-ff8a-48c3-b400-eab2d52f2e87 None None] MFA Rules not processed for user `50f5cc247f6b445f81fc3715d7bce92d`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:12:17.196096 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-fc29085f-ff8a-48c3-b400-eab2d52f2e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:17.274848 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 663/1318] 10.222.0.13 () {58 vars in 1061 bytes} [Wed Jun 29 12:12:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:12:17.284889 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13abdcfd-20cb-472e-bcd0-cbe5c32410ad None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:12:17.286507 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-13abdcfd-20cb-472e-bcd0-cbe5c32410ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:17.296193 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:12:17.390899 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13abdcfd-20cb-472e-bcd0-cbe5c32410ad None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:12:17.466284 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402bf95-381f-44a7-9da2-cdafda5c57e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:12:17.466971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402bf95-381f-44a7-9da2-cdafda5c57e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:17.467253 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402bf95-381f-44a7-9da2-cdafda5c57e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:17.467527 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402bf95-381f-44a7-9da2-cdafda5c57e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:17.469185 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-f402bf95-381f-44a7-9da2-cdafda5c57e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:17.532874 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:12:17.582151 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402bf95-381f-44a7-9da2-cdafda5c57e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:12:17.583618 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402bf95-381f-44a7-9da2-cdafda5c57e2 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:12:17.601870 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 656/1319] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:12:17 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:12:20.556316 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b151b37-6bc3-4e9e-ac0f-c6041bcf1e96 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:20.556887 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b151b37-6bc3-4e9e-ac0f-c6041bcf1e96 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:20.556887 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b151b37-6bc3-4e9e-ac0f-c6041bcf1e96 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:20.558141 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 664/1320] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:12:20.563599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cebaee-eb7a-4d5e-88eb-5cb58425f429 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:20.564097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cebaee-eb7a-4d5e-88eb-5cb58425f429 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:20.564201 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cebaee-eb7a-4d5e-88eb-5cb58425f429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:20.632951 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-c9cebaee-eb7a-4d5e-88eb-5cb58425f429 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:12:20.634136 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-c9cebaee-eb7a-4d5e-88eb-5cb58425f429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:20.730984 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 657/1321] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:12:20 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:12:20.769084 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b151b37-6bc3-4e9e-ac0f-c6041bcf1e96 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:12:20.770600 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-5b151b37-6bc3-4e9e-ac0f-c6041bcf1e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:20.820454 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:12:20.872197 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b151b37-6bc3-4e9e-ac0f-c6041bcf1e96 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:12:20.943555 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f581e4b-42cb-40f3-82de-6ae172287fc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:12:20.944193 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f581e4b-42cb-40f3-82de-6ae172287fc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:20.944476 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f581e4b-42cb-40f3-82de-6ae172287fc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:20.944751 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f581e4b-42cb-40f3-82de-6ae172287fc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:20.946385 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-6f581e4b-42cb-40f3-82de-6ae172287fc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:21.039922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:12:21.053762 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f581e4b-42cb-40f3-82de-6ae172287fc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:12:21.055252 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f581e4b-42cb-40f3-82de-6ae172287fc0 service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:12:21.078567 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 665/1322] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:12:20 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:12:23.847149 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda4318-147c-4922-940e-d1b7d99be566 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:23.847710 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda4318-147c-4922-940e-d1b7d99be566 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:23.847710 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda4318-147c-4922-940e-d1b7d99be566 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:23.849248 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 658/1323] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:12:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:12:23.854307 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cd119-7f83-4bc5-99ad-ae5b49cac54a None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:23.854785 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cd119-7f83-4bc5-99ad-ae5b49cac54a None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:23.854920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cd119-7f83-4bc5-99ad-ae5b49cac54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:23.920918 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-654cd119-7f83-4bc5-99ad-ae5b49cac54a None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:12:23.922107 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-654cd119-7f83-4bc5-99ad-ae5b49cac54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:24.048526 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 666/1324] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:12:24.086351 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda4318-147c-4922-940e-d1b7d99be566 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:12:24.088066 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-fbda4318-147c-4922-940e-d1b7d99be566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:24.110190 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:12:24.207342 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda4318-147c-4922-940e-d1b7d99be566 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:12:24.291258 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4981b3e-55d9-4700-92ee-adf227aef5e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:12:24.291907 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4981b3e-55d9-4700-92ee-adf227aef5e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:24.292187 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4981b3e-55d9-4700-92ee-adf227aef5e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:24.292460 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4981b3e-55d9-4700-92ee-adf227aef5e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:24.294135 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-e4981b3e-55d9-4700-92ee-adf227aef5e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:24.370885 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:12:24.414621 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4981b3e-55d9-4700-92ee-adf227aef5e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:12:24.416024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4981b3e-55d9-4700-92ee-adf227aef5e8 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:12:24.434213 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 659/1325] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:12:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:12:26.554347 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2b934-0856-4543-b6dd-e6f293d9326c None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:26.554959 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2b934-0856-4543-b6dd-e6f293d9326c None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:26.554959 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2b934-0856-4543-b6dd-e6f293d9326c None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:26.556221 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 667/1326] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:12:26.561985 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea5099-02c6-4687-9609-4d547af600fb None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:26.562505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea5099-02c6-4687-9609-4d547af600fb None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:26.562596 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea5099-02c6-4687-9609-4d547af600fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:26.628180 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-a4ea5099-02c6-4687-9609-4d547af600fb None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:12:26.629391 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-a4ea5099-02c6-4687-9609-4d547af600fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:26.729895 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 660/1327] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:12:26.765511 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2b934-0856-4543-b6dd-e6f293d9326c None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:12:26.767110 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-bcd2b934-0856-4543-b6dd-e6f293d9326c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:26.828243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:12:26.872834 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2b934-0856-4543-b6dd-e6f293d9326c None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:12:26.950482 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5414693-7df9-46fb-acbc-c6637e79e850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:12:26.951175 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5414693-7df9-46fb-acbc-c6637e79e850 service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:26.951461 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5414693-7df9-46fb-acbc-c6637e79e850 service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:26.951739 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5414693-7df9-46fb-acbc-c6637e79e850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:26.953415 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-a5414693-7df9-46fb-acbc-c6637e79e850 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:27.060236 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:12:27.062766 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5414693-7df9-46fb-acbc-c6637e79e850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:12:27.064953 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5414693-7df9-46fb-acbc-c6637e79e850 service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:12:27.089810 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 668/1328] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:12:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:12:29.204271 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ebf73-cac5-4b47-a6dc-1ff3f8352722 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:29.204829 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ebf73-cac5-4b47-a6dc-1ff3f8352722 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:29.204829 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ebf73-cac5-4b47-a6dc-1ff3f8352722 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:29.206553 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 661/1329] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:12:29.211862 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5f34b-e618-45a8-81cd-7fa5709947cc None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:29.212340 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5f34b-e618-45a8-81cd-7fa5709947cc None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:29.212459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5f34b-e618-45a8-81cd-7fa5709947cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:29.279037 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-bed5f34b-e618-45a8-81cd-7fa5709947cc None None] MFA Rules not processed for user `831d3cfb8ffd4317a4ffe611c92f5d05`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:12:29.280244 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-bed5f34b-e618-45a8-81cd-7fa5709947cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:29.389711 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 669/1330] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:12:29 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:12:29.428016 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ebf73-cac5-4b47-a6dc-1ff3f8352722 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:12:29.429614 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-1d5ebf73-cac5-4b47-a6dc-1ff3f8352722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:29.461632 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:12:29.538279 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ebf73-cac5-4b47-a6dc-1ff3f8352722 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:12:29.612049 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380a335-62e0-4810-9294-836d243ba2bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:12:29.612705 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380a335-62e0-4810-9294-836d243ba2bc service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:29.612979 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380a335-62e0-4810-9294-836d243ba2bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:29.613247 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380a335-62e0-4810-9294-836d243ba2bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:29.614913 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-1380a335-62e0-4810-9294-836d243ba2bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:29.694448 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:12:29.741117 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380a335-62e0-4810-9294-836d243ba2bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:12:29.742557 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380a335-62e0-4810-9294-836d243ba2bc service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:12:29.765200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 662/1331] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:12:29 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:12:32.084632 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eaa5c9-ff2f-4f32-981c-e05ed193e16e None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:32.085169 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eaa5c9-ff2f-4f32-981c-e05ed193e16e None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:32.085169 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eaa5c9-ff2f-4f32-981c-e05ed193e16e None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:32.086511 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 670/1332] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:12:32.091699 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcf16b-1e9f-4bdf-be6f-88dbe72df3ff None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:32.092120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcf16b-1e9f-4bdf-be6f-88dbe72df3ff None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:32.092277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcf16b-1e9f-4bdf-be6f-88dbe72df3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:32.159251 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-94bcf16b-1e9f-4bdf-be6f-88dbe72df3ff None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:12:32.160459 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-94bcf16b-1e9f-4bdf-be6f-88dbe72df3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:32.255876 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 663/1333] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:12:32.292238 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eaa5c9-ff2f-4f32-981c-e05ed193e16e None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:12:32.293770 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-a9eaa5c9-ff2f-4f32-981c-e05ed193e16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:32.365335 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:12:32.405411 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eaa5c9-ff2f-4f32-981c-e05ed193e16e None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:12:32.480070 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99adcf-a6a3-4d20-bf66-c61ca5c95094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:12:32.480784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99adcf-a6a3-4d20-bf66-c61ca5c95094 service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:32.481071 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99adcf-a6a3-4d20-bf66-c61ca5c95094 service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:32.481347 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99adcf-a6a3-4d20-bf66-c61ca5c95094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:32.483078 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-4d99adcf-a6a3-4d20-bf66-c61ca5c95094 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:32.600719 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d99adcf-a6a3-4d20-bf66-c61ca5c95094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:12:32.602183 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d99adcf-a6a3-4d20-bf66-c61ca5c95094 service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:12:32.614304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:12:32.623462 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 671/1334] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:12:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:12:34.717027 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023edef4-3713-4543-9491-40cebda99a0b None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:34.717602 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023edef4-3713-4543-9491-40cebda99a0b None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:34.717602 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023edef4-3713-4543-9491-40cebda99a0b None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:34.718997 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 664/1335] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:12:34.725078 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd78e8-1a40-4e00-b82c-62c4a29d531d None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:34.725554 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd78e8-1a40-4e00-b82c-62c4a29d531d None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:34.725663 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd78e8-1a40-4e00-b82c-62c4a29d531d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:34.789800 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-a2dd78e8-1a40-4e00-b82c-62c4a29d531d None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:12:34.791053 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-a2dd78e8-1a40-4e00-b82c-62c4a29d531d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:34.887171 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 672/1336] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:12:34.928249 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023edef4-3713-4543-9491-40cebda99a0b None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:12:34.929802 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-023edef4-3713-4543-9491-40cebda99a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:34.971175 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:12:35.035411 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023edef4-3713-4543-9491-40cebda99a0b None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:12:35.109551 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976dde0-2782-4cec-bf04-24bad63e3799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:12:35.110206 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976dde0-2782-4cec-bf04-24bad63e3799 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:35.110492 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976dde0-2782-4cec-bf04-24bad63e3799 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:35.111365 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976dde0-2782-4cec-bf04-24bad63e3799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:35.113017 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-f976dde0-2782-4cec-bf04-24bad63e3799 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:35.195441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:12:35.222055 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976dde0-2782-4cec-bf04-24bad63e3799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:12:35.223452 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976dde0-2782-4cec-bf04-24bad63e3799 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:12:35.243158 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 665/1337] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:12:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:12:37.803658 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecf300-7c51-4132-9033-7a485abce533 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:37.804186 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecf300-7c51-4132-9033-7a485abce533 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:37.804186 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecf300-7c51-4132-9033-7a485abce533 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:37.805580 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 673/1338] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:12:37.810890 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478b185-3c62-4c04-8b57-9b15f7b43477 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:37.811322 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478b185-3c62-4c04-8b57-9b15f7b43477 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:37.811455 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478b185-3c62-4c04-8b57-9b15f7b43477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:37.875033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-d478b185-3c62-4c04-8b57-9b15f7b43477 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:12:37.876225 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-d478b185-3c62-4c04-8b57-9b15f7b43477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:37.970483 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 666/1339] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:12:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:12:38.005765 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ecf300-7c51-4132-9033-7a485abce533 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:12:38.007310 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-97ecf300-7c51-4132-9033-7a485abce533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:38.083080 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:12:38.111410 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ecf300-7c51-4132-9033-7a485abce533 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:12:38.182322 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956a7e0-b45c-4bf8-aad2-8840f66e8ab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:12:38.182984 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956a7e0-b45c-4bf8-aad2-8840f66e8ab3 service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:38.183267 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956a7e0-b45c-4bf8-aad2-8840f66e8ab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:38.183539 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956a7e0-b45c-4bf8-aad2-8840f66e8ab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:38.185162 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-1956a7e0-b45c-4bf8-aad2-8840f66e8ab3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:38.292200 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956a7e0-b45c-4bf8-aad2-8840f66e8ab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:12:38.293656 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956a7e0-b45c-4bf8-aad2-8840f66e8ab3 service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:12:38.312946 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 674/1340] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:12:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:12:42.454592 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d295d-b974-41b9-bc42-5ef59fefb86e None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:42.455172 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d295d-b974-41b9-bc42-5ef59fefb86e None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:42.455172 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d295d-b974-41b9-bc42-5ef59fefb86e None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:42.456564 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 667/1341] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:12:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:12:42.462015 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596b27e-795c-4b97-81b5-df264af89d93 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:42.462449 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596b27e-795c-4b97-81b5-df264af89d93 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:42.462843 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596b27e-795c-4b97-81b5-df264af89d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:42.475917 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:12:42.549841 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-f596b27e-795c-4b97-81b5-df264af89d93 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:12:42.551098 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-f596b27e-795c-4b97-81b5-df264af89d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:42.658216 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 675/1342] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:12:42.697373 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d295d-b974-41b9-bc42-5ef59fefb86e None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:12:42.699638 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-597d295d-b974-41b9-bc42-5ef59fefb86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:42.751592 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:12:42.797173 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d295d-b974-41b9-bc42-5ef59fefb86e None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:12:42.801624 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b36a34-de84-45dc-bc59-299131670cc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:12:42.802269 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b36a34-de84-45dc-bc59-299131670cc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:42.802549 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b36a34-de84-45dc-bc59-299131670cc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:42.802848 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b36a34-de84-45dc-bc59-299131670cc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:42.811901 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b36a34-de84-45dc-bc59-299131670cc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:12:42.813430 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b36a34-de84-45dc-bc59-299131670cc9 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:12:42.822799 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 668/1343] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:12:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:12:45.474268 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737203e-29d9-4f3d-9553-7a9fc1aab747 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:45.475038 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737203e-29d9-4f3d-9553-7a9fc1aab747 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:45.475038 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737203e-29d9-4f3d-9553-7a9fc1aab747 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:45.476261 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 676/1344] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:12:45.481752 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fddc4-0370-4b2d-b610-daec14d781aa None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:45.482239 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fddc4-0370-4b2d-b610-daec14d781aa None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:45.482351 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fddc4-0370-4b2d-b610-daec14d781aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:45.511257 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-555fddc4-0370-4b2d-b610-daec14d781aa None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:12:45.512472 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-555fddc4-0370-4b2d-b610-daec14d781aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:45.595038 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 669/1345] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:12:45 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:12:45.634324 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737203e-29d9-4f3d-9553-7a9fc1aab747 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:12:45.645778 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737203e-29d9-4f3d-9553-7a9fc1aab747 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:12:45.649447 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf8ef0-6bbe-4598-a317-b3b82b29b61c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:12:45.650120 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf8ef0-6bbe-4598-a317-b3b82b29b61c service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:45.650690 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf8ef0-6bbe-4598-a317-b3b82b29b61c service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:45.650969 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf8ef0-6bbe-4598-a317-b3b82b29b61c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:45.661316 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf8ef0-6bbe-4598-a317-b3b82b29b61c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:12:45.662811 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf8ef0-6bbe-4598-a317-b3b82b29b61c service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:12:45.674058 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 677/1346] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:12:45 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:12:49.804001 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fa90a-8cd9-49ad-afcf-eb2bc7825e8e None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:49.804567 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fa90a-8cd9-49ad-afcf-eb2bc7825e8e None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:49.804567 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fa90a-8cd9-49ad-afcf-eb2bc7825e8e None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:49.805927 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 670/1347] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:12:49.811331 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1fde5-2179-43a7-9719-d6110f3cb41e None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:49.811788 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1fde5-2179-43a7-9719-d6110f3cb41e None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:49.811923 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1fde5-2179-43a7-9719-d6110f3cb41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:49.829546 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-abc1fde5-2179-43a7-9719-d6110f3cb41e None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:12:49.830661 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-abc1fde5-2179-43a7-9719-d6110f3cb41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:49.838810 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 678/1348] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:12:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:12:49.877362 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fa90a-8cd9-49ad-afcf-eb2bc7825e8e None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:12:49.889094 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fa90a-8cd9-49ad-afcf-eb2bc7825e8e None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:12:49.893669 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e885756-5b5c-482d-b48f-d8e5e3ed9e73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:12:49.894314 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e885756-5b5c-482d-b48f-d8e5e3ed9e73 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:49.894594 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e885756-5b5c-482d-b48f-d8e5e3ed9e73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:49.894905 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e885756-5b5c-482d-b48f-d8e5e3ed9e73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:49.904539 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e885756-5b5c-482d-b48f-d8e5e3ed9e73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:12:49.905965 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e885756-5b5c-482d-b48f-d8e5e3ed9e73 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:12:49.916486 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 671/1349] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:12:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:12:54.967443 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f6606-de3b-4e92-a1b3-0fb11a8972ef None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:54.967931 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f6606-de3b-4e92-a1b3-0fb11a8972ef None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:54.968013 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f6606-de3b-4e92-a1b3-0fb11a8972ef None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:54.970095 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 679/1350] 10.222.0.13 () {54 vars in 921 bytes} [Wed Jun 29 12:12:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:12:54.975195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a572a3-8f1c-4b99-8e58-9c0e9f3df707 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:54.976206 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a572a3-8f1c-4b99-8e58-9c0e9f3df707 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:54.976653 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a572a3-8f1c-4b99-8e58-9c0e9f3df707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:55.066151 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-b7a572a3-8f1c-4b99-8e58-9c0e9f3df707 None None] MFA Rules not processed for user `cd57c8b894e74c709ea389ed462184fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:12:55.067363 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-b7a572a3-8f1c-4b99-8e58-9c0e9f3df707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:55.104596 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:12:55.165255 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 672/1351] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Jun 29 12:12:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:12:59.482285 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b96d23-d04d-4192-bbba-29ae2559e5b9 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:59.483357 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b96d23-d04d-4192-bbba-29ae2559e5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:59.483920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b96d23-d04d-4192-bbba-29ae2559e5b9 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:59.485828 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 680/1352] 10.222.0.13 () {54 vars in 921 bytes} [Wed Jun 29 12:12:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:12:59.491238 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885aaeb8-e9e1-45df-9fbb-797bc321ee9b None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:59.492160 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885aaeb8-e9e1-45df-9fbb-797bc321ee9b None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:59.492649 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885aaeb8-e9e1-45df-9fbb-797bc321ee9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:59.512211 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-885aaeb8-e9e1-45df-9fbb-797bc321ee9b None None] MFA Rules not processed for user `cd57c8b894e74c709ea389ed462184fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:12:59.513751 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-885aaeb8-e9e1-45df-9fbb-797bc321ee9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:59.524186 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 673/1353] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Jun 29 12:12:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:12:59.824492 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=72 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:13:01.207067 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec1a7f-2093-4fa7-8576-18c1ce420ea3 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:01.207823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec1a7f-2093-4fa7-8576-18c1ce420ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:01.207823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec1a7f-2093-4fa7-8576-18c1ce420ea3 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:01.209055 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 681/1354] 10.222.0.13 () {54 vars in 921 bytes} [Wed Jun 29 12:13:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:01.214339 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c63974-c3df-44ab-80ba-45932dc2f8c8 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:01.214844 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c63974-c3df-44ab-80ba-45932dc2f8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:01.214945 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c63974-c3df-44ab-80ba-45932dc2f8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:01.234437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-a6c63974-c3df-44ab-80ba-45932dc2f8c8 None None] MFA Rules not processed for user `cd57c8b894e74c709ea389ed462184fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:01.235710 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-a6c63974-c3df-44ab-80ba-45932dc2f8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:01.244202 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 674/1355] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Jun 29 12:13:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:04.903035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462f92c-84e4-4bd6-b797-a9ae6030feff None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:04.903954 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462f92c-84e4-4bd6-b797-a9ae6030feff None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:04.904329 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462f92c-84e4-4bd6-b797-a9ae6030feff None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:04.907056 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 682/1356] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:13:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:04.914166 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda3429-d6bc-4292-a617-ee6664ec63f2 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:04.914624 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda3429-d6bc-4292-a617-ee6664ec63f2 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:04.914946 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda3429-d6bc-4292-a617-ee6664ec63f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:04.933084 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-6fda3429-d6bc-4292-a617-ee6664ec63f2 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:04.934285 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-6fda3429-d6bc-4292-a617-ee6664ec63f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:04.942437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 675/1357] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:04.999432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e3632-49e5-44bc-82fb-6294f9d73479 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:05.001029 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e3632-49e5-44bc-82fb-6294f9d73479 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:05.001539 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e3632-49e5-44bc-82fb-6294f9d73479 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:05.003239 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 683/1358] 10.222.0.13 () {54 vars in 961 bytes} [Wed Jun 29 12:13:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:05.013516 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a9ba3-f957-44eb-b1a6-9ddfa8d893ad None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:05.015068 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a9ba3-f957-44eb-b1a6-9ddfa8d893ad None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:05.016140 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a9ba3-f957-44eb-b1a6-9ddfa8d893ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:05.068528 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-672a9ba3-f957-44eb-b1a6-9ddfa8d893ad None None] MFA Rules not processed for user `3fbcf547421b42e4b520f9246326bff8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:05.069856 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-672a9ba3-f957-44eb-b1a6-9ddfa8d893ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:05.164564 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 676/1359] 10.222.0.13 () {58 vars in 1058 bytes} [Wed Jun 29 12:13:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:05.172937 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e3632-49e5-44bc-82fb-6294f9d73479 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:05.188560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e3632-49e5-44bc-82fb-6294f9d73479 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:05.194947 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67a89e-42ec-4be4-88bc-5e3569c2382c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:05.196043 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67a89e-42ec-4be4-88bc-5e3569c2382c service nova] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:05.196412 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67a89e-42ec-4be4-88bc-5e3569c2382c service nova] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:05.196808 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67a89e-42ec-4be4-88bc-5e3569c2382c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:05.206328 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a67a89e-42ec-4be4-88bc-5e3569c2382c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:05.208185 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a67a89e-42ec-4be4-88bc-5e3569c2382c service nova] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:05.219169 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 684/1360] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:13:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:13:07.497508 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cc71a-0a25-458d-8196-5138ed513b6c None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:07.498081 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cc71a-0a25-458d-8196-5138ed513b6c None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:07.498081 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cc71a-0a25-458d-8196-5138ed513b6c None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:07.500133 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 677/1361] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:07.505491 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a37865-6b13-4f30-a250-e8794827e793 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:07.505925 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a37865-6b13-4f30-a250-e8794827e793 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:07.506053 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a37865-6b13-4f30-a250-e8794827e793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:07.525833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-39a37865-6b13-4f30-a250-e8794827e793 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:07.527342 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-39a37865-6b13-4f30-a250-e8794827e793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:07.537627 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 685/1362] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:07.583923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cc71a-0a25-458d-8196-5138ed513b6c None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:07.599625 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cc71a-0a25-458d-8196-5138ed513b6c None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:07.605254 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57421535-c18e-499e-b366-b9ac7838600c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:07.605904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57421535-c18e-499e-b366-b9ac7838600c service nova] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:07.606194 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57421535-c18e-499e-b366-b9ac7838600c service nova] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:07.606473 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57421535-c18e-499e-b366-b9ac7838600c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:07.618888 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57421535-c18e-499e-b366-b9ac7838600c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:07.620527 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57421535-c18e-499e-b366-b9ac7838600c service nova] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:07.633446 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 678/1363] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:13:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:13:10.055825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d5f13-6ddf-4294-b721-6abd75daed86 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:10.056277 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d5f13-6ddf-4294-b721-6abd75daed86 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:10.056381 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d5f13-6ddf-4294-b721-6abd75daed86 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:10.057734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 686/1364] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:10.063874 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1c033-53f9-4f02-a796-89a5611c975f None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:10.064394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1c033-53f9-4f02-a796-89a5611c975f None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:10.064544 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1c033-53f9-4f02-a796-89a5611c975f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:10.085534 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-e7f1c033-53f9-4f02-a796-89a5611c975f None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:10.086865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-e7f1c033-53f9-4f02-a796-89a5611c975f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:10.095935 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 679/1365] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:10.152046 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea93368-691c-4449-9555-0df49da7b5d9 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:10.152330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea93368-691c-4449-9555-0df49da7b5d9 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:10.152606 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea93368-691c-4449-9555-0df49da7b5d9 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:10.154185 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 687/1366] 10.222.0.13 () {54 vars in 961 bytes} [Wed Jun 29 12:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:10.161409 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfe78a-f29a-4942-b4df-d33f7b2c0fc0 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:10.161690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfe78a-f29a-4942-b4df-d33f7b2c0fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:10.162203 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfe78a-f29a-4942-b4df-d33f7b2c0fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:10.184997 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-e2dfe78a-f29a-4942-b4df-d33f7b2c0fc0 None None] MFA Rules not processed for user `3fbcf547421b42e4b520f9246326bff8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:10.186214 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-e2dfe78a-f29a-4942-b4df-d33f7b2c0fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:10.197820 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 680/1367] 10.222.0.13 () {58 vars in 1058 bytes} [Wed Jun 29 12:13:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:10.205880 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea93368-691c-4449-9555-0df49da7b5d9 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:10.222446 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea93368-691c-4449-9555-0df49da7b5d9 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:10.228007 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36c2d5-db1f-4a6c-9bbc-bd201c9dceef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:10.228661 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36c2d5-db1f-4a6c-9bbc-bd201c9dceef service nova] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:10.228943 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36c2d5-db1f-4a6c-9bbc-bd201c9dceef service nova] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:10.229222 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36c2d5-db1f-4a6c-9bbc-bd201c9dceef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:10.238883 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36c2d5-db1f-4a6c-9bbc-bd201c9dceef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:10.240529 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36c2d5-db1f-4a6c-9bbc-bd201c9dceef service nova] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:10.253311 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 688/1368] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:13:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:13:12.487595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ef371-077d-4725-b1ab-10be60126ec5 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:12.488221 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ef371-077d-4725-b1ab-10be60126ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:12.488221 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ef371-077d-4725-b1ab-10be60126ec5 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:12.489549 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 681/1369] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:12.498016 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f70f2-d9f9-4b88-a5e7-4ea2ac9a31b6 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:12.498761 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f70f2-d9f9-4b88-a5e7-4ea2ac9a31b6 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:12.499093 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f70f2-d9f9-4b88-a5e7-4ea2ac9a31b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:12.522684 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-739f70f2-d9f9-4b88-a5e7-4ea2ac9a31b6 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:12.524093 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-739f70f2-d9f9-4b88-a5e7-4ea2ac9a31b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:12.541806 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 689/1370] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:13:12.584054 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ef371-077d-4725-b1ab-10be60126ec5 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:12.602483 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ef371-077d-4725-b1ab-10be60126ec5 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:12.609900 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f59ef-ec22-4cc0-8fdd-973360eece7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:12.610843 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f59ef-ec22-4cc0-8fdd-973360eece7a service nova] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:12.611317 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f59ef-ec22-4cc0-8fdd-973360eece7a service nova] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:12.611761 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f59ef-ec22-4cc0-8fdd-973360eece7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:12.622797 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f59ef-ec22-4cc0-8fdd-973360eece7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:12.625877 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f59ef-ec22-4cc0-8fdd-973360eece7a service nova] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:12.637034 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 682/1371] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:13:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:13:13.421584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87302b13-3b5c-43e2-a940-31adf5276d63 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:13.422110 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87302b13-3b5c-43e2-a940-31adf5276d63 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:13.422373 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87302b13-3b5c-43e2-a940-31adf5276d63 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:13.424170 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 690/1372] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:13:13.431104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d4a59-2662-4168-a2fa-70b111857e30 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:13.432075 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d4a59-2662-4168-a2fa-70b111857e30 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:13.433003 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d4a59-2662-4168-a2fa-70b111857e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:13.460740 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-a00d4a59-2662-4168-a2fa-70b111857e30 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:13.462316 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-a00d4a59-2662-4168-a2fa-70b111857e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:13.471633 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 683/1373] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:13.828424 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbd71b-9c2e-46f8-a3c6-ed1228bd91a7 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:13.828424 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbd71b-9c2e-46f8-a3c6-ed1228bd91a7 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:13.828924 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbd71b-9c2e-46f8-a3c6-ed1228bd91a7 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:13.831791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 691/1374] 10.222.0.13 () {54 vars in 963 bytes} [Wed Jun 29 12:13:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:13.836754 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c7c54-7430-4052-ac89-715f375ced9f None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:13.837317 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c7c54-7430-4052-ac89-715f375ced9f None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:13.837317 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c7c54-7430-4052-ac89-715f375ced9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:13.845101 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:13:13.902979 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-126c7c54-7430-4052-ac89-715f375ced9f None None] MFA Rules not processed for user `4009947e15c347e19da8b4fbddfb2875`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:13.904201 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-126c7c54-7430-4052-ac89-715f375ced9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:13.974691 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 684/1375] 10.222.0.13 () {58 vars in 1060 bytes} [Wed Jun 29 12:13:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:13.982030 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dbd71b-9c2e-46f8-a3c6-ed1228bd91a7 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:13.999437 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dbd71b-9c2e-46f8-a3c6-ed1228bd91a7 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:14.003150 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cdd15-5597-465a-a303-8c254ac67a46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:14.004000 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cdd15-5597-465a-a303-8c254ac67a46 service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:14.004286 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cdd15-5597-465a-a303-8c254ac67a46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:14.004568 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cdd15-5597-465a-a303-8c254ac67a46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:14.014526 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cdd15-5597-465a-a303-8c254ac67a46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:14.016721 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cdd15-5597-465a-a303-8c254ac67a46 service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:14.027526 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 692/1376] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:13:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:13:14.779731 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8eaa0-c8bd-4b01-abec-1451850dd149 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:14.780081 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8eaa0-c8bd-4b01-abec-1451850dd149 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:14.780483 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8eaa0-c8bd-4b01-abec-1451850dd149 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:14.782871 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 685/1377] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:13:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:14.789421 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622fd2d-2276-4ef9-b167-61e3d7838aec None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:14.790282 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622fd2d-2276-4ef9-b167-61e3d7838aec None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:14.791095 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622fd2d-2276-4ef9-b167-61e3d7838aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:14.823909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-7622fd2d-2276-4ef9-b167-61e3d7838aec None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:14.825141 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-7622fd2d-2276-4ef9-b167-61e3d7838aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:14.843434 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 693/1378] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:13:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:14.891787 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8eaa0-c8bd-4b01-abec-1451850dd149 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:14.909165 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8eaa0-c8bd-4b01-abec-1451850dd149 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:14.916274 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a598a86-6a2e-420c-bc5c-9057f3b773c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:14.917069 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a598a86-6a2e-420c-bc5c-9057f3b773c3 service nova] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:14.917545 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a598a86-6a2e-420c-bc5c-9057f3b773c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:14.917827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a598a86-6a2e-420c-bc5c-9057f3b773c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:14.930224 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a598a86-6a2e-420c-bc5c-9057f3b773c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:14.931889 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a598a86-6a2e-420c-bc5c-9057f3b773c3 service nova] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:14.943158 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 686/1379] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:13:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:13:17.098876 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0f9f8-69ac-4373-a3d0-52d63740f174 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:17.099423 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0f9f8-69ac-4373-a3d0-52d63740f174 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:17.099423 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0f9f8-69ac-4373-a3d0-52d63740f174 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:17.102874 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 694/1380] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:17.106499 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c6ad0-3e86-43fa-be69-93013374b86c None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:17.107004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c6ad0-3e86-43fa-be69-93013374b86c None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:17.107101 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c6ad0-3e86-43fa-be69-93013374b86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:17.126480 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-003c6ad0-3e86-43fa-be69-93013374b86c None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:17.127724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-003c6ad0-3e86-43fa-be69-93013374b86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:17.135819 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 687/1381] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:17.183293 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0f9f8-69ac-4373-a3d0-52d63740f174 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:17.200548 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0f9f8-69ac-4373-a3d0-52d63740f174 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:17.206109 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cd92b-0ee3-4539-ab5b-92e04f935ef8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:17.206770 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cd92b-0ee3-4539-ab5b-92e04f935ef8 service nova] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:17.207053 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cd92b-0ee3-4539-ab5b-92e04f935ef8 service nova] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:17.207326 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cd92b-0ee3-4539-ab5b-92e04f935ef8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:17.217137 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1cd92b-0ee3-4539-ab5b-92e04f935ef8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:17.219387 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1cd92b-0ee3-4539-ab5b-92e04f935ef8 service nova] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:17.229939 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 695/1382] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:13:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:13:19.405121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f2cbf-9ce0-41a1-afed-65267d217935 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:19.407302 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f2cbf-9ce0-41a1-afed-65267d217935 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:19.407949 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f2cbf-9ce0-41a1-afed-65267d217935 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:19.414749 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 688/1383] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:13:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:19.416689 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c24cd6-1d3e-42f6-bb44-f198c21dba4a None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:19.417165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c24cd6-1d3e-42f6-bb44-f198c21dba4a None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:19.417257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c24cd6-1d3e-42f6-bb44-f198c21dba4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:19.436901 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-b3c24cd6-1d3e-42f6-bb44-f198c21dba4a None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:19.438213 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-b3c24cd6-1d3e-42f6-bb44-f198c21dba4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:19.446588 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 696/1384] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:19.498111 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f2cbf-9ce0-41a1-afed-65267d217935 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:19.522426 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f2cbf-9ce0-41a1-afed-65267d217935 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:19.528982 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50809a1f-d4c6-4475-9af7-c178a512d641 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:19.529648 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50809a1f-d4c6-4475-9af7-c178a512d641 service nova] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:19.529936 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50809a1f-d4c6-4475-9af7-c178a512d641 service nova] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:19.530217 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50809a1f-d4c6-4475-9af7-c178a512d641 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:19.545783 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50809a1f-d4c6-4475-9af7-c178a512d641 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:19.547711 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50809a1f-d4c6-4475-9af7-c178a512d641 service nova] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:19.558797 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 689/1385] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:13:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:13:21.696900 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70250ff-eced-47dc-9fa1-08a0ba62900f None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:21.697877 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70250ff-eced-47dc-9fa1-08a0ba62900f None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:21.698159 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70250ff-eced-47dc-9fa1-08a0ba62900f None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:21.699727 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 697/1386] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:13:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:21.706600 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00783828-3b3a-41ea-8fdf-8f1214a946bd None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:21.707231 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00783828-3b3a-41ea-8fdf-8f1214a946bd None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:21.707231 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00783828-3b3a-41ea-8fdf-8f1214a946bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:21.735139 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-00783828-3b3a-41ea-8fdf-8f1214a946bd None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:21.736585 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-00783828-3b3a-41ea-8fdf-8f1214a946bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:21.748713 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 690/1387] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:21.802171 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70250ff-eced-47dc-9fa1-08a0ba62900f None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:21.826393 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70250ff-eced-47dc-9fa1-08a0ba62900f None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:21.839396 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7a4d3-db46-4e81-ba57-7c9f932cbeef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:21.840041 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7a4d3-db46-4e81-ba57-7c9f932cbeef service nova] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:21.840501 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7a4d3-db46-4e81-ba57-7c9f932cbeef service nova] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:21.841116 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7a4d3-db46-4e81-ba57-7c9f932cbeef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:21.871275 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7a4d3-db46-4e81-ba57-7c9f932cbeef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:21.876220 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7a4d3-db46-4e81-ba57-7c9f932cbeef service nova] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:21.904869 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 698/1388] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:13:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:13:24.962181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd7b6f-4fcb-4ba4-940c-f90e03e1f1cb None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:24.962942 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd7b6f-4fcb-4ba4-940c-f90e03e1f1cb None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:24.963474 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd7b6f-4fcb-4ba4-940c-f90e03e1f1cb None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:24.966343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 691/1389] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:13:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:24.973075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d8ec8-b2e4-4933-80b2-a824c0732724 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:24.973727 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d8ec8-b2e4-4933-80b2-a824c0732724 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:24.973727 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d8ec8-b2e4-4933-80b2-a824c0732724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:24.996463 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-967d8ec8-b2e4-4933-80b2-a824c0732724 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:24.997985 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-967d8ec8-b2e4-4933-80b2-a824c0732724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:25.009648 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 699/1390] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:25.063759 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd7b6f-4fcb-4ba4-940c-f90e03e1f1cb None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:25.074431 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd7b6f-4fcb-4ba4-940c-f90e03e1f1cb None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:25.082108 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4a114-0441-4e61-b076-3e56428e45c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:25.083188 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4a114-0441-4e61-b076-3e56428e45c1 service nova] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:25.083654 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4a114-0441-4e61-b076-3e56428e45c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:25.084074 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4a114-0441-4e61-b076-3e56428e45c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:25.099611 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab4a114-0441-4e61-b076-3e56428e45c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:25.102459 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab4a114-0441-4e61-b076-3e56428e45c1 service nova] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:25.120428 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 692/1391] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:13:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:13:27.318601 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba097f5-8bb8-45dd-88ec-f575f40d4da8 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:27.319202 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba097f5-8bb8-45dd-88ec-f575f40d4da8 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:27.319300 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba097f5-8bb8-45dd-88ec-f575f40d4da8 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:27.321155 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 700/1392] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:13:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:13:27.329215 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f153971-3165-435d-ab37-4908b16259ce None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:27.329753 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f153971-3165-435d-ab37-4908b16259ce None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:27.329994 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f153971-3165-435d-ab37-4908b16259ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:27.354926 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-7f153971-3165-435d-ab37-4908b16259ce None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:27.356174 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-7f153971-3165-435d-ab37-4908b16259ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:27.364656 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 693/1393] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:13:27.425080 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba097f5-8bb8-45dd-88ec-f575f40d4da8 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:27.441253 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba097f5-8bb8-45dd-88ec-f575f40d4da8 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:27.447260 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3bc85-21b6-4235-a312-e04105ea7e4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:27.447925 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3bc85-21b6-4235-a312-e04105ea7e4d service nova] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:27.448209 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3bc85-21b6-4235-a312-e04105ea7e4d service nova] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:27.448646 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3bc85-21b6-4235-a312-e04105ea7e4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:27.458825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3bc85-21b6-4235-a312-e04105ea7e4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:27.460460 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3bc85-21b6-4235-a312-e04105ea7e4d service nova] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:27.471349 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 701/1394] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:13:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:13:29.616146 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b408bf-c0fc-4f95-bc97-e2aac6e5d227 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:29.616740 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b408bf-c0fc-4f95-bc97-e2aac6e5d227 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:29.616740 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b408bf-c0fc-4f95-bc97-e2aac6e5d227 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:29.618085 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 694/1395] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:29.623511 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190f49b-6926-4743-b6b5-073139dba1ad None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:29.623957 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190f49b-6926-4743-b6b5-073139dba1ad None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:29.624057 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190f49b-6926-4743-b6b5-073139dba1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:29.643929 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-1190f49b-6926-4743-b6b5-073139dba1ad None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:29.645227 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-1190f49b-6926-4743-b6b5-073139dba1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:29.653933 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 702/1396] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:29.699532 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b408bf-c0fc-4f95-bc97-e2aac6e5d227 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:29.715623 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b408bf-c0fc-4f95-bc97-e2aac6e5d227 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:29.723127 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40edf914-d0b6-4f0a-b98f-9dfcbbdc9470 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:29.723940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edf914-d0b6-4f0a-b98f-9dfcbbdc9470 service nova] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:29.724387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edf914-d0b6-4f0a-b98f-9dfcbbdc9470 service nova] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:29.724669 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edf914-d0b6-4f0a-b98f-9dfcbbdc9470 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:29.734732 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40edf914-d0b6-4f0a-b98f-9dfcbbdc9470 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:29.736425 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40edf914-d0b6-4f0a-b98f-9dfcbbdc9470 service nova] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:29.737564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b89e3-29ec-4383-8c0e-e22ef91a3278 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:29.737856 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b89e3-29ec-4383-8c0e-e22ef91a3278 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:29.738138 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b89e3-29ec-4383-8c0e-e22ef91a3278 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:29.739549 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 703/1397] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:29.744666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b78b1-3a76-4eed-8042-3d7227787499 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:29.744954 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b78b1-3a76-4eed-8042-3d7227787499 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:29.745227 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b78b1-3a76-4eed-8042-3d7227787499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:29.746959 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 695/1398] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:13:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:13:29.764020 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-8c6b78b1-3a76-4eed-8042-3d7227787499 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:29.765251 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-8c6b78b1-3a76-4eed-8042-3d7227787499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:29.774747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 704/1399] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:13:29.833285 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11301770-f20a-48ff-9854-a17341b53b34 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:29.833629 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11301770-f20a-48ff-9854-a17341b53b34 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:29.833855 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11301770-f20a-48ff-9854-a17341b53b34 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:29.835346 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 696/1400] 10.222.0.13 () {54 vars in 962 bytes} [Wed Jun 29 12:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:29.841031 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335ddfb-373a-4c9b-9a0f-a2a32cfd0d83 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:29.841326 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335ddfb-373a-4c9b-9a0f-a2a32cfd0d83 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:29.841603 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335ddfb-373a-4c9b-9a0f-a2a32cfd0d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:29.848221 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=58 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:13:29.900045 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-7335ddfb-373a-4c9b-9a0f-a2a32cfd0d83 None None] MFA Rules not processed for user `09d603d756a9484bbf48cfd6d56bdb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:29.901704 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-7335ddfb-373a-4c9b-9a0f-a2a32cfd0d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:29.971160 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 705/1401] 10.222.0.13 () {58 vars in 1059 bytes} [Wed Jun 29 12:13:29 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:29.979896 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11301770-f20a-48ff-9854-a17341b53b34 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:29.995450 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11301770-f20a-48ff-9854-a17341b53b34 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:29.999073 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a165b-f8ec-4151-abeb-f79658bfe056 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09d603d756a9484bbf48cfd6d56bdb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:29.999733 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a165b-f8ec-4151-abeb-f79658bfe056 service glance] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:30.000024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a165b-f8ec-4151-abeb-f79658bfe056 service glance] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:30.000293 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a165b-f8ec-4151-abeb-f79658bfe056 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:30.010467 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a165b-f8ec-4151-abeb-f79658bfe056 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:30.011978 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a165b-f8ec-4151-abeb-f79658bfe056 service glance] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:30.022371 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 697/1402] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:13:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:13:30.765373 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7d527-843f-4f05-8ce1-bb9da2094693 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:30.766505 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7d527-843f-4f05-8ce1-bb9da2094693 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:30.766505 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7d527-843f-4f05-8ce1-bb9da2094693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:30.822066 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-75b7d527-843f-4f05-8ce1-bb9da2094693 None None] MFA Rules not processed for user `2891b5a315b64f228f665e024b641629`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:30.823330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-75b7d527-843f-4f05-8ce1-bb9da2094693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:30.911291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 706/1403] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Jun 29 12:13:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:30.956849 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753ba97-c01d-4a04-b9dc-dc7d77d8072d None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:30.957441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753ba97-c01d-4a04-b9dc-dc7d77d8072d None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:30.957441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753ba97-c01d-4a04-b9dc-dc7d77d8072d None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:30.959181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 698/1404] 10.222.0.13 () {54 vars in 942 bytes} [Wed Jun 29 12:13:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:30.966915 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a672a4-ac44-475f-bd00-6aa9ddf7b08b None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:30.967282 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a672a4-ac44-475f-bd00-6aa9ddf7b08b None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:30.967588 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a672a4-ac44-475f-bd00-6aa9ddf7b08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:31.028342 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-c8a672a4-ac44-475f-bd00-6aa9ddf7b08b None None] MFA Rules not processed for user `11efdbeeaa5c428aa344f7f0f5b061ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:31.029479 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-c8a672a4-ac44-475f-bd00-6aa9ddf7b08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:31.051718 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:13:31.107500 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 707/1405] 10.222.0.13 () {58 vars in 1039 bytes} [Wed Jun 29 12:13:30 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:31.117954 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753ba97-c01d-4a04-b9dc-dc7d77d8072d None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:31.133000 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753ba97-c01d-4a04-b9dc-dc7d77d8072d None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:31.138265 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aecd1a-4e23-4428-8002-a30086f533a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11efdbeeaa5c428aa344f7f0f5b061ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:31.139035 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aecd1a-4e23-4428-8002-a30086f533a9 service swift] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:31.139393 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aecd1a-4e23-4428-8002-a30086f533a9 service swift] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:31.139685 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aecd1a-4e23-4428-8002-a30086f533a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:31.148779 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aecd1a-4e23-4428-8002-a30086f533a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:31.150385 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aecd1a-4e23-4428-8002-a30086f533a9 service swift] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:31.159509 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 699/1406] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Jun 29 12:13:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 12:13:31.959941 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811e2b7-647e-459c-9e66-0cfbbc4ab89f None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:31.960898 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811e2b7-647e-459c-9e66-0cfbbc4ab89f None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:31.960898 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811e2b7-647e-459c-9e66-0cfbbc4ab89f None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:31.963507 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 708/1407] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:13:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:31.967373 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ef54e-5662-47ae-961e-796167b1bb62 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:31.967889 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ef54e-5662-47ae-961e-796167b1bb62 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:31.967983 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ef54e-5662-47ae-961e-796167b1bb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:31.987487 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-080ef54e-5662-47ae-961e-796167b1bb62 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:31.989111 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-080ef54e-5662-47ae-961e-796167b1bb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:31.999067 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 700/1408] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:32.047615 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811e2b7-647e-459c-9e66-0cfbbc4ab89f None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:32.062413 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811e2b7-647e-459c-9e66-0cfbbc4ab89f None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:32.083190 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215efdfe-1630-4dcd-baa3-2e33ed58b664 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:32.083945 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215efdfe-1630-4dcd-baa3-2e33ed58b664 service nova] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:32.084287 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215efdfe-1630-4dcd-baa3-2e33ed58b664 service nova] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:32.084629 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215efdfe-1630-4dcd-baa3-2e33ed58b664 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:32.094934 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215efdfe-1630-4dcd-baa3-2e33ed58b664 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:32.096652 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215efdfe-1630-4dcd-baa3-2e33ed58b664 service nova] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:32.119045 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 709/1409] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:13:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:13:41.981254 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=84 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:13:42.102675 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=27 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:13:54.378053 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c9282-6a01-44dc-aa66-c9788b3a16f1 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:54.378667 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c9282-6a01-44dc-aa66-c9788b3a16f1 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:54.378667 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c9282-6a01-44dc-aa66-c9788b3a16f1 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:54.380037 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 701/1410] 10.222.0.13 () {54 vars in 918 bytes} [Wed Jun 29 12:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:54.385448 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31eaed5-eaf3-494e-b040-019f2cd4718e None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:54.385964 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31eaed5-eaf3-494e-b040-019f2cd4718e None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:54.386080 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31eaed5-eaf3-494e-b040-019f2cd4718e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:54.408731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-a31eaed5-eaf3-494e-b040-019f2cd4718e None None] MFA Rules not processed for user `cd57c8b894e74c709ea389ed462184fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:54.409936 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-a31eaed5-eaf3-494e-b040-019f2cd4718e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:54.418516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 710/1411] 10.222.0.13 () {58 vars in 1015 bytes} [Wed Jun 29 12:13:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:54.433046 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279fbfc-5efd-4dd5-8ecd-8587d704b7c1 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:54.433339 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279fbfc-5efd-4dd5-8ecd-8587d704b7c1 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:54.433618 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279fbfc-5efd-4dd5-8ecd-8587d704b7c1 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:54.435030 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 702/1412] 10.222.0.13 () {54 vars in 918 bytes} [Wed Jun 29 12:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:54.440313 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2def4c-dc09-4a8c-9f93-f1a0c7858677 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:54.440603 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2def4c-dc09-4a8c-9f93-f1a0c7858677 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:54.440884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2def4c-dc09-4a8c-9f93-f1a0c7858677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:54.459516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-6e2def4c-dc09-4a8c-9f93-f1a0c7858677 None None] MFA Rules not processed for user `3fbcf547421b42e4b520f9246326bff8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:54.460729 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-6e2def4c-dc09-4a8c-9f93-f1a0c7858677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:54.470517 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 711/1413] 10.222.0.13 () {58 vars in 1015 bytes} [Wed Jun 29 12:13:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:13:57.034712 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46454a10-b365-4e4c-a22f-88d3c9db1161 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:57.035298 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46454a10-b365-4e4c-a22f-88d3c9db1161 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:57.035298 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46454a10-b365-4e4c-a22f-88d3c9db1161 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:57.036926 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 703/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 12:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:57.042430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd8bb5-8a59-493f-8b84-252e4073e844 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:57.042906 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd8bb5-8a59-493f-8b84-252e4073e844 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:57.043023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd8bb5-8a59-493f-8b84-252e4073e844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:57.061123 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-39dd8bb5-8a59-493f-8b84-252e4073e844 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:57.064038 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-39dd8bb5-8a59-493f-8b84-252e4073e844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:57.071641 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 712/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 12:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:57.115620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46454a10-b365-4e4c-a22f-88d3c9db1161 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:57.133426 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46454a10-b365-4e4c-a22f-88d3c9db1161 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:57.138955 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc7659-6b2c-4f98-8ae4-c22a14c2921e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:57.139613 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc7659-6b2c-4f98-8ae4-c22a14c2921e service nova] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:57.139896 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc7659-6b2c-4f98-8ae4-c22a14c2921e service nova] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:57.140171 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc7659-6b2c-4f98-8ae4-c22a14c2921e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:57.149137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc7659-6b2c-4f98-8ae4-c22a14c2921e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:57.150757 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc7659-6b2c-4f98-8ae4-c22a14c2921e service nova] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:57.161365 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 704/1416] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:13:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:13:58.082123 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb093b6d-7e99-454e-99db-59cfb4c6b58d None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:58.082703 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb093b6d-7e99-454e-99db-59cfb4c6b58d None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:58.082703 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb093b6d-7e99-454e-99db-59cfb4c6b58d None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:58.084020 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 713/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 12:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:58.089128 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5835065-cad9-4187-aceb-739991d18316 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:58.089630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5835065-cad9-4187-aceb-739991d18316 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:58.089736 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5835065-cad9-4187-aceb-739991d18316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:58.107670 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-f5835065-cad9-4187-aceb-739991d18316 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:58.108893 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-f5835065-cad9-4187-aceb-739991d18316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:58.117350 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 705/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 12:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:58.269741 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb093b6d-7e99-454e-99db-59cfb4c6b58d None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:58.285113 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb093b6d-7e99-454e-99db-59cfb4c6b58d None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:58.290508 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659ce4c-c166-4f42-81d1-b2c3c29b6a8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:58.291206 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659ce4c-c166-4f42-81d1-b2c3c29b6a8c service nova] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:58.291487 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659ce4c-c166-4f42-81d1-b2c3c29b6a8c service nova] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:58.291763 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659ce4c-c166-4f42-81d1-b2c3c29b6a8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:58.305648 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659ce4c-c166-4f42-81d1-b2c3c29b6a8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:58.307267 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659ce4c-c166-4f42-81d1-b2c3c29b6a8c service nova] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:58.318181 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 714/1419] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:13:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:13:59.248378 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5063ac7-244c-4615-9433-956596495d7f None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:59.248959 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5063ac7-244c-4615-9433-956596495d7f None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:59.248959 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5063ac7-244c-4615-9433-956596495d7f None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:59.250297 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 706/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 12:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:59.255592 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd62ed-99c2-4052-bc14-b972a605f629 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:59.256078 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd62ed-99c2-4052-bc14-b972a605f629 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:59.256180 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd62ed-99c2-4052-bc14-b972a605f629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:59.274158 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-10cd62ed-99c2-4052-bc14-b972a605f629 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:59.275404 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-10cd62ed-99c2-4052-bc14-b972a605f629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:59.284270 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 715/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 12:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:59.437193 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5063ac7-244c-4615-9433-956596495d7f None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:59.452599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5063ac7-244c-4615-9433-956596495d7f None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:59.458045 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfec91-476d-407f-9044-6dcb6033982b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:59.458729 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfec91-476d-407f-9044-6dcb6033982b service nova] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:59.459012 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfec91-476d-407f-9044-6dcb6033982b service nova] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:59.459282 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfec91-476d-407f-9044-6dcb6033982b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:59.468085 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfec91-476d-407f-9044-6dcb6033982b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:59.470229 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfec91-476d-407f-9044-6dcb6033982b service nova] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:59.480002 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 707/1422] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:13:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:00.362377 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330e6f1-a7aa-4d57-95c6-cf364187e2b6 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:00.362987 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330e6f1-a7aa-4d57-95c6-cf364187e2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:00.362987 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330e6f1-a7aa-4d57-95c6-cf364187e2b6 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:00.364454 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 716/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 12:14:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:00.369852 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b83ad2-3d7b-46b5-84d9-3d3a041d19f7 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:00.370362 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b83ad2-3d7b-46b5-84d9-3d3a041d19f7 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:00.370470 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b83ad2-3d7b-46b5-84d9-3d3a041d19f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:00.388507 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-91b83ad2-3d7b-46b5-84d9-3d3a041d19f7 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:00.389737 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-91b83ad2-3d7b-46b5-84d9-3d3a041d19f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:00.398234 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 708/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 12:14:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:00.554737 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330e6f1-a7aa-4d57-95c6-cf364187e2b6 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:00.571064 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330e6f1-a7aa-4d57-95c6-cf364187e2b6 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:00.576542 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b93766-1661-40b6-bd6c-b69fc60b3465 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:00.577190 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b93766-1661-40b6-bd6c-b69fc60b3465 service nova] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:00.577468 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b93766-1661-40b6-bd6c-b69fc60b3465 service nova] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:00.577743 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b93766-1661-40b6-bd6c-b69fc60b3465 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:00.586666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b93766-1661-40b6-bd6c-b69fc60b3465 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:00.588273 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b93766-1661-40b6-bd6c-b69fc60b3465 service nova] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:00.598058 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 717/1425] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:01.490897 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729e35e-8d49-4b70-b88b-4407e858df66 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:01.491448 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729e35e-8d49-4b70-b88b-4407e858df66 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:01.491448 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729e35e-8d49-4b70-b88b-4407e858df66 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:01.492842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 709/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 12:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:01.498114 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe4bc8-bb88-492b-b6a4-75bbdc08ff18 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:01.498531 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe4bc8-bb88-492b-b6a4-75bbdc08ff18 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:01.498681 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe4bc8-bb88-492b-b6a4-75bbdc08ff18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:01.517739 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-d9fe4bc8-bb88-492b-b6a4-75bbdc08ff18 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:01.519020 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-d9fe4bc8-bb88-492b-b6a4-75bbdc08ff18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:01.527376 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 718/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 12:14:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:01.677757 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729e35e-8d49-4b70-b88b-4407e858df66 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:01.694133 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729e35e-8d49-4b70-b88b-4407e858df66 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:01.700661 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fffd6-3e8f-401e-845d-1543ef985935 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:01.701500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fffd6-3e8f-401e-845d-1543ef985935 service nova] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:01.701786 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fffd6-3e8f-401e-845d-1543ef985935 service nova] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:01.702060 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fffd6-3e8f-401e-845d-1543ef985935 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:01.711875 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233fffd6-3e8f-401e-845d-1543ef985935 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:01.713474 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233fffd6-3e8f-401e-845d-1543ef985935 service nova] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:01.724940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 710/1428] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:02.550956 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83524f7c-1fe4-4f5e-a8d9-b01edc262200 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:02.551509 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83524f7c-1fe4-4f5e-a8d9-b01edc262200 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:02.551509 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83524f7c-1fe4-4f5e-a8d9-b01edc262200 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:02.552877 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 719/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 12:14:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:14:02.558235 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb10ee-77e3-4272-960f-f41e4a57662f None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:02.558846 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb10ee-77e3-4272-960f-f41e4a57662f None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:02.558846 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb10ee-77e3-4272-960f-f41e4a57662f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:02.578056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-d0cb10ee-77e3-4272-960f-f41e4a57662f None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:02.579799 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-d0cb10ee-77e3-4272-960f-f41e4a57662f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:02.588096 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 711/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 12:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:02.740715 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83524f7c-1fe4-4f5e-a8d9-b01edc262200 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:02.755667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83524f7c-1fe4-4f5e-a8d9-b01edc262200 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:02.760893 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64ba19-338c-49b8-ad76-841049351446 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:02.761530 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64ba19-338c-49b8-ad76-841049351446 service nova] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:02.761812 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64ba19-338c-49b8-ad76-841049351446 service nova] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:02.762080 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64ba19-338c-49b8-ad76-841049351446 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:02.770761 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64ba19-338c-49b8-ad76-841049351446 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:02.772373 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64ba19-338c-49b8-ad76-841049351446 service nova] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:02.782487 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 720/1431] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:03.628976 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a684f-55cb-4c62-9699-ad66797f264a None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:03.629587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a684f-55cb-4c62-9699-ad66797f264a None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:03.629587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a684f-55cb-4c62-9699-ad66797f264a None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:03.630964 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 712/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 12:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:03.636289 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f4f7a-df2e-4127-a665-c3ad6f67acc9 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:03.637044 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f4f7a-df2e-4127-a665-c3ad6f67acc9 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:03.637215 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f4f7a-df2e-4127-a665-c3ad6f67acc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:03.659620 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-248f4f7a-df2e-4127-a665-c3ad6f67acc9 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:03.660851 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-248f4f7a-df2e-4127-a665-c3ad6f67acc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:03.668873 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 721/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 12:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:03.819599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a684f-55cb-4c62-9699-ad66797f264a None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:03.833847 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a684f-55cb-4c62-9699-ad66797f264a None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:03.839203 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93a1c2-9d5c-42b3-80e6-7959536bf627 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:03.839847 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93a1c2-9d5c-42b3-80e6-7959536bf627 service nova] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:03.840128 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93a1c2-9d5c-42b3-80e6-7959536bf627 service nova] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:03.840409 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93a1c2-9d5c-42b3-80e6-7959536bf627 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:03.849739 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93a1c2-9d5c-42b3-80e6-7959536bf627 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:03.851358 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93a1c2-9d5c-42b3-80e6-7959536bf627 service nova] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:03.861665 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 713/1434] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:04.703827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ca865-6d0d-4b97-9786-cab3fc0d386c None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:04.704957 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ca865-6d0d-4b97-9786-cab3fc0d386c None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:04.705073 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ca865-6d0d-4b97-9786-cab3fc0d386c None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:04.706424 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 722/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 12:14:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:04.711709 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cdd0c-f45f-4968-a5b7-612ad73ab904 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:04.712156 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cdd0c-f45f-4968-a5b7-612ad73ab904 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:04.712263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cdd0c-f45f-4968-a5b7-612ad73ab904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:04.731993 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-198cdd0c-f45f-4968-a5b7-612ad73ab904 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:04.733197 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-198cdd0c-f45f-4968-a5b7-612ad73ab904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:04.741694 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 714/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 12:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:04.893576 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ca865-6d0d-4b97-9786-cab3fc0d386c None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:04.908753 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ca865-6d0d-4b97-9786-cab3fc0d386c None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:04.914176 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4e3a2-70eb-4527-9c31-f1b201a76581 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:04.914858 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4e3a2-70eb-4527-9c31-f1b201a76581 service nova] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:04.915144 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4e3a2-70eb-4527-9c31-f1b201a76581 service nova] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:04.915420 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4e3a2-70eb-4527-9c31-f1b201a76581 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:04.924107 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae4e3a2-70eb-4527-9c31-f1b201a76581 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:04.925710 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae4e3a2-70eb-4527-9c31-f1b201a76581 service nova] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:04.935513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 723/1437] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:05.769219 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904daabf-4816-49d4-81cb-2190e107ad4d None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:05.769831 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904daabf-4816-49d4-81cb-2190e107ad4d None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:05.769831 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904daabf-4816-49d4-81cb-2190e107ad4d None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:05.771168 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 715/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 12:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:14:05.776588 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53653d09-c636-4f51-bdab-e28351092632 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:05.777098 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53653d09-c636-4f51-bdab-e28351092632 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:05.777197 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53653d09-c636-4f51-bdab-e28351092632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:05.795547 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-53653d09-c636-4f51-bdab-e28351092632 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:05.796744 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-53653d09-c636-4f51-bdab-e28351092632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:05.810287 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 724/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 12:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:14:05.961454 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904daabf-4816-49d4-81cb-2190e107ad4d None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:05.976498 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904daabf-4816-49d4-81cb-2190e107ad4d None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:05.981887 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12e0a0-7eec-4e17-9c86-693cd21d0930 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:05.982486 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12e0a0-7eec-4e17-9c86-693cd21d0930 service nova] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:05.982809 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12e0a0-7eec-4e17-9c86-693cd21d0930 service nova] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:05.983088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12e0a0-7eec-4e17-9c86-693cd21d0930 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:05.992452 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12e0a0-7eec-4e17-9c86-693cd21d0930 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:05.994050 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12e0a0-7eec-4e17-9c86-693cd21d0930 service nova] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:06.004448 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 716/1440] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:07.993178 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c0fab-743f-4d84-a980-447dd32d74bf None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:07.993725 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c0fab-743f-4d84-a980-447dd32d74bf None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:07.993725 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c0fab-743f-4d84-a980-447dd32d74bf None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:07.995077 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 725/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 12:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:08.000781 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0df04-5c3e-4d8e-b3a2-fe77e65fcc69 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:08.001488 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0df04-5c3e-4d8e-b3a2-fe77e65fcc69 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:08.001488 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0df04-5c3e-4d8e-b3a2-fe77e65fcc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:08.019743 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-91b0df04-5c3e-4d8e-b3a2-fe77e65fcc69 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:08.020956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-91b0df04-5c3e-4d8e-b3a2-fe77e65fcc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:08.029164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 717/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 12:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:08.068810 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c0fab-743f-4d84-a980-447dd32d74bf None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:08.079743 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c0fab-743f-4d84-a980-447dd32d74bf None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:08.083480 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ef66f-0a9a-465e-b87b-e2d2e864a18d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:08.084129 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ef66f-0a9a-465e-b87b-e2d2e864a18d service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:08.084413 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ef66f-0a9a-465e-b87b-e2d2e864a18d service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:08.084683 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ef66f-0a9a-465e-b87b-e2d2e864a18d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:08.094153 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ef66f-0a9a-465e-b87b-e2d2e864a18d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:08.095669 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ef66f-0a9a-465e-b87b-e2d2e864a18d service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:08.105529 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 726/1443] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:10.364234 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f8b93-8edc-4811-be7a-fc0059da2570 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:10.364798 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f8b93-8edc-4811-be7a-fc0059da2570 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:10.364798 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f8b93-8edc-4811-be7a-fc0059da2570 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:10.366160 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 718/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 12:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:10.371861 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c7ad0-6753-4613-89ec-938aa493a4fc None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:10.372344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c7ad0-6753-4613-89ec-938aa493a4fc None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:10.372449 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c7ad0-6753-4613-89ec-938aa493a4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:10.390749 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-ba1c7ad0-6753-4613-89ec-938aa493a4fc None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:10.392460 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-ba1c7ad0-6753-4613-89ec-938aa493a4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:10.400702 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 727/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 12:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:10.439510 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f8b93-8edc-4811-be7a-fc0059da2570 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:10.450373 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f8b93-8edc-4811-be7a-fc0059da2570 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:10.453836 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26035ee9-74fe-4ff6-9d1f-07634045deb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:10.455135 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26035ee9-74fe-4ff6-9d1f-07634045deb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:10.455418 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26035ee9-74fe-4ff6-9d1f-07634045deb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:10.455692 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26035ee9-74fe-4ff6-9d1f-07634045deb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:10.466850 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26035ee9-74fe-4ff6-9d1f-07634045deb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:10.469385 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26035ee9-74fe-4ff6-9d1f-07634045deb0 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:10.483014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 719/1446] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:12.920996 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f6cee-39bc-4647-bb58-bd20df655d60 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:12.921570 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f6cee-39bc-4647-bb58-bd20df655d60 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:12.921570 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f6cee-39bc-4647-bb58-bd20df655d60 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:12.923660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 728/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 12:14:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:12.929748 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3132c5e-181d-4b86-b5cc-993f34956c09 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:12.930267 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3132c5e-181d-4b86-b5cc-993f34956c09 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:12.930374 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3132c5e-181d-4b86-b5cc-993f34956c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:12.948632 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-f3132c5e-181d-4b86-b5cc-993f34956c09 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:12.949841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-f3132c5e-181d-4b86-b5cc-993f34956c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:12.958427 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 720/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 12:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:12.999700 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f6cee-39bc-4647-bb58-bd20df655d60 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:13.011843 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f6cee-39bc-4647-bb58-bd20df655d60 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:13.015403 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec46df4-6872-451d-9253-f820079879d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:13.016056 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec46df4-6872-451d-9253-f820079879d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:13.016339 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec46df4-6872-451d-9253-f820079879d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:13.016787 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec46df4-6872-451d-9253-f820079879d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:13.026507 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec46df4-6872-451d-9253-f820079879d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:13.028138 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec46df4-6872-451d-9253-f820079879d1 service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:13.040016 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 729/1449] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:15.270606 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0936a-e1ba-493a-abfb-c93d72551a45 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:15.271347 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0936a-e1ba-493a-abfb-c93d72551a45 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:15.271347 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0936a-e1ba-493a-abfb-c93d72551a45 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:15.272624 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 721/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 12:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:15.278715 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373ea8b-2954-4312-adab-8703da3c1cba None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:15.279245 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373ea8b-2954-4312-adab-8703da3c1cba None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:15.279370 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373ea8b-2954-4312-adab-8703da3c1cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:15.299348 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-0373ea8b-2954-4312-adab-8703da3c1cba None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:15.300552 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-0373ea8b-2954-4312-adab-8703da3c1cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:15.308482 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 730/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 12:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:15.353376 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0936a-e1ba-493a-abfb-c93d72551a45 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:15.358375 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0936a-e1ba-493a-abfb-c93d72551a45 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:15.362424 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a16906-35c1-4e6f-8994-046111c65c5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:15.363130 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a16906-35c1-4e6f-8994-046111c65c5b service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:15.363392 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a16906-35c1-4e6f-8994-046111c65c5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:15.363667 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a16906-35c1-4e6f-8994-046111c65c5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:15.373137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a16906-35c1-4e6f-8994-046111c65c5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:15.374583 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a16906-35c1-4e6f-8994-046111c65c5b service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:15.384557 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 722/1452] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:17.504696 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8cc98-c287-4553-934e-226f39f87a17 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:17.505291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8cc98-c287-4553-934e-226f39f87a17 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:17.505291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8cc98-c287-4553-934e-226f39f87a17 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:17.506629 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 731/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 12:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:17.512370 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45ae06-4753-46a1-a03a-50dbcddc2963 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:17.512904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45ae06-4753-46a1-a03a-50dbcddc2963 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:17.513024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45ae06-4753-46a1-a03a-50dbcddc2963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:17.536821 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-6f45ae06-4753-46a1-a03a-50dbcddc2963 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:17.538072 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-6f45ae06-4753-46a1-a03a-50dbcddc2963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:17.546106 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 723/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 12:14:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:17.584273 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8cc98-c287-4553-934e-226f39f87a17 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:17.595686 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8cc98-c287-4553-934e-226f39f87a17 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:17.599213 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ac738-6877-4324-93a7-7b7e0e89bc66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:17.599862 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ac738-6877-4324-93a7-7b7e0e89bc66 service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:17.600142 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ac738-6877-4324-93a7-7b7e0e89bc66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:17.600414 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ac738-6877-4324-93a7-7b7e0e89bc66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:17.610068 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ac738-6877-4324-93a7-7b7e0e89bc66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:17.612140 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ac738-6877-4324-93a7-7b7e0e89bc66 service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:17.622488 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 732/1455] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:19.762039 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fa671-bc1c-4a63-a01d-7ae2a1495bf6 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:19.762687 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fa671-bc1c-4a63-a01d-7ae2a1495bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:19.762687 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fa671-bc1c-4a63-a01d-7ae2a1495bf6 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:19.764006 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 724/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 12:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:19.769796 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9377ea-25f8-4cdf-84d8-c0d85af7c720 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:19.770279 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9377ea-25f8-4cdf-84d8-c0d85af7c720 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:19.770427 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9377ea-25f8-4cdf-84d8-c0d85af7c720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:19.799457 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-dd9377ea-25f8-4cdf-84d8-c0d85af7c720 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:19.800672 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-dd9377ea-25f8-4cdf-84d8-c0d85af7c720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:19.808558 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 733/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 12:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:19.846683 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815fa671-bc1c-4a63-a01d-7ae2a1495bf6 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:19.857710 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815fa671-bc1c-4a63-a01d-7ae2a1495bf6 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:19.862132 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d072dd8-79cc-4e3c-8bdf-6ea08544806d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:19.862849 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d072dd8-79cc-4e3c-8bdf-6ea08544806d service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:19.863131 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d072dd8-79cc-4e3c-8bdf-6ea08544806d service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:19.863404 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d072dd8-79cc-4e3c-8bdf-6ea08544806d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:19.873011 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d072dd8-79cc-4e3c-8bdf-6ea08544806d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:19.874479 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d072dd8-79cc-4e3c-8bdf-6ea08544806d service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:19.886118 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 725/1458] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:22.030324 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365b23e-b073-4687-b179-fb1468c51f54 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:22.030895 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365b23e-b073-4687-b179-fb1468c51f54 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:22.030895 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365b23e-b073-4687-b179-fb1468c51f54 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:22.033056 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 12:14:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:22.040849 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6ca26-90e3-4db5-984c-849c1942eb23 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:22.041362 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6ca26-90e3-4db5-984c-849c1942eb23 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:22.041453 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6ca26-90e3-4db5-984c-849c1942eb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:22.048474 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=70 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:14:22.061670 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-0ac6ca26-90e3-4db5-984c-849c1942eb23 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:22.062954 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-0ac6ca26-90e3-4db5-984c-849c1942eb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:22.072176 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 12:14:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:22.114147 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365b23e-b073-4687-b179-fb1468c51f54 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:22.122212 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=73 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:14:22.131536 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365b23e-b073-4687-b179-fb1468c51f54 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:22.137076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66123ce-1834-451a-a475-3d2267ac0ecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:22.138078 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66123ce-1834-451a-a475-3d2267ac0ecf service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:22.138486 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66123ce-1834-451a-a475-3d2267ac0ecf service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:22.138955 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66123ce-1834-451a-a475-3d2267ac0ecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:22.148563 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66123ce-1834-451a-a475-3d2267ac0ecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:22.150019 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66123ce-1834-451a-a475-3d2267ac0ecf service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:22.160189 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 735/1461] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:24.310810 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d5b26-c907-427e-91c6-9d4a70405ac5 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:24.311383 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d5b26-c907-427e-91c6-9d4a70405ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:24.311383 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d5b26-c907-427e-91c6-9d4a70405ac5 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:24.312734 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 12:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:24.319067 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9349560-7bfe-41d6-b080-a64e35c145c1 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:24.319557 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9349560-7bfe-41d6-b080-a64e35c145c1 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:24.319674 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9349560-7bfe-41d6-b080-a64e35c145c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:24.338678 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-c9349560-7bfe-41d6-b080-a64e35c145c1 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:24.339879 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-c9349560-7bfe-41d6-b080-a64e35c145c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:24.347666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 12:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:24.385483 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d5b26-c907-427e-91c6-9d4a70405ac5 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:24.396919 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d5b26-c907-427e-91c6-9d4a70405ac5 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:24.400425 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55847fc-7f45-4486-92ae-9c20ba3da35f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:24.401100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55847fc-7f45-4486-92ae-9c20ba3da35f service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:24.401357 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55847fc-7f45-4486-92ae-9c20ba3da35f service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:24.401629 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55847fc-7f45-4486-92ae-9c20ba3da35f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:24.412452 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55847fc-7f45-4486-92ae-9c20ba3da35f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:24.413953 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55847fc-7f45-4486-92ae-9c20ba3da35f service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:24.424022 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 728/1464] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:26.536984 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813127a-419b-49df-8a35-d36d02d5891d None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:26.537551 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813127a-419b-49df-8a35-d36d02d5891d None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:26.537551 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813127a-419b-49df-8a35-d36d02d5891d None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:26.538924 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 12:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:26.544276 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593fa0a-2aa8-4e99-a836-83b53b41c37a None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:26.544728 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593fa0a-2aa8-4e99-a836-83b53b41c37a None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:26.544862 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593fa0a-2aa8-4e99-a836-83b53b41c37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:26.563131 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-0593fa0a-2aa8-4e99-a836-83b53b41c37a None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:26.564425 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-0593fa0a-2aa8-4e99-a836-83b53b41c37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:26.572286 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 12:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:26.609210 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813127a-419b-49df-8a35-d36d02d5891d None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:26.624355 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813127a-419b-49df-8a35-d36d02d5891d None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:26.629652 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471af92-ad1a-4b00-aef5-a845264ef744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:26.630825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471af92-ad1a-4b00-aef5-a845264ef744 service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:26.631352 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471af92-ad1a-4b00-aef5-a845264ef744 service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:26.631807 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471af92-ad1a-4b00-aef5-a845264ef744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:26.644371 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471af92-ad1a-4b00-aef5-a845264ef744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:26.645837 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471af92-ad1a-4b00-aef5-a845264ef744 service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:26.656285 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 738/1467] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:28.756304 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ae541-24f3-48f9-ab0d-6d7c1f882ee7 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:28.756896 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ae541-24f3-48f9-ab0d-6d7c1f882ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:28.756896 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ae541-24f3-48f9-ab0d-6d7c1f882ee7 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:28.758306 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 12:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:28.763750 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064fd00-8aa4-4056-b04c-abb87151ba2e None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:28.764222 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064fd00-8aa4-4056-b04c-abb87151ba2e None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:28.764319 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064fd00-8aa4-4056-b04c-abb87151ba2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:28.783034 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-f064fd00-8aa4-4056-b04c-abb87151ba2e None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:28.784263 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-f064fd00-8aa4-4056-b04c-abb87151ba2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:28.792380 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 12:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:28.830427 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ae541-24f3-48f9-ab0d-6d7c1f882ee7 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:28.841314 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ae541-24f3-48f9-ab0d-6d7c1f882ee7 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:28.845417 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb722d-2574-40e0-b8ab-03e611b2c55a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:28.846061 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb722d-2574-40e0-b8ab-03e611b2c55a service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:28.846339 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb722d-2574-40e0-b8ab-03e611b2c55a service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:28.846617 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb722d-2574-40e0-b8ab-03e611b2c55a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:28.856068 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb722d-2574-40e0-b8ab-03e611b2c55a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:28.857505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb722d-2574-40e0-b8ab-03e611b2c55a service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:28.868346 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 731/1470] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:38.776910 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=17 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:14:38.863657 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=17 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:14:49.089431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd498e9-9470-4e16-a793-552c83ef09bb None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:49.089973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd498e9-9470-4e16-a793-552c83ef09bb None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:49.089973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd498e9-9470-4e16-a793-552c83ef09bb None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:49.091296 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 740/1471] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:49.096682 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4ed6b-1bb1-410c-9e65-8ddc9a770c5d None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:49.097091 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4ed6b-1bb1-410c-9e65-8ddc9a770c5d None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:49.097235 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4ed6b-1bb1-410c-9e65-8ddc9a770c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:49.115732 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-4af4ed6b-1bb1-410c-9e65-8ddc9a770c5d None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:49.116912 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-4af4ed6b-1bb1-410c-9e65-8ddc9a770c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:49.124694 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 732/1472] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:14:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:49.172742 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7909a1-5ef4-436b-ac1a-38e9b136397e None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:49.173629 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7909a1-5ef4-436b-ac1a-38e9b136397e None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:49.173915 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7909a1-5ef4-436b-ac1a-38e9b136397e None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:49.175330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 741/1473] 10.222.0.13 () {54 vars in 962 bytes} [Wed Jun 29 12:14:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:49.179976 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68891c-6169-4600-ba65-ded43d364f31 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:49.180263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68891c-6169-4600-ba65-ded43d364f31 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:49.180537 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68891c-6169-4600-ba65-ded43d364f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:49.198068 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-8d68891c-6169-4600-ba65-ded43d364f31 None None] MFA Rules not processed for user `09d603d756a9484bbf48cfd6d56bdb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:49.199268 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-8d68891c-6169-4600-ba65-ded43d364f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:49.205716 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 733/1474] 10.222.0.13 () {58 vars in 1059 bytes} [Wed Jun 29 12:14:49 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:49.212713 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7909a1-5ef4-436b-ac1a-38e9b136397e None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:49.223774 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7909a1-5ef4-436b-ac1a-38e9b136397e None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:49.227206 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d601e-2d87-44f3-89e2-e204cd25c207 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09d603d756a9484bbf48cfd6d56bdb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:49.227829 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d601e-2d87-44f3-89e2-e204cd25c207 service glance] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:49.228110 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d601e-2d87-44f3-89e2-e204cd25c207 service glance] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:49.228386 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d601e-2d87-44f3-89e2-e204cd25c207 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:49.237704 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d601e-2d87-44f3-89e2-e204cd25c207 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:49.239186 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d601e-2d87-44f3-89e2-e204cd25c207 service glance] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:49.248395 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 742/1475] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:14:51.373027 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d086a-0495-4784-bf69-8fbf3b8ffc2e None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:51.373595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d086a-0495-4784-bf69-8fbf3b8ffc2e None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:51.373705 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d086a-0495-4784-bf69-8fbf3b8ffc2e None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:51.375055 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 734/1476] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:51.380980 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4c72e-8390-4a7d-b559-a325752506f5 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:51.381440 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4c72e-8390-4a7d-b559-a325752506f5 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:51.381573 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4c72e-8390-4a7d-b559-a325752506f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:51.398918 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-a7c4c72e-8390-4a7d-b559-a325752506f5 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:51.400116 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-a7c4c72e-8390-4a7d-b559-a325752506f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:51.408623 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 743/1477] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:14:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:51.435251 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d086a-0495-4784-bf69-8fbf3b8ffc2e None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:51.453114 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d086a-0495-4784-bf69-8fbf3b8ffc2e None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:51.458925 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ee893-5640-49ba-82d2-c871cd994114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:51.459593 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ee893-5640-49ba-82d2-c871cd994114 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:51.459874 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ee893-5640-49ba-82d2-c871cd994114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:51.460151 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ee893-5640-49ba-82d2-c871cd994114 admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:51.460890 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ee893-5640-49ba-82d2-c871cd994114 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:51.462732 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: WARNING py.warnings [None req-d37ee893-5640-49ba-82d2-c871cd994114 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:14:51.462732 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: warnings.warn(msg) Jun 29 12:14:51.462732 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: Jun 29 12:14:51.463939 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ee893-5640-49ba-82d2-c871cd994114 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:51.484061 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 735/1478] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 29 12:14:51 2022] GET /identity/v3/projects => generated 2553 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:14:53.566769 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2eb04-d792-4203-a8b8-0044fb68dfc4 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:53.567361 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2eb04-d792-4203-a8b8-0044fb68dfc4 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:53.567361 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2eb04-d792-4203-a8b8-0044fb68dfc4 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:53.568734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 744/1479] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:14:53.574528 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e98ff-5c75-4381-8c62-7351369f01ef None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:53.575107 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e98ff-5c75-4381-8c62-7351369f01ef None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:53.575221 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e98ff-5c75-4381-8c62-7351369f01ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:53.594362 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-7c1e98ff-5c75-4381-8c62-7351369f01ef None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:53.596335 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-7c1e98ff-5c75-4381-8c62-7351369f01ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:53.605081 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 736/1480] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:14:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:53.650360 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2eb04-d792-4203-a8b8-0044fb68dfc4 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:53.665756 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2eb04-d792-4203-a8b8-0044fb68dfc4 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:53.671061 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa983995-1fea-4fe8-aae9-d17d4663f6b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:53.671709 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa983995-1fea-4fe8-aae9-d17d4663f6b9 service nova] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:53.671988 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa983995-1fea-4fe8-aae9-d17d4663f6b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:53.672260 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa983995-1fea-4fe8-aae9-d17d4663f6b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:53.681623 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa983995-1fea-4fe8-aae9-d17d4663f6b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:53.683268 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa983995-1fea-4fe8-aae9-d17d4663f6b9 service nova] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:53.693378 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 745/1481] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:55.959857 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711d002-8b47-4f58-a3a5-3016e5300f17 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:55.960426 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711d002-8b47-4f58-a3a5-3016e5300f17 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:55.960426 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711d002-8b47-4f58-a3a5-3016e5300f17 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:55.961791 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 737/1482] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:55.967082 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef2c07-37dc-4f2b-a5b2-b5dc202fc1e8 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:55.967530 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef2c07-37dc-4f2b-a5b2-b5dc202fc1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:55.967652 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef2c07-37dc-4f2b-a5b2-b5dc202fc1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:55.985125 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-5aef2c07-37dc-4f2b-a5b2-b5dc202fc1e8 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:55.986282 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-5aef2c07-37dc-4f2b-a5b2-b5dc202fc1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:55.994037 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 746/1483] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:14:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:56.030614 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711d002-8b47-4f58-a3a5-3016e5300f17 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:56.041161 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711d002-8b47-4f58-a3a5-3016e5300f17 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:56.044637 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df499418-16f3-4789-acc2-8fd31753e5ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:56.045268 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df499418-16f3-4789-acc2-8fd31753e5ed service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:56.045546 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df499418-16f3-4789-acc2-8fd31753e5ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:56.045817 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df499418-16f3-4789-acc2-8fd31753e5ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:56.055413 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df499418-16f3-4789-acc2-8fd31753e5ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:56.056847 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df499418-16f3-4789-acc2-8fd31753e5ed service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:56.067580 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 738/1484] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:58.203262 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726acd82-e197-46f9-9463-992c5c7ca7e6 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:58.203925 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726acd82-e197-46f9-9463-992c5c7ca7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:58.203925 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726acd82-e197-46f9-9463-992c5c7ca7e6 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:58.205227 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 747/1485] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:58.211188 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f208c1-9ae6-4494-b8c7-ca2523ca6fac None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:58.211690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f208c1-9ae6-4494-b8c7-ca2523ca6fac None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:58.211797 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f208c1-9ae6-4494-b8c7-ca2523ca6fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:58.233623 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-53f208c1-9ae6-4494-b8c7-ca2523ca6fac None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:58.234872 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-53f208c1-9ae6-4494-b8c7-ca2523ca6fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:58.243492 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 739/1486] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:14:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:58.285831 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726acd82-e197-46f9-9463-992c5c7ca7e6 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:58.296549 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726acd82-e197-46f9-9463-992c5c7ca7e6 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:58.300906 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11102b33-b5b9-467e-85e5-fdfd2b1041f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:58.301541 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11102b33-b5b9-467e-85e5-fdfd2b1041f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:58.301817 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11102b33-b5b9-467e-85e5-fdfd2b1041f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:58.302089 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11102b33-b5b9-467e-85e5-fdfd2b1041f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:58.311054 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11102b33-b5b9-467e-85e5-fdfd2b1041f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:58.312647 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11102b33-b5b9-467e-85e5-fdfd2b1041f3 service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:58.322213 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 748/1487] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:15:00.502767 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d76a67-1044-4a03-844d-14819025e4a5 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:00.503335 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d76a67-1044-4a03-844d-14819025e4a5 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:00.503335 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d76a67-1044-4a03-844d-14819025e4a5 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:00.504716 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 740/1488] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:15:00.509991 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97811c98-51c8-497b-9a5b-2dbd63561bdc None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:00.510458 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97811c98-51c8-497b-9a5b-2dbd63561bdc None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:00.510564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97811c98-51c8-497b-9a5b-2dbd63561bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:00.528282 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-97811c98-51c8-497b-9a5b-2dbd63561bdc None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:15:00.529506 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-97811c98-51c8-497b-9a5b-2dbd63561bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:15:00.538447 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 749/1489] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:15:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:15:00.578860 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d76a67-1044-4a03-844d-14819025e4a5 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:15:00.589541 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d76a67-1044-4a03-844d-14819025e4a5 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:15:00.593015 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a7c5b-efe8-4267-9a92-647501b78e5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:15:00.593657 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a7c5b-efe8-4267-9a92-647501b78e5d service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:00.593938 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a7c5b-efe8-4267-9a92-647501b78e5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:00.594211 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a7c5b-efe8-4267-9a92-647501b78e5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:00.604106 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a7c5b-efe8-4267-9a92-647501b78e5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:15:00.605466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a7c5b-efe8-4267-9a92-647501b78e5d service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:15:00.615940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 741/1490] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:15:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:15:02.977842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dcd27-90b4-4926-b0fe-7b91ee46162f None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:02.978359 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dcd27-90b4-4926-b0fe-7b91ee46162f None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:02.978359 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dcd27-90b4-4926-b0fe-7b91ee46162f None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:02.979725 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 750/1491] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 29 12:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:15:02.985113 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e3191-6d67-4f88-8eb5-382acabb2c3a None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:02.986193 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e3191-6d67-4f88-8eb5-382acabb2c3a None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:02.986297 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e3191-6d67-4f88-8eb5-382acabb2c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:03.009661 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-db7e3191-6d67-4f88-8eb5-382acabb2c3a None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:15:03.010907 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-db7e3191-6d67-4f88-8eb5-382acabb2c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:15:03.019169 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 742/1492] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 29 12:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:15:03.059853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713dcd27-90b4-4926-b0fe-7b91ee46162f None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:15:03.073662 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713dcd27-90b4-4926-b0fe-7b91ee46162f None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:15:03.077156 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ab0f1-a2fd-4892-9a23-292fdd7497b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:15:03.077811 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ab0f1-a2fd-4892-9a23-292fdd7497b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:03.078091 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ab0f1-a2fd-4892-9a23-292fdd7497b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:03.078364 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ab0f1-a2fd-4892-9a23-292fdd7497b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:03.087470 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ab0f1-a2fd-4892-9a23-292fdd7497b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:15:03.088920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ab0f1-a2fd-4892-9a23-292fdd7497b1 service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:15:03.100166 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 751/1493] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:15:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:15:13.004451 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=33 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:15:13.094179 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=33 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:16:36.955479 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b8599-ddf3-4ab0-b4df-2c4de437483f None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:16:36.956100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b8599-ddf3-4ab0-b4df-2c4de437483f None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:16:36.956100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b8599-ddf3-4ab0-b4df-2c4de437483f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:16:36.974537 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-109b8599-ddf3-4ab0-b4df-2c4de437483f None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:16:36.975780 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-109b8599-ddf3-4ab0-b4df-2c4de437483f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:16:36.983650 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 743/1494] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:16:36.991497 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a960a0-26c9-4818-bb53-abc65f783dbe None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:16:36.992007 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a960a0-26c9-4818-bb53-abc65f783dbe None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:16:36.992118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a960a0-26c9-4818-bb53-abc65f783dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:16:37.009375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-05a960a0-26c9-4818-bb53-abc65f783dbe None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:16:37.010596 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-05a960a0-26c9-4818-bb53-abc65f783dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:16:37.019141 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 752/1495] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:16:37.023611 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b8599-ddf3-4ab0-b4df-2c4de437483f None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:16:37.033962 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b8599-ddf3-4ab0-b4df-2c4de437483f None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:16:37.038456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78b66f-72e1-4a13-b2cd-e87d189d8494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:16:37.039154 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78b66f-72e1-4a13-b2cd-e87d189d8494 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:16:37.039439 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78b66f-72e1-4a13-b2cd-e87d189d8494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:16:37.039717 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78b66f-72e1-4a13-b2cd-e87d189d8494 admin admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:16:37.040435 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78b66f-72e1-4a13-b2cd-e87d189d8494 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:16:37.040741 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78b66f-72e1-4a13-b2cd-e87d189d8494 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:16:37.041744 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: WARNING py.warnings [None req-2f78b66f-72e1-4a13-b2cd-e87d189d8494 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:16:37.041744 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: warnings.warn(msg) Jun 29 12:16:37.041744 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: Jun 29 12:16:37.042648 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78b66f-72e1-4a13-b2cd-e87d189d8494 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:16:37.054459 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 744/1496] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:16:37.063185 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a960a0-26c9-4818-bb53-abc65f783dbe None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:16:37.072134 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a960a0-26c9-4818-bb53-abc65f783dbe None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:16:37.076613 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543cb04a-7e6d-4907-ae2c-3b8d709dc94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:16:37.077252 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543cb04a-7e6d-4907-ae2c-3b8d709dc94e admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:16:37.077537 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543cb04a-7e6d-4907-ae2c-3b8d709dc94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:16:37.077808 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543cb04a-7e6d-4907-ae2c-3b8d709dc94e admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:16:37.078486 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543cb04a-7e6d-4907-ae2c-3b8d709dc94e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:16:37.080311 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: WARNING py.warnings [None req-543cb04a-7e6d-4907-ae2c-3b8d709dc94e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:16:37.080311 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: warnings.warn(msg) Jun 29 12:16:37.080311 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: Jun 29 12:16:37.081507 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543cb04a-7e6d-4907-ae2c-3b8d709dc94e admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:16:37.116302 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 753/1497] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:16:37 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:16:37.120456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78b66f-72e1-4a13-b2cd-e87d189d8494 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:16:37.130886 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78b66f-72e1-4a13-b2cd-e87d189d8494 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:16:37.189893 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d63f2-7b66-4c14-9cb0-d614ddc68055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:16:37.190586 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d63f2-7b66-4c14-9cb0-d614ddc68055 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:16:37.190898 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d63f2-7b66-4c14-9cb0-d614ddc68055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:16:37.191306 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d63f2-7b66-4c14-9cb0-d614ddc68055 admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:16:37.191891 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928d63f2-7b66-4c14-9cb0-d614ddc68055 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:16:37.192994 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: WARNING py.warnings [None req-928d63f2-7b66-4c14-9cb0-d614ddc68055 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:16:37.192994 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: warnings.warn(msg) Jun 29 12:16:37.192994 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: Jun 29 12:16:37.194405 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928d63f2-7b66-4c14-9cb0-d614ddc68055 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:16:37.214598 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 745/1498] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:16:37 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:16:37.219178 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543cb04a-7e6d-4907-ae2c-3b8d709dc94e admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:16:37.229185 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543cb04a-7e6d-4907-ae2c-3b8d709dc94e admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:16:37.233611 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbad710-57f4-425a-9454-8ac4f9cdad7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:16:37.234895 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbad710-57f4-425a-9454-8ac4f9cdad7d admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:16:37.235293 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbad710-57f4-425a-9454-8ac4f9cdad7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:16:37.235417 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbad710-57f4-425a-9454-8ac4f9cdad7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:16:37.236117 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbad710-57f4-425a-9454-8ac4f9cdad7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:16:37.237195 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: WARNING py.warnings [None req-abbad710-57f4-425a-9454-8ac4f9cdad7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:16:37.237195 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: warnings.warn(msg) Jun 29 12:16:37.237195 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: Jun 29 12:16:37.238126 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbad710-57f4-425a-9454-8ac4f9cdad7d admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:16:37.251038 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 754/1499] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:16:37.255030 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d63f2-7b66-4c14-9cb0-d614ddc68055 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:16:37.264772 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d63f2-7b66-4c14-9cb0-d614ddc68055 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:16:37.269260 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945f507-846a-4e3b-87d1-aa1e07016043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:16:37.269911 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945f507-846a-4e3b-87d1-aa1e07016043 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:16:37.270199 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945f507-846a-4e3b-87d1-aa1e07016043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:16:37.270467 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945f507-846a-4e3b-87d1-aa1e07016043 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:16:37.271220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6945f507-846a-4e3b-87d1-aa1e07016043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:16:37.272226 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: WARNING py.warnings [None req-6945f507-846a-4e3b-87d1-aa1e07016043 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:16:37.272226 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: warnings.warn(msg) Jun 29 12:16:37.272226 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: Jun 29 12:16:37.273106 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6945f507-846a-4e3b-87d1-aa1e07016043 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:16:37.287250 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 746/1500] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:16:37.291482 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbad710-57f4-425a-9454-8ac4f9cdad7d admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:16:37.302482 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbad710-57f4-425a-9454-8ac4f9cdad7d admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:16:37.306981 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57a224-5af0-4872-a4bb-15502a1d32fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:16:37.307861 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57a224-5af0-4872-a4bb-15502a1d32fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:16:37.308141 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57a224-5af0-4872-a4bb-15502a1d32fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:16:37.308416 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57a224-5af0-4872-a4bb-15502a1d32fe admin admin] PATH_INFO: `/v3/projects/5503361648c948d98becc4dea558d46b/users/7c8efe1a22004c53ace2b34d90ce736d/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:16:37.322909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57a224-5af0-4872-a4bb-15502a1d32fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5503361648c948d98becc4dea558d46b, user_id=7c8efe1a22004c53ace2b34d90ce736d, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:16:37.323942 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: WARNING py.warnings [None req-be57a224-5af0-4872-a4bb-15502a1d32fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:16:37.323942 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: warnings.warn(msg) Jun 29 12:16:37.323942 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: Jun 29 12:16:37.325888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57a224-5af0-4872-a4bb-15502a1d32fe admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:16:37.338756 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 755/1501] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:16:37 2022] PUT /identity/v3/projects/5503361648c948d98becc4dea558d46b/users/7c8efe1a22004c53ace2b34d90ce736d/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:16:37.351349 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495bc51-960d-45d0-a684-fd3abfd97bc8 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:16:37.351646 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495bc51-960d-45d0-a684-fd3abfd97bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:16:37.351926 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495bc51-960d-45d0-a684-fd3abfd97bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:16:37.378652 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-a495bc51-960d-45d0-a684-fd3abfd97bc8 None None] MFA Rules not processed for user `7c8efe1a22004c53ace2b34d90ce736d`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:16:37.379877 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-a495bc51-960d-45d0-a684-fd3abfd97bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:16:37.445655 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 747/1502] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:16:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:16:37.458629 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bbe8a-7a46-4007-ad02-a8ce805dc0bc None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:16:37.458948 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bbe8a-7a46-4007-ad02-a8ce805dc0bc None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:16:37.459230 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bbe8a-7a46-4007-ad02-a8ce805dc0bc None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:16:37.460624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 756/1503] 10.222.0.13 () {54 vars in 963 bytes} [Wed Jun 29 12:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:16:37.465446 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6434ec-b284-49ea-ad40-efb5b864721e None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:16:37.465736 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6434ec-b284-49ea-ad40-efb5b864721e None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:16:37.466014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6434ec-b284-49ea-ad40-efb5b864721e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:16:37.483986 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-3f6434ec-b284-49ea-ad40-efb5b864721e None None] MFA Rules not processed for user `4009947e15c347e19da8b4fbddfb2875`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:16:37.485825 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-3f6434ec-b284-49ea-ad40-efb5b864721e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:16:37.529218 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:16:37.538519 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 748/1504] 10.222.0.13 () {58 vars in 1060 bytes} [Wed Jun 29 12:16:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:16:37.546199 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291bbe8a-7a46-4007-ad02-a8ce805dc0bc None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:16:37.556655 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291bbe8a-7a46-4007-ad02-a8ce805dc0bc None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:16:37.560179 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70596bdc-92c9-4f66-ac67-dc83cdc627ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:16:37.560808 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70596bdc-92c9-4f66-ac67-dc83cdc627ce service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:16:37.561094 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70596bdc-92c9-4f66-ac67-dc83cdc627ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:16:37.561391 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70596bdc-92c9-4f66-ac67-dc83cdc627ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:16:37.569513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70596bdc-92c9-4f66-ac67-dc83cdc627ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:16:37.570980 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70596bdc-92c9-4f66-ac67-dc83cdc627ce service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:16:37.580112 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 757/1505] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:16:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:16:37.625782 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fbd67-e952-421c-bd9d-daab6f9427d2 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:16:37.626217 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fbd67-e952-421c-bd9d-daab6f9427d2 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:16:37.626570 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fbd67-e952-421c-bd9d-daab6f9427d2 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:16:37.628648 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 749/1506] 10.222.0.13 () {52 vars in 829 bytes} [Wed Jun 29 12:16:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:16:37.632245 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70596bdc-92c9-4f66-ac67-dc83cdc627ce service cinder] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:16:37.692643 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70596bdc-92c9-4f66-ac67-dc83cdc627ce service cinder] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:16:37.697067 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0b95a-9d33-4bb1-b0ff-6bcf134b51f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:16:37.697937 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0b95a-9d33-4bb1-b0ff-6bcf134b51f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:16:37.698217 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0b95a-9d33-4bb1-b0ff-6bcf134b51f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:16:37.698492 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0b95a-9d33-4bb1-b0ff-6bcf134b51f7 admin admin] PATH_INFO: `/v3/users/7c8efe1a22004c53ace2b34d90ce736d` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:16:37.699698 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0b95a-9d33-4bb1-b0ff-6bcf134b51f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c8efe1a22004c53ace2b34d90ce736d)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:16:37.700758 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: WARNING py.warnings [None req-27c0b95a-9d33-4bb1-b0ff-6bcf134b51f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:16:37.700758 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: warnings.warn(msg) Jun 29 12:16:37.700758 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: Jun 29 12:16:37.702008 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0b95a-9d33-4bb1-b0ff-6bcf134b51f7 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:16:37.770859 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-27c0b95a-9d33-4bb1-b0ff-6bcf134b51f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c8efe1a22004c53ace2b34d90ce736d'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:16:37.771455 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-27c0b95a-9d33-4bb1-b0ff-6bcf134b51f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c8efe1a22004c53ace2b34d90ce736d'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:16:37.791487 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-27c0b95a-9d33-4bb1-b0ff-6bcf134b51f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c8efe1a22004c53ace2b34d90ce736d'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:16:37.800861 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-27c0b95a-9d33-4bb1-b0ff-6bcf134b51f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c8efe1a22004c53ace2b34d90ce736d'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:16:37.801714 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-27c0b95a-9d33-4bb1-b0ff-6bcf134b51f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c8efe1a22004c53ace2b34d90ce736d'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:16:37.810434 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:16:37.823040 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 758/1507] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:16:37 2022] DELETE /identity/v3/users/7c8efe1a22004c53ace2b34d90ce736d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:16:37.827528 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594ef08-a044-450f-8402-fe9941231c0a None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:16:37.828347 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594ef08-a044-450f-8402-fe9941231c0a None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:16:37.828629 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594ef08-a044-450f-8402-fe9941231c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:16:37.846771 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-8594ef08-a044-450f-8402-fe9941231c0a None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:16:37.847996 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-8594ef08-a044-450f-8402-fe9941231c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:16:37.904861 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 750/1508] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:16:37.914662 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0b95a-9d33-4bb1-b0ff-6bcf134b51f7 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:16:37.916082 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-27c0b95a-9d33-4bb1-b0ff-6bcf134b51f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:16:37.971342 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0b95a-9d33-4bb1-b0ff-6bcf134b51f7 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:16:37.974805 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937927fd-90fb-412b-8d3a-4e0d4cd769c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:16:37.975448 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937927fd-90fb-412b-8d3a-4e0d4cd769c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:16:37.975729 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937927fd-90fb-412b-8d3a-4e0d4cd769c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:16:37.976003 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937927fd-90fb-412b-8d3a-4e0d4cd769c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:16:37.985594 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937927fd-90fb-412b-8d3a-4e0d4cd769c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:16:37.987111 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937927fd-90fb-412b-8d3a-4e0d4cd769c0 service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:16:37.996397 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 759/1509] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:16:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:16:38.331325 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8594ef08-a044-450f-8402-fe9941231c0a None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:16:38.332852 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-8594ef08-a044-450f-8402-fe9941231c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:16:38.345041 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8594ef08-a044-450f-8402-fe9941231c0a None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:16:38.349920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909a5ad-e0ff-4835-88b9-658672e5e4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:16:38.350835 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909a5ad-e0ff-4835-88b9-658672e5e4e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:16:38.351121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909a5ad-e0ff-4835-88b9-658672e5e4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:16:38.351415 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909a5ad-e0ff-4835-88b9-658672e5e4e6 admin admin] PATH_INFO: `/v3/projects/5503361648c948d98becc4dea558d46b` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:16:38.353358 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909a5ad-e0ff-4835-88b9-658672e5e4e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5503361648c948d98becc4dea558d46b)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:16:38.354781 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: WARNING py.warnings [None req-0909a5ad-e0ff-4835-88b9-658672e5e4e6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:16:38.354781 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: warnings.warn(msg) Jun 29 12:16:38.354781 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: Jun 29 12:16:38.356089 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909a5ad-e0ff-4835-88b9-658672e5e4e6 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:16:38.420750 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-0909a5ad-e0ff-4835-88b9-658672e5e4e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5503361648c948d98becc4dea558d46b', 'request_id': 'req-0909a5ad-e0ff-4835-88b9-658672e5e4e6'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:16:38.431365 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-0909a5ad-e0ff-4835-88b9-658672e5e4e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5503361648c948d98becc4dea558d46b', 'request_id': 'req-0909a5ad-e0ff-4835-88b9-658672e5e4e6'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:16:38.446060 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-0909a5ad-e0ff-4835-88b9-658672e5e4e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5503361648c948d98becc4dea558d46b', 'request_id': 'req-0909a5ad-e0ff-4835-88b9-658672e5e4e6'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:16:38.456952 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-0909a5ad-e0ff-4835-88b9-658672e5e4e6 admin admin] The token cache is being invalidate because project 5503361648c948d98becc4dea558d46b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:16:38.457241 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-0909a5ad-e0ff-4835-88b9-658672e5e4e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:16:38.457988 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-0909a5ad-e0ff-4835-88b9-658672e5e4e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:16:38.459589 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 751/1510] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:16:38 2022] DELETE /identity/v3/projects/5503361648c948d98becc4dea558d46b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:16:47.992376 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=29 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:16:48.453957 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:18:22.644754 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0172634-1439-4d97-bd37-efd6ce28be4f None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:18:22.645343 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0172634-1439-4d97-bd37-efd6ce28be4f None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:18:22.645343 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0172634-1439-4d97-bd37-efd6ce28be4f None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:18:22.647120 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 760/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 12:18:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:18:22.652586 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941be748-0cbc-4c31-a7d0-410bda3c90c6 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:18:22.653094 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941be748-0cbc-4c31-a7d0-410bda3c90c6 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:18:22.653289 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941be748-0cbc-4c31-a7d0-410bda3c90c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:18:22.672093 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-941be748-0cbc-4c31-a7d0-410bda3c90c6 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:18:22.673292 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-941be748-0cbc-4c31-a7d0-410bda3c90c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:18:22.733328 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 752/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 12:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:18:22.890762 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0172634-1439-4d97-bd37-efd6ce28be4f None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:18:22.892612 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-a0172634-1439-4d97-bd37-efd6ce28be4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:18:22.965769 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0172634-1439-4d97-bd37-efd6ce28be4f None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:18:22.971176 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1d4eb-8a5c-4727-8511-8f3585de6e03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:18:22.971828 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1d4eb-8a5c-4727-8511-8f3585de6e03 service nova] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:18:22.972109 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1d4eb-8a5c-4727-8511-8f3585de6e03 service nova] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:18:22.972384 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1d4eb-8a5c-4727-8511-8f3585de6e03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:18:22.980839 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1d4eb-8a5c-4727-8511-8f3585de6e03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:18:22.982413 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1d4eb-8a5c-4727-8511-8f3585de6e03 service nova] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:18:22.992191 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 761/1513] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:18:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:18:23.864605 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b38af3-1e5a-4efb-abde-654f0d7f8def None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:18:23.865176 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b38af3-1e5a-4efb-abde-654f0d7f8def None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:18:23.865176 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b38af3-1e5a-4efb-abde-654f0d7f8def None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:18:23.866556 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 753/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 12:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:18:23.871727 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9a464-b2bf-4c35-aa02-b908ff871c6e None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:18:23.872169 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9a464-b2bf-4c35-aa02-b908ff871c6e None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:18:23.872357 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9a464-b2bf-4c35-aa02-b908ff871c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:18:23.891240 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-27b9a464-b2bf-4c35-aa02-b908ff871c6e None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:18:23.892510 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-27b9a464-b2bf-4c35-aa02-b908ff871c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:18:23.902803 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 762/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 12:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:18:24.057618 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b38af3-1e5a-4efb-abde-654f0d7f8def None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:18:24.071934 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b38af3-1e5a-4efb-abde-654f0d7f8def None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:18:24.078285 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676d265-ea76-4b5c-a886-d83ee1f9305e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:18:24.078955 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676d265-ea76-4b5c-a886-d83ee1f9305e service nova] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:18:24.079235 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676d265-ea76-4b5c-a886-d83ee1f9305e service nova] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:18:24.079507 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676d265-ea76-4b5c-a886-d83ee1f9305e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:18:24.087923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676d265-ea76-4b5c-a886-d83ee1f9305e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:18:24.089516 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676d265-ea76-4b5c-a886-d83ee1f9305e service nova] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:18:24.099860 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 754/1516] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:18:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:18:25.149095 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188d769-a736-445c-9a1d-38c73417415a None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:18:25.149657 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188d769-a736-445c-9a1d-38c73417415a None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:18:25.149657 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188d769-a736-445c-9a1d-38c73417415a None None] PATH_INFO: `/v3` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:18:25.150972 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 763/1517] 10.222.0.16 () {54 vars in 925 bytes} [Wed Jun 29 12:18:25 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:18:25.159426 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fed45-b28f-4e0c-9d43-e5b532ca0944 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:18:25.159875 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fed45-b28f-4e0c-9d43-e5b532ca0944 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:18:25.160111 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fed45-b28f-4e0c-9d43-e5b532ca0944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:18:25.178350 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-208fed45-b28f-4e0c-9d43-e5b532ca0944 None None] MFA Rules not processed for user `cd57c8b894e74c709ea389ed462184fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:18:25.179578 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-208fed45-b28f-4e0c-9d43-e5b532ca0944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:18:25.240930 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 755/1518] 10.222.0.16 () {58 vars in 1015 bytes} [Wed Jun 29 12:18:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:18:29.164785 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938498a5-7544-4587-9c94-9c56681812b5 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:18:29.165301 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938498a5-7544-4587-9c94-9c56681812b5 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:18:29.165301 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938498a5-7544-4587-9c94-9c56681812b5 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:18:29.166709 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 764/1519] 10.222.0.13 () {54 vars in 960 bytes} [Wed Jun 29 12:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:18:29.172181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edcd11c-290f-4098-b6c5-6c75dda5ce8a None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:18:29.172643 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edcd11c-290f-4098-b6c5-6c75dda5ce8a None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:18:29.172758 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edcd11c-290f-4098-b6c5-6c75dda5ce8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:18:29.191315 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-0edcd11c-290f-4098-b6c5-6c75dda5ce8a None None] MFA Rules not processed for user `cd57c8b894e74c709ea389ed462184fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:18:29.192526 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-0edcd11c-290f-4098-b6c5-6c75dda5ce8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:18:29.201330 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 756/1520] 10.222.0.13 () {58 vars in 1057 bytes} [Wed Jun 29 12:18:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:18:29.209140 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938498a5-7544-4587-9c94-9c56681812b5 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:18:29.223012 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938498a5-7544-4587-9c94-9c56681812b5 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:18:29.227903 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adb890-3872-4799-a64b-ce3519cacbbd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57c8b894e74c709ea389ed462184fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:18:29.228545 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adb890-3872-4799-a64b-ce3519cacbbd service placement] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:18:29.228832 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adb890-3872-4799-a64b-ce3519cacbbd service placement] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:18:29.229109 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adb890-3872-4799-a64b-ce3519cacbbd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:18:29.237990 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99adb890-3872-4799-a64b-ce3519cacbbd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:18:29.239649 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99adb890-3872-4799-a64b-ce3519cacbbd service placement] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:18:29.249195 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 765/1521] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:18:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:18:35.348604 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f5a1e-0947-467e-a645-c51f771f8337 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:18:35.349181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f5a1e-0947-467e-a645-c51f771f8337 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:18:35.349181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f5a1e-0947-467e-a645-c51f771f8337 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:18:35.350527 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 757/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 12:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:18:35.355338 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d60aa-08bb-45db-905e-39af171b1fe2 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:18:35.355786 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d60aa-08bb-45db-905e-39af171b1fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:18:35.355988 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d60aa-08bb-45db-905e-39af171b1fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:18:35.373982 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-978d60aa-08bb-45db-905e-39af171b1fe2 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:18:35.375214 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-978d60aa-08bb-45db-905e-39af171b1fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:18:35.382950 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 766/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 12:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:18:35.538549 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f5a1e-0947-467e-a645-c51f771f8337 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:18:35.553553 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f5a1e-0947-467e-a645-c51f771f8337 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:18:35.559438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6606e1-e9ca-4418-8898-33c8e51087bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:18:35.560127 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6606e1-e9ca-4418-8898-33c8e51087bb service nova] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:18:35.560412 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6606e1-e9ca-4418-8898-33c8e51087bb service nova] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:18:35.560691 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6606e1-e9ca-4418-8898-33c8e51087bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:18:35.571057 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6606e1-e9ca-4418-8898-33c8e51087bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:18:35.572723 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6606e1-e9ca-4418-8898-33c8e51087bb service nova] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:18:35.584356 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 758/1524] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:18:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:18:36.430107 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a877f4-2262-41f6-82dc-8b7bbbe0fd10 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:18:36.430715 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a877f4-2262-41f6-82dc-8b7bbbe0fd10 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:18:36.430715 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a877f4-2262-41f6-82dc-8b7bbbe0fd10 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:18:36.432096 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 767/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 12:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:18:36.437240 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cea4fa-72e9-45d3-9e1d-193d7b427c66 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:18:36.437680 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cea4fa-72e9-45d3-9e1d-193d7b427c66 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:18:36.437794 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cea4fa-72e9-45d3-9e1d-193d7b427c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:18:36.455681 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-83cea4fa-72e9-45d3-9e1d-193d7b427c66 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:18:36.456922 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-83cea4fa-72e9-45d3-9e1d-193d7b427c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:18:36.464915 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 759/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 12:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:18:36.617265 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a877f4-2262-41f6-82dc-8b7bbbe0fd10 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:18:36.631643 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a877f4-2262-41f6-82dc-8b7bbbe0fd10 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:18:36.636965 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9abb8-f3eb-40f8-a27d-ad62e1c7bfa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:18:36.637603 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9abb8-f3eb-40f8-a27d-ad62e1c7bfa6 service nova] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:18:36.637892 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9abb8-f3eb-40f8-a27d-ad62e1c7bfa6 service nova] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:18:36.638175 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9abb8-f3eb-40f8-a27d-ad62e1c7bfa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:18:36.646526 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9abb8-f3eb-40f8-a27d-ad62e1c7bfa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:18:36.648155 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9abb8-f3eb-40f8-a27d-ad62e1c7bfa6 service nova] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:18:36.658739 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 768/1527] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:18:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:18:41.099678 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d521e7-a860-4e06-ae3e-f2b34a053b9e None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:18:41.100248 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d521e7-a860-4e06-ae3e-f2b34a053b9e None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:18:41.100248 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d521e7-a860-4e06-ae3e-f2b34a053b9e None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:18:41.101560 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 760/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 12:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:18:41.107094 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1872615-2d51-41c5-816c-a537fa2bfc2a None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:18:41.107581 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1872615-2d51-41c5-816c-a537fa2bfc2a None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:18:41.107691 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1872615-2d51-41c5-816c-a537fa2bfc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:18:41.125870 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-a1872615-2d51-41c5-816c-a537fa2bfc2a None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:18:41.127117 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-a1872615-2d51-41c5-816c-a537fa2bfc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:18:41.134854 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 769/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 12:18:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:18:41.171441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d521e7-a860-4e06-ae3e-f2b34a053b9e None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:18:41.173097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-34d521e7-a860-4e06-ae3e-f2b34a053b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:18:41.230655 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d521e7-a860-4e06-ae3e-f2b34a053b9e None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:18:41.234709 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b810981-75e1-4115-9691-ce72bee7312a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:18:41.235344 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b810981-75e1-4115-9691-ce72bee7312a service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:18:41.235627 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b810981-75e1-4115-9691-ce72bee7312a service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:18:41.235902 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b810981-75e1-4115-9691-ce72bee7312a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:18:41.244693 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b810981-75e1-4115-9691-ce72bee7312a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:18:41.246122 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b810981-75e1-4115-9691-ce72bee7312a service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:18:41.251593 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:18:41.256383 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 761/1530] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:18:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:18:43.292637 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba078a-9568-4a07-89e6-06d08c4548c7 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:18:43.293201 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba078a-9568-4a07-89e6-06d08c4548c7 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:18:43.293201 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba078a-9568-4a07-89e6-06d08c4548c7 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:18:43.295251 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 770/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 12:18:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:18:43.300436 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d9448-7057-4875-af5a-1176e3cd2779 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:18:43.300872 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d9448-7057-4875-af5a-1176e3cd2779 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:18:43.301104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d9448-7057-4875-af5a-1176e3cd2779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:18:43.318609 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-861d9448-7057-4875-af5a-1176e3cd2779 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:18:43.319827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-861d9448-7057-4875-af5a-1176e3cd2779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:18:43.327438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 762/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 12:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:18:43.364613 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba078a-9568-4a07-89e6-06d08c4548c7 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:18:43.366928 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-baba078a-9568-4a07-89e6-06d08c4548c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:18:43.383279 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba078a-9568-4a07-89e6-06d08c4548c7 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:18:43.387354 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a3325-6e5e-4158-bb87-247fdfffca47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:18:43.388027 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a3325-6e5e-4158-bb87-247fdfffca47 service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:18:43.388317 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a3325-6e5e-4158-bb87-247fdfffca47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:18:43.388581 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a3325-6e5e-4158-bb87-247fdfffca47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:18:43.398803 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a3325-6e5e-4158-bb87-247fdfffca47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:18:43.400272 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a3325-6e5e-4158-bb87-247fdfffca47 service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:18:43.410941 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 771/1533] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:18:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:18:47.297847 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bffb30-6c78-42cb-a41d-010041953911 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:18:47.298394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bffb30-6c78-42cb-a41d-010041953911 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:18:47.298394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bffb30-6c78-42cb-a41d-010041953911 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:18:47.299831 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 763/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 12:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:18:47.305005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7aefe3-4442-467a-bbf8-ab5261be6179 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:18:47.305428 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7aefe3-4442-467a-bbf8-ab5261be6179 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:18:47.305563 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7aefe3-4442-467a-bbf8-ab5261be6179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:18:47.323720 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-ff7aefe3-4442-467a-bbf8-ab5261be6179 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:18:47.324910 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-ff7aefe3-4442-467a-bbf8-ab5261be6179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:18:47.332561 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 772/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 12:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:18:47.644189 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bffb30-6c78-42cb-a41d-010041953911 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:18:47.645881 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-35bffb30-6c78-42cb-a41d-010041953911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:18:47.705036 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bffb30-6c78-42cb-a41d-010041953911 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:18:47.708582 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff1d41-db53-4861-aaf0-c8d10e11be8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:18:47.709244 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff1d41-db53-4861-aaf0-c8d10e11be8e service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:18:47.709528 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff1d41-db53-4861-aaf0-c8d10e11be8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:18:47.709810 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff1d41-db53-4861-aaf0-c8d10e11be8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:18:47.719873 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff1d41-db53-4861-aaf0-c8d10e11be8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:18:47.721373 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff1d41-db53-4861-aaf0-c8d10e11be8e service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:18:47.733341 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 764/1536] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:18:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:18:49.800977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab86f4-c0d9-436b-99f2-21316629ac59 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:18:49.801531 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab86f4-c0d9-436b-99f2-21316629ac59 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:18:49.801531 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab86f4-c0d9-436b-99f2-21316629ac59 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:18:49.802950 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 773/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 12:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:18:49.808267 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943f4d3-3b10-4600-9a0d-5293b6c87bc6 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:18:49.808694 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943f4d3-3b10-4600-9a0d-5293b6c87bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:18:49.808806 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943f4d3-3b10-4600-9a0d-5293b6c87bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:18:49.827943 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-8943f4d3-3b10-4600-9a0d-5293b6c87bc6 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:18:49.829126 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-8943f4d3-3b10-4600-9a0d-5293b6c87bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:18:49.836846 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 765/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 12:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:18:50.140432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab86f4-c0d9-436b-99f2-21316629ac59 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:18:50.147834 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-17ab86f4-c0d9-436b-99f2-21316629ac59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:18:50.155801 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=65 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:18:50.162986 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab86f4-c0d9-436b-99f2-21316629ac59 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:18:50.166483 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae12d9d-a754-461d-9899-88d3c8387d94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:18:50.167162 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae12d9d-a754-461d-9899-88d3c8387d94 service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:18:50.167446 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae12d9d-a754-461d-9899-88d3c8387d94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:18:50.167724 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae12d9d-a754-461d-9899-88d3c8387d94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:18:50.176933 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae12d9d-a754-461d-9899-88d3c8387d94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:18:50.178370 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae12d9d-a754-461d-9899-88d3c8387d94 service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:18:50.188692 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 774/1539] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:18:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:18:59.822591 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=32 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:19:00.183661 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=5 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:21.531251 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00809d3-8662-426d-8a88-4195a069e811 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:21.531969 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00809d3-8662-426d-8a88-4195a069e811 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:21.531969 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00809d3-8662-426d-8a88-4195a069e811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:21.550450 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575b837-86ab-4fda-a48a-ebe77d772ed7 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:21.551592 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575b837-86ab-4fda-a48a-ebe77d772ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:21.552134 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575b837-86ab-4fda-a48a-ebe77d772ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:21.558796 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-d00809d3-8662-426d-8a88-4195a069e811 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:21.560002 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-d00809d3-8662-426d-8a88-4195a069e811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:21.573635 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-b575b837-86ab-4fda-a48a-ebe77d772ed7 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:21.578245 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 766/1540] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:21.579062 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-b575b837-86ab-4fda-a48a-ebe77d772ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:21.586069 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64659e-afa2-472b-810b-0ad7187bd4f7 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:21.586360 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64659e-afa2-472b-810b-0ad7187bd4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:21.586688 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64659e-afa2-472b-810b-0ad7187bd4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:21.595278 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 775/1541] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:20:21.605228 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603aee5-29af-4677-ab69-a8094aa1294d None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:21.605828 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603aee5-29af-4677-ab69-a8094aa1294d None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:21.606307 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603aee5-29af-4677-ab69-a8094aa1294d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:21.620016 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-8f64659e-afa2-472b-810b-0ad7187bd4f7 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:21.620263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-8f64659e-afa2-472b-810b-0ad7187bd4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:21.634886 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 767/1542] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:20:21.636284 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-6603aee5-29af-4677-ab69-a8094aa1294d None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:21.637717 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-6603aee5-29af-4677-ab69-a8094aa1294d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:21.639602 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64659e-afa2-472b-810b-0ad7187bd4f7 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:21.652736 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 776/1543] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:20:21.666298 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64659e-afa2-472b-810b-0ad7187bd4f7 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:21.667341 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603aee5-29af-4677-ab69-a8094aa1294d None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:21.675655 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e8c1f-9b42-496e-a2e2-de8c9692a575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:21.676268 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e8c1f-9b42-496e-a2e2-de8c9692a575 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:21.676543 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e8c1f-9b42-496e-a2e2-de8c9692a575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:21.676826 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e8c1f-9b42-496e-a2e2-de8c9692a575 admin admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:21.677567 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e8c1f-9b42-496e-a2e2-de8c9692a575 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:20:21.677878 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e8c1f-9b42-496e-a2e2-de8c9692a575 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:21.682670 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e8c1f-9b42-496e-a2e2-de8c9692a575 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:21.686269 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603aee5-29af-4677-ab69-a8094aa1294d None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:21.699287 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73448230-f0d6-4a09-a521-781550c6da82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:21.700389 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73448230-f0d6-4a09-a521-781550c6da82 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:21.701190 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73448230-f0d6-4a09-a521-781550c6da82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:21.701685 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73448230-f0d6-4a09-a521-781550c6da82 admin admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:21.705498 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 768/1544] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:20:21.706200 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73448230-f0d6-4a09-a521-781550c6da82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:20:21.707089 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73448230-f0d6-4a09-a521-781550c6da82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:21.708461 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: WARNING py.warnings [None req-73448230-f0d6-4a09-a521-781550c6da82 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:20:21.708461 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: warnings.warn(msg) Jun 29 12:20:21.708461 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: Jun 29 12:20:21.709789 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73448230-f0d6-4a09-a521-781550c6da82 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:21.716244 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e8c1f-9b42-496e-a2e2-de8c9692a575 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:21.747163 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 777/1545] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:20:21.749527 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e8c1f-9b42-496e-a2e2-de8c9692a575 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:21.757633 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959ff3a-463f-4705-a1bd-f658f899371e None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:21.758388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959ff3a-463f-4705-a1bd-f658f899371e None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:21.758965 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959ff3a-463f-4705-a1bd-f658f899371e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:21.768086 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6764a4e-5d25-4ae8-8203-194cc1d7394f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:21.768781 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6764a4e-5d25-4ae8-8203-194cc1d7394f admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:21.769064 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6764a4e-5d25-4ae8-8203-194cc1d7394f admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:21.769336 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6764a4e-5d25-4ae8-8203-194cc1d7394f admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:21.770136 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6764a4e-5d25-4ae8-8203-194cc1d7394f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:21.771108 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: WARNING py.warnings [None req-a6764a4e-5d25-4ae8-8203-194cc1d7394f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:20:21.771108 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: warnings.warn(msg) Jun 29 12:20:21.771108 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: Jun 29 12:20:21.772421 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6764a4e-5d25-4ae8-8203-194cc1d7394f admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:21.796645 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-5959ff3a-463f-4705-a1bd-f658f899371e None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:21.798263 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-5959ff3a-463f-4705-a1bd-f658f899371e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:21.819048 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 778/1546] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:21.820925 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959ff3a-463f-4705-a1bd-f658f899371e None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:21.837920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959ff3a-463f-4705-a1bd-f658f899371e None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:21.848762 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 769/1547] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:20:21 2022] POST /identity/v3/projects => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:20:21.850196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeadbcf-b1ed-4289-ac56-678c7212865c None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:21.850491 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeadbcf-b1ed-4289-ac56-678c7212865c None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:21.850797 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeadbcf-b1ed-4289-ac56-678c7212865c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:21.852494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e216d-a9d5-4e6d-bcfc-89cd8aeda715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:21.853408 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e216d-a9d5-4e6d-bcfc-89cd8aeda715 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:21.853883 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e216d-a9d5-4e6d-bcfc-89cd8aeda715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:21.854359 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e216d-a9d5-4e6d-bcfc-89cd8aeda715 admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:21.855262 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e216d-a9d5-4e6d-bcfc-89cd8aeda715 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:21.857403 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e216d-a9d5-4e6d-bcfc-89cd8aeda715 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:21.880054 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-bdeadbcf-b1ed-4289-ac56-678c7212865c None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:21.881261 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-bdeadbcf-b1ed-4289-ac56-678c7212865c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:21.908272 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 779/1548] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:20:21 2022] POST /identity/v3/projects => generated 383 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:21.909582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e216d-a9d5-4e6d-bcfc-89cd8aeda715 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:21.997516 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 770/1549] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:21.998740 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeadbcf-b1ed-4289-ac56-678c7212865c None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:22.008834 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeadbcf-b1ed-4289-ac56-678c7212865c None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:22.016387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69e45d-1554-4fd6-b40f-9fb424eeb450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:22.016799 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e216d-a9d5-4e6d-bcfc-89cd8aeda715 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:22.017113 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69e45d-1554-4fd6-b40f-9fb424eeb450 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:22.017402 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69e45d-1554-4fd6-b40f-9fb424eeb450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:22.017681 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69e45d-1554-4fd6-b40f-9fb424eeb450 admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:22.018559 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a69e45d-1554-4fd6-b40f-9fb424eeb450 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:22.020514 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a69e45d-1554-4fd6-b40f-9fb424eeb450 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:22.021572 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522051b9-9d88-4542-ac38-7ba87644982b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:22.022214 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522051b9-9d88-4542-ac38-7ba87644982b admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:22.022507 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522051b9-9d88-4542-ac38-7ba87644982b admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:22.022814 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522051b9-9d88-4542-ac38-7ba87644982b admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:22.023499 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522051b9-9d88-4542-ac38-7ba87644982b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:22.025255 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: WARNING py.warnings [None req-522051b9-9d88-4542-ac38-7ba87644982b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:20:22.025255 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: warnings.warn(msg) Jun 29 12:20:22.025255 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: Jun 29 12:20:22.026471 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522051b9-9d88-4542-ac38-7ba87644982b admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:22.042041 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 771/1550] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:20:21 2022] POST /identity/v3/users => generated 292 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:22.045562 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039487b8-a31f-4d65-b7c5-2d4018f79604 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:22.045562 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039487b8-a31f-4d65-b7c5-2d4018f79604 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:22.045562 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039487b8-a31f-4d65-b7c5-2d4018f79604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:22.054938 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 780/1551] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:20:21 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:22.057667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d460d0b-abe0-494e-a4e1-bf2406e4d378 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:22.058172 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d460d0b-abe0-494e-a4e1-bf2406e4d378 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:22.058679 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d460d0b-abe0-494e-a4e1-bf2406e4d378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:22.064794 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-039487b8-a31f-4d65-b7c5-2d4018f79604 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:22.066062 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-039487b8-a31f-4d65-b7c5-2d4018f79604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:22.074676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 772/1552] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:22.080165 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dd2fc-3b13-4c92-8f22-72ecd60a1bca None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:22.080724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dd2fc-3b13-4c92-8f22-72ecd60a1bca None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:22.081442 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dd2fc-3b13-4c92-8f22-72ecd60a1bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:22.083370 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-4d460d0b-abe0-494e-a4e1-bf2406e4d378 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:22.084760 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-4d460d0b-abe0-494e-a4e1-bf2406e4d378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:22.094655 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 781/1553] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:22.095751 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d460d0b-abe0-494e-a4e1-bf2406e4d378 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:22.103169 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-4c6dd2fc-3b13-4c92-8f22-72ecd60a1bca None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:22.104768 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-4c6dd2fc-3b13-4c92-8f22-72ecd60a1bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:22.112100 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d460d0b-abe0-494e-a4e1-bf2406e4d378 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:22.113140 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 773/1554] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:22.114462 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd512d6d-ac13-4718-ab96-cded1038acc9 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:22.114834 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd512d6d-ac13-4718-ab96-cded1038acc9 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:22.115111 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd512d6d-ac13-4718-ab96-cded1038acc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:22.117521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050234dd-20f9-414c-8c39-bc2f9636f046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:22.118184 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050234dd-20f9-414c-8c39-bc2f9636f046 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:22.119025 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050234dd-20f9-414c-8c39-bc2f9636f046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:22.119304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050234dd-20f9-414c-8c39-bc2f9636f046 admin admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:22.120031 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050234dd-20f9-414c-8c39-bc2f9636f046 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:20:22.120340 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050234dd-20f9-414c-8c39-bc2f9636f046 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:22.121982 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050234dd-20f9-414c-8c39-bc2f9636f046 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:22.133981 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-fd512d6d-ac13-4718-ab96-cded1038acc9 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:22.135715 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-fd512d6d-ac13-4718-ab96-cded1038acc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:22.137769 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 782/1555] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:20:22.138546 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050234dd-20f9-414c-8c39-bc2f9636f046 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:22.143756 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 774/1556] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:22.144785 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd512d6d-ac13-4718-ab96-cded1038acc9 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:22.150061 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050234dd-20f9-414c-8c39-bc2f9636f046 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:22.154548 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f2fdc-565c-4bab-a7fe-c97c30ef9b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:22.155336 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f2fdc-565c-4bab-a7fe-c97c30ef9b5c admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:22.155887 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f2fdc-565c-4bab-a7fe-c97c30ef9b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:22.156165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f2fdc-565c-4bab-a7fe-c97c30ef9b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:22.156891 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f2fdc-565c-4bab-a7fe-c97c30ef9b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:22.158504 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f2fdc-565c-4bab-a7fe-c97c30ef9b5c admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:22.160675 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd512d6d-ac13-4718-ab96-cded1038acc9 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:22.167666 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833161f5-ca1e-4906-948f-84737b0c3243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:22.168441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833161f5-ca1e-4906-948f-84737b0c3243 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:22.168729 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833161f5-ca1e-4906-948f-84737b0c3243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:22.169004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833161f5-ca1e-4906-948f-84737b0c3243 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:22.169784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 783/1557] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:22.169912 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833161f5-ca1e-4906-948f-84737b0c3243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:22.170927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a53b02-89c4-4e93-afc2-c1ade70dedab None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:22.171221 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a53b02-89c4-4e93-afc2-c1ade70dedab None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:22.171483 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833161f5-ca1e-4906-948f-84737b0c3243 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:22.171685 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a53b02-89c4-4e93-afc2-c1ade70dedab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:22.183326 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 775/1558] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:22.184409 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a6465-cd16-4de7-94ac-5848f47e6ca9 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:22.184800 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a6465-cd16-4de7-94ac-5848f47e6ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:22.184969 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a6465-cd16-4de7-94ac-5848f47e6ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:22.194130 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-35a53b02-89c4-4e93-afc2-c1ade70dedab None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:22.195517 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-35a53b02-89c4-4e93-afc2-c1ade70dedab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:22.203951 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-ed3a6465-cd16-4de7-94ac-5848f47e6ca9 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:22.204879 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 784/1559] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:22.205133 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-ed3a6465-cd16-4de7-94ac-5848f47e6ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:22.206225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20149062-ac08-45d2-adf3-0bd44915395f None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:22.206509 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20149062-ac08-45d2-adf3-0bd44915395f None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:22.206813 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20149062-ac08-45d2-adf3-0bd44915395f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:22.215777 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 776/1560] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:22.217457 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a166b-2fed-4b5d-b4e7-b9499417a860 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:22.217927 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a166b-2fed-4b5d-b4e7-b9499417a860 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:22.218212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a166b-2fed-4b5d-b4e7-b9499417a860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:22.233335 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-20149062-ac08-45d2-adf3-0bd44915395f None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:22.234571 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-20149062-ac08-45d2-adf3-0bd44915395f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:22.236999 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-d55a166b-2fed-4b5d-b4e7-b9499417a860 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:22.238135 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-d55a166b-2fed-4b5d-b4e7-b9499417a860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:22.242513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 785/1561] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:22.245202 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20149062-ac08-45d2-adf3-0bd44915395f None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:22.252601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 777/1562] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:22.253940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ead57-ec9b-4403-a28d-9cd979ac5ea0 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:22.254237 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ead57-ec9b-4403-a28d-9cd979ac5ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:22.254568 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ead57-ec9b-4403-a28d-9cd979ac5ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:22.256636 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20149062-ac08-45d2-adf3-0bd44915395f None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:22.261887 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cdb08-db47-4fe0-8d20-17ed5f22a145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:22.262555 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cdb08-db47-4fe0-8d20-17ed5f22a145 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:22.262915 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cdb08-db47-4fe0-8d20-17ed5f22a145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:22.263191 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cdb08-db47-4fe0-8d20-17ed5f22a145 admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:22.263877 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77cdb08-db47-4fe0-8d20-17ed5f22a145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:22.265782 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77cdb08-db47-4fe0-8d20-17ed5f22a145 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:22.273329 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-967ead57-ec9b-4403-a28d-9cd979ac5ea0 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:22.274532 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-967ead57-ec9b-4403-a28d-9cd979ac5ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:22.286721 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 778/1563] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:22.286721 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ead57-ec9b-4403-a28d-9cd979ac5ea0 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:22.293288 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 786/1564] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:20:22 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:22.294138 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cdb08-db47-4fe0-8d20-17ed5f22a145 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:22.294342 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ead57-ec9b-4403-a28d-9cd979ac5ea0 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:22.328192 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:22.337167 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:22.353203 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107485f-5bf7-4704-9ea8-3261c3750108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:22.353878 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107485f-5bf7-4704-9ea8-3261c3750108 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:22.354158 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107485f-5bf7-4704-9ea8-3261c3750108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:22.354539 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107485f-5bf7-4704-9ea8-3261c3750108 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:22.355268 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107485f-5bf7-4704-9ea8-3261c3750108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:22.356874 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107485f-5bf7-4704-9ea8-3261c3750108 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:22.361533 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cdb08-db47-4fe0-8d20-17ed5f22a145 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:22.366547 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c110b6-12de-4756-98ab-40d6014547cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:22.367250 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c110b6-12de-4756-98ab-40d6014547cf admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:22.367436 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 779/1565] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:22.367838 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c110b6-12de-4756-98ab-40d6014547cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:22.368169 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c110b6-12de-4756-98ab-40d6014547cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:22.369479 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c110b6-12de-4756-98ab-40d6014547cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:22.369592 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107485f-5bf7-4704-9ea8-3261c3750108 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:22.371405 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c110b6-12de-4756-98ab-40d6014547cf admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:22.379311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107485f-5bf7-4704-9ea8-3261c3750108 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:22.381516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 787/1566] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:22.382354 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c110b6-12de-4756-98ab-40d6014547cf admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:22.384631 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3413b4-641d-4e3c-9cc2-614eb403eb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:22.385470 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3413b4-641d-4e3c-9cc2-614eb403eb77 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:22.385813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3413b4-641d-4e3c-9cc2-614eb403eb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:22.386090 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3413b4-641d-4e3c-9cc2-614eb403eb77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:22.386961 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3413b4-641d-4e3c-9cc2-614eb403eb77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:20:22.387267 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3413b4-641d-4e3c-9cc2-614eb403eb77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:22.388865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3413b4-641d-4e3c-9cc2-614eb403eb77 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:22.392383 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c110b6-12de-4756-98ab-40d6014547cf admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:22.396855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b92a3-2145-4186-a5dc-8c1936fe03ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:22.397871 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b92a3-2145-4186-a5dc-8c1936fe03ec admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:22.397871 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b92a3-2145-4186-a5dc-8c1936fe03ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:22.398097 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b92a3-2145-4186-a5dc-8c1936fe03ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:22.398789 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b92a3-2145-4186-a5dc-8c1936fe03ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:20:22.399098 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b92a3-2145-4186-a5dc-8c1936fe03ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:22.400735 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b92a3-2145-4186-a5dc-8c1936fe03ec admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:22.401373 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 780/1567] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:20:22.402775 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701e732-e379-4a45-bb2d-b031d111b9fc None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:22.403063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701e732-e379-4a45-bb2d-b031d111b9fc None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:22.403340 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701e732-e379-4a45-bb2d-b031d111b9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:22.419765 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 788/1568] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:20:22.420808 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b92a3-2145-4186-a5dc-8c1936fe03ec admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:22.420926 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-c701e732-e379-4a45-bb2d-b031d111b9fc None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:22.422052 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-c701e732-e379-4a45-bb2d-b031d111b9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:22.431914 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 781/1569] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:22.432101 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b92a3-2145-4186-a5dc-8c1936fe03ec admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:22.433655 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701e732-e379-4a45-bb2d-b031d111b9fc None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:22.436888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7721f3-ccb6-497b-98b6-eeafcb61544c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:22.437537 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7721f3-ccb6-497b-98b6-eeafcb61544c admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:22.437815 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7721f3-ccb6-497b-98b6-eeafcb61544c admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:22.438081 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7721f3-ccb6-497b-98b6-eeafcb61544c admin admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:22.438958 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7721f3-ccb6-497b-98b6-eeafcb61544c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:20:22.439261 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7721f3-ccb6-497b-98b6-eeafcb61544c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:22.440916 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7721f3-ccb6-497b-98b6-eeafcb61544c admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:22.444153 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701e732-e379-4a45-bb2d-b031d111b9fc None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:22.449332 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360d57e-f448-42ea-a394-92e3bcd6bbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:22.450020 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360d57e-f448-42ea-a394-92e3bcd6bbf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:22.450303 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360d57e-f448-42ea-a394-92e3bcd6bbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:22.450576 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360d57e-f448-42ea-a394-92e3bcd6bbf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:22.451367 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360d57e-f448-42ea-a394-92e3bcd6bbf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:20:22.451672 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360d57e-f448-42ea-a394-92e3bcd6bbf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:22.453272 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360d57e-f448-42ea-a394-92e3bcd6bbf9 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:22.454284 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 789/1570] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:20:22.455114 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7721f3-ccb6-497b-98b6-eeafcb61544c admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:22.465359 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7721f3-ccb6-497b-98b6-eeafcb61544c admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:22.473189 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 782/1571] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:20:22.473353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61559040-4861-4c56-a7a7-4161f8b5bbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:22.473463 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360d57e-f448-42ea-a394-92e3bcd6bbf9 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:22.473543 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61559040-4861-4c56-a7a7-4161f8b5bbad admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:22.473543 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61559040-4861-4c56-a7a7-4161f8b5bbad admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:22.473543 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61559040-4861-4c56-a7a7-4161f8b5bbad admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:22.473543 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61559040-4861-4c56-a7a7-4161f8b5bbad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:22.473829 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61559040-4861-4c56-a7a7-4161f8b5bbad admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:22.483438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360d57e-f448-42ea-a394-92e3bcd6bbf9 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:22.488231 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0bee0-0984-470a-a915-8cda77315274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:22.489168 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0bee0-0984-470a-a915-8cda77315274 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:22.489447 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0bee0-0984-470a-a915-8cda77315274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:22.489724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0bee0-0984-470a-a915-8cda77315274 admin admin] PATH_INFO: `/v3/projects/f9aa36d294af47a5ad4519c4e7f2ea59/users/026de546e4f448b3b5258cafedf8bf78/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:22.494974 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 790/1572] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:20:22 2022] POST /identity/v3/users => generated 295 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:22.495769 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61559040-4861-4c56-a7a7-4161f8b5bbad admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:22.507088 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61559040-4861-4c56-a7a7-4161f8b5bbad admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:22.508417 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0bee0-0984-470a-a915-8cda77315274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9aa36d294af47a5ad4519c4e7f2ea59, user_id=026de546e4f448b3b5258cafedf8bf78, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:22.509639 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: WARNING py.warnings [None req-c0b0bee0-0984-470a-a915-8cda77315274 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:20:22.509639 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: warnings.warn(msg) Jun 29 12:20:22.509639 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: Jun 29 12:20:22.511709 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0bee0-0984-470a-a915-8cda77315274 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:22.512073 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb4e15-bb04-4372-9128-5672f02486d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:22.513039 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb4e15-bb04-4372-9128-5672f02486d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:22.513318 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb4e15-bb04-4372-9128-5672f02486d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:22.513593 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb4e15-bb04-4372-9128-5672f02486d8 admin admin] PATH_INFO: `/v3/projects/41fc31c54d6747588064e8585e68df9e/users/6fb208908c78467f8495350e6446d379/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:22.526990 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 783/1573] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:20:22 2022] PUT /identity/v3/projects/f9aa36d294af47a5ad4519c4e7f2ea59/users/026de546e4f448b3b5258cafedf8bf78/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:22.528004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0bee0-0984-470a-a915-8cda77315274 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:22.532751 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb4e15-bb04-4372-9128-5672f02486d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41fc31c54d6747588064e8585e68df9e, user_id=6fb208908c78467f8495350e6446d379, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:22.535518 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb4e15-bb04-4372-9128-5672f02486d8 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:22.549667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 791/1574] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:20:22 2022] PUT /identity/v3/projects/41fc31c54d6747588064e8585e68df9e/users/6fb208908c78467f8495350e6446d379/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:22.550460 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb4e15-bb04-4372-9128-5672f02486d8 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:22.601075 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0bee0-0984-470a-a915-8cda77315274 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:22.620280 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb4e15-bb04-4372-9128-5672f02486d8 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:22.625189 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c9ebf-61ff-4388-9230-6cfe2ff6d9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:22.625857 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c9ebf-61ff-4388-9230-6cfe2ff6d9cf admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:22.626136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c9ebf-61ff-4388-9230-6cfe2ff6d9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:22.626411 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c9ebf-61ff-4388-9230-6cfe2ff6d9cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:22.627136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c9ebf-61ff-4388-9230-6cfe2ff6d9cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:22.629075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c9ebf-61ff-4388-9230-6cfe2ff6d9cf admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:22.659014 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 792/1575] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:20:22 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:22.659014 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c9ebf-61ff-4388-9230-6cfe2ff6d9cf admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:22.663893 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74f032-cef1-44ce-a6fb-3cd5d0f599cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:22.664511 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74f032-cef1-44ce-a6fb-3cd5d0f599cd admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:22.664800 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74f032-cef1-44ce-a6fb-3cd5d0f599cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:22.665075 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74f032-cef1-44ce-a6fb-3cd5d0f599cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:22.666358 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74f032-cef1-44ce-a6fb-3cd5d0f599cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:22.668333 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74f032-cef1-44ce-a6fb-3cd5d0f599cd admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:22.696095 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 784/1576] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:20:22 2022] POST /identity/v3/projects => generated 405 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:22.699632 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74f032-cef1-44ce-a6fb-3cd5d0f599cd admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:22.707804 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:22.718902 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:22.728315 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c9ebf-61ff-4388-9230-6cfe2ff6d9cf admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:22.767781 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74f032-cef1-44ce-a6fb-3cd5d0f599cd admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:22.772668 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220549e-a2ab-4185-b315-8a058dd2400d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:22.773333 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220549e-a2ab-4185-b315-8a058dd2400d admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:22.773622 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220549e-a2ab-4185-b315-8a058dd2400d admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:22.773895 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220549e-a2ab-4185-b315-8a058dd2400d admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:22.774716 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0220549e-a2ab-4185-b315-8a058dd2400d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:22.776643 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0220549e-a2ab-4185-b315-8a058dd2400d admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:22.786703 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111762c-dfd9-40e4-b525-1c07f9e38f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:22.787365 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111762c-dfd9-40e4-b525-1c07f9e38f8e admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:22.787647 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111762c-dfd9-40e4-b525-1c07f9e38f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:22.787917 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111762c-dfd9-40e4-b525-1c07f9e38f8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:22.788628 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c111762c-dfd9-40e4-b525-1c07f9e38f8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:20:22.788932 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c111762c-dfd9-40e4-b525-1c07f9e38f8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:22.791147 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c111762c-dfd9-40e4-b525-1c07f9e38f8e admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:22.803749 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 793/1577] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:20:22.804560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111762c-dfd9-40e4-b525-1c07f9e38f8e admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:22.811769 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 785/1578] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:20:22 2022] POST /identity/v3/projects => generated 369 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:22.812706 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220549e-a2ab-4185-b315-8a058dd2400d admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:22.814666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111762c-dfd9-40e4-b525-1c07f9e38f8e admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:22.871676 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f18d6-c8ac-4e22-8e33-dcd68a22f217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:22.872261 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f18d6-c8ac-4e22-8e33-dcd68a22f217 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:22.872684 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f18d6-c8ac-4e22-8e33-dcd68a22f217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:22.872964 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f18d6-c8ac-4e22-8e33-dcd68a22f217 admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:22.873679 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f18d6-c8ac-4e22-8e33-dcd68a22f217 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:22.875759 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f18d6-c8ac-4e22-8e33-dcd68a22f217 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:22.876146 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220549e-a2ab-4185-b315-8a058dd2400d admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:22.881195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b67d0-37b0-4050-8f85-400a115dd83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:22.881868 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b67d0-37b0-4050-8f85-400a115dd83a admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:22.882185 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b67d0-37b0-4050-8f85-400a115dd83a admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:22.882464 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b67d0-37b0-4050-8f85-400a115dd83a admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:22.883226 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b67d0-37b0-4050-8f85-400a115dd83a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:22.884824 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b67d0-37b0-4050-8f85-400a115dd83a admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:22.894802 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 786/1579] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:22.896059 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd39b73-b8a7-459f-9cf5-f6ddffa4fa53 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:22.896342 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd39b73-b8a7-459f-9cf5-f6ddffa4fa53 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:22.896626 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd39b73-b8a7-459f-9cf5-f6ddffa4fa53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:22.905725 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 794/1580] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:20:22 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:22.907394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cf018-4131-40b8-983e-3a07df87bf34 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:22.907683 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cf018-4131-40b8-983e-3a07df87bf34 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:22.907960 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cf018-4131-40b8-983e-3a07df87bf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:22.914560 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-2dd39b73-b8a7-459f-9cf5-f6ddffa4fa53 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:22.916593 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-2dd39b73-b8a7-459f-9cf5-f6ddffa4fa53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:22.934494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-c32cf018-4131-40b8-983e-3a07df87bf34 None None] MFA Rules not processed for user `6fb208908c78467f8495350e6446d379`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:22.935722 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-c32cf018-4131-40b8-983e-3a07df87bf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:22.976630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 787/1581] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:22.977638 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd39b73-b8a7-459f-9cf5-f6ddffa4fa53 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:22.988585 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd39b73-b8a7-459f-9cf5-f6ddffa4fa53 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:22.993272 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094a6ff-1a46-42c7-9e21-9804687a7e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:22.993942 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094a6ff-1a46-42c7-9e21-9804687a7e32 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:22.994226 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094a6ff-1a46-42c7-9e21-9804687a7e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:22.994507 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094a6ff-1a46-42c7-9e21-9804687a7e32 admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:22.995231 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094a6ff-1a46-42c7-9e21-9804687a7e32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:22.997177 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094a6ff-1a46-42c7-9e21-9804687a7e32 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:22.999361 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:23.007025 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 795/1582] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:23.007863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cf018-4131-40b8-983e-3a07df87bf34 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:23.019031 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cf018-4131-40b8-983e-3a07df87bf34 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:23.024247 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 788/1583] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:20:22 2022] POST /identity/v3/users => generated 290 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:23.024247 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094a6ff-1a46-42c7-9e21-9804687a7e32 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:23.025554 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186cd80-29a0-4a4b-a15e-2f9e3892f8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:23.025554 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186cd80-29a0-4a4b-a15e-2f9e3892f8cd admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:23.025872 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186cd80-29a0-4a4b-a15e-2f9e3892f8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:23.025872 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186cd80-29a0-4a4b-a15e-2f9e3892f8cd admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:23.026663 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e186cd80-29a0-4a4b-a15e-2f9e3892f8cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:23.028694 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e186cd80-29a0-4a4b-a15e-2f9e3892f8cd admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:23.037877 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094a6ff-1a46-42c7-9e21-9804687a7e32 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:23.044309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fd2f6-87b8-4afc-86b7-0745f4190345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:23.045296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fd2f6-87b8-4afc-86b7-0745f4190345 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:23.045448 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fd2f6-87b8-4afc-86b7-0745f4190345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:23.045741 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fd2f6-87b8-4afc-86b7-0745f4190345 admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:23.047020 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644fd2f6-87b8-4afc-86b7-0745f4190345 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:23.049735 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644fd2f6-87b8-4afc-86b7-0745f4190345 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:23.052286 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 796/1584] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:20:23 2022] POST /identity/v3/users => generated 303 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:23.053030 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186cd80-29a0-4a4b-a15e-2f9e3892f8cd admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:23.065242 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186cd80-29a0-4a4b-a15e-2f9e3892f8cd admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:23.070220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:23.070490 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69734f-8c92-45d5-a469-d490cb8d3bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:23.071307 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69734f-8c92-45d5-a469-d490cb8d3bae admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:23.071781 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69734f-8c92-45d5-a469-d490cb8d3bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:23.072118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69734f-8c92-45d5-a469-d490cb8d3bae admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:23.072815 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69734f-8c92-45d5-a469-d490cb8d3bae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:23.074858 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69734f-8c92-45d5-a469-d490cb8d3bae admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:23.079733 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 789/1585] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:20:23 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:23.080544 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fd2f6-87b8-4afc-86b7-0745f4190345 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:23.098365 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 797/1586] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:20:23 2022] POST /identity/v3/users => generated 285 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:23.098365 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69734f-8c92-45d5-a469-d490cb8d3bae admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:23.107893 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69734f-8c92-45d5-a469-d490cb8d3bae admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:23.150805 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fd2f6-87b8-4afc-86b7-0745f4190345 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:23.155954 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43607add-7503-48b6-a290-35d875ea1e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:23.156631 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43607add-7503-48b6-a290-35d875ea1e37 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:23.156938 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43607add-7503-48b6-a290-35d875ea1e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:23.157220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43607add-7503-48b6-a290-35d875ea1e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:23.157948 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43607add-7503-48b6-a290-35d875ea1e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:23.159590 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43607add-7503-48b6-a290-35d875ea1e37 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:23.166356 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f35eac-3518-47e7-a6d7-401ca4bd7bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:23.167036 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f35eac-3518-47e7-a6d7-401ca4bd7bea admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:23.167319 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f35eac-3518-47e7-a6d7-401ca4bd7bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:23.167604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f35eac-3518-47e7-a6d7-401ca4bd7bea admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:23.168278 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f35eac-3518-47e7-a6d7-401ca4bd7bea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:23.170228 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f35eac-3518-47e7-a6d7-401ca4bd7bea admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:23.173713 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 790/1587] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:23.173713 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43607add-7503-48b6-a290-35d875ea1e37 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:23.192907 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 798/1588] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:20:23 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:23.192907 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f35eac-3518-47e7-a6d7-401ca4bd7bea admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:23.200986 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f35eac-3518-47e7-a6d7-401ca4bd7bea admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:23.205610 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c20f1d-fe3d-4a32-8c6f-c5629f47c9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:23.206251 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c20f1d-fe3d-4a32-8c6f-c5629f47c9cd admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:23.206536 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c20f1d-fe3d-4a32-8c6f-c5629f47c9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:23.206841 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c20f1d-fe3d-4a32-8c6f-c5629f47c9cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:23.207560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c20f1d-fe3d-4a32-8c6f-c5629f47c9cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:23.209181 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c20f1d-fe3d-4a32-8c6f-c5629f47c9cd admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:23.219035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 799/1589] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:23.220267 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53980c-b1d6-476c-a6b4-2ae564fd1160 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:23.220554 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53980c-b1d6-476c-a6b4-2ae564fd1160 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:23.220835 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53980c-b1d6-476c-a6b4-2ae564fd1160 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:23.222068 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 800/1590] 10.222.0.13 () {54 vars in 961 bytes} [Wed Jun 29 12:20:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:20:23.222800 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53980c-b1d6-476c-a6b4-2ae564fd1160 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:23.235016 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53980c-b1d6-476c-a6b4-2ae564fd1160 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:23.236700 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43607add-7503-48b6-a290-35d875ea1e37 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:23.239474 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3e528-7e5f-4336-9053-2eaab2ed1d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:23.240091 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3e528-7e5f-4336-9053-2eaab2ed1d25 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:23.240274 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48e436-a870-4176-a851-009c752cc937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:23.240409 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3e528-7e5f-4336-9053-2eaab2ed1d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:23.240643 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3e528-7e5f-4336-9053-2eaab2ed1d25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:23.240915 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48e436-a870-4176-a851-009c752cc937 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:23.241192 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48e436-a870-4176-a851-009c752cc937 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:23.241351 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d3e528-7e5f-4336-9053-2eaab2ed1d25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:23.241448 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48e436-a870-4176-a851-009c752cc937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:23.242965 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d3e528-7e5f-4336-9053-2eaab2ed1d25 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:23.251369 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a48e436-a870-4176-a851-009c752cc937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:23.252796 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a48e436-a870-4176-a851-009c752cc937 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:23.253866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 801/1591] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:23.254620 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3e528-7e5f-4336-9053-2eaab2ed1d25 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:23.263560 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 791/1592] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:20:23.264379 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48e436-a870-4176-a851-009c752cc937 service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:23.264570 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3e528-7e5f-4336-9053-2eaab2ed1d25 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:23.269044 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d9a16-33c6-4dc8-9aef-3ea08cc16c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:23.269703 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d9a16-33c6-4dc8-9aef-3ea08cc16c9f admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:23.269978 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d9a16-33c6-4dc8-9aef-3ea08cc16c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:23.270253 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d9a16-33c6-4dc8-9aef-3ea08cc16c9f admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:23.270952 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d9a16-33c6-4dc8-9aef-3ea08cc16c9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:23.272860 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d9a16-33c6-4dc8-9aef-3ea08cc16c9f admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:23.274115 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48e436-a870-4176-a851-009c752cc937 service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:23.280684 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6b2d5-8171-4645-886b-581faa325925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:23.282291 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6b2d5-8171-4645-886b-581faa325925 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:23.282701 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6b2d5-8171-4645-886b-581faa325925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:23.284394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6b2d5-8171-4645-886b-581faa325925 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:23.284724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f6b2d5-8171-4645-886b-581faa325925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:23.286752 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f6b2d5-8171-4645-886b-581faa325925 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:23.296107 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 802/1593] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:20:23 2022] POST /identity/v3/users => generated 291 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:23.296784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d9a16-33c6-4dc8-9aef-3ea08cc16c9f admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:23.302265 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 792/1594] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:23.303224 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6b2d5-8171-4645-886b-581faa325925 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:23.310258 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d9a16-33c6-4dc8-9aef-3ea08cc16c9f admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:23.313217 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6b2d5-8171-4645-886b-581faa325925 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:23.314961 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6fec8-08fb-4d6a-b43d-a5889d254815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:23.315859 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6fec8-08fb-4d6a-b43d-a5889d254815 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:23.316398 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6fec8-08fb-4d6a-b43d-a5889d254815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:23.316398 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6fec8-08fb-4d6a-b43d-a5889d254815 admin admin] PATH_INFO: `/v3/projects/6846438ca78f4340864eb0e40a0c0858/users/00a1e1a5b2044f2bb37bb4bd52f3afb9/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:23.318319 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae28c2-3ca8-43d7-be61-cd14b53f5db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:23.319092 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae28c2-3ca8-43d7-be61-cd14b53f5db9 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:23.319378 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae28c2-3ca8-43d7-be61-cd14b53f5db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:23.319658 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae28c2-3ca8-43d7-be61-cd14b53f5db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:23.320381 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae28c2-3ca8-43d7-be61-cd14b53f5db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:23.322489 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae28c2-3ca8-43d7-be61-cd14b53f5db9 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:23.333617 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 793/1595] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:23.334493 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae28c2-3ca8-43d7-be61-cd14b53f5db9 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:23.335213 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb6fec8-08fb-4d6a-b43d-a5889d254815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6846438ca78f4340864eb0e40a0c0858, user_id=00a1e1a5b2044f2bb37bb4bd52f3afb9, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:23.339281 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb6fec8-08fb-4d6a-b43d-a5889d254815 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:23.346096 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae28c2-3ca8-43d7-be61-cd14b53f5db9 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:23.350908 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514231d-dd23-41e7-b401-40833845b74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:23.351576 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514231d-dd23-41e7-b401-40833845b74a admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:23.351864 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514231d-dd23-41e7-b401-40833845b74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:23.352164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514231d-dd23-41e7-b401-40833845b74a admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:23.352913 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1514231d-dd23-41e7-b401-40833845b74a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:23.354604 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1514231d-dd23-41e7-b401-40833845b74a admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:23.354820 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 803/1596] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:20:23 2022] PUT /identity/v3/projects/6846438ca78f4340864eb0e40a0c0858/users/00a1e1a5b2044f2bb37bb4bd52f3afb9/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:23.360305 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4579c-7c8b-4e66-871f-adc5ff11ce88 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:23.360711 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4579c-7c8b-4e66-871f-adc5ff11ce88 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:23.361111 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4579c-7c8b-4e66-871f-adc5ff11ce88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:23.366911 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 794/1597] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:23.368215 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514231d-dd23-41e7-b401-40833845b74a admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:23.380705 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514231d-dd23-41e7-b401-40833845b74a admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:23.385130 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-5aa4579c-7c8b-4e66-871f-adc5ff11ce88 None None] MFA Rules not processed for user `3fbcf547421b42e4b520f9246326bff8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:23.386345 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-5aa4579c-7c8b-4e66-871f-adc5ff11ce88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:23.436987 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:23.447541 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e8316-654f-4185-a473-7fec1f1a6922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:23.448422 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e8316-654f-4185-a473-7fec1f1a6922 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:23.448768 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e8316-654f-4185-a473-7fec1f1a6922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:23.449265 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e8316-654f-4185-a473-7fec1f1a6922 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:23.449995 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e8316-654f-4185-a473-7fec1f1a6922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:23.451657 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e8316-654f-4185-a473-7fec1f1a6922 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:23.457701 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:23.464551 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 795/1598] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:23.465430 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e8316-654f-4185-a473-7fec1f1a6922 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:23.468848 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 804/1599] 10.222.0.13 () {58 vars in 1058 bytes} [Wed Jun 29 12:20:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:23.469641 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4579c-7c8b-4e66-871f-adc5ff11ce88 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:23.481455 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4579c-7c8b-4e66-871f-adc5ff11ce88 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:23.483421 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e8316-654f-4185-a473-7fec1f1a6922 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:23.487500 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239f5af-cb8a-44da-94ee-1b66ea5f86c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:23.491057 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239f5af-cb8a-44da-94ee-1b66ea5f86c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:23.491057 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239f5af-cb8a-44da-94ee-1b66ea5f86c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:23.491057 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239f5af-cb8a-44da-94ee-1b66ea5f86c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:23.491057 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c239f5af-cb8a-44da-94ee-1b66ea5f86c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:23.491382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c239f5af-cb8a-44da-94ee-1b66ea5f86c5 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:23.493886 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e452a67-8018-4067-9bbc-2744c1c4fa47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:23.494567 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e452a67-8018-4067-9bbc-2744c1c4fa47 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:23.494874 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e452a67-8018-4067-9bbc-2744c1c4fa47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:23.495151 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e452a67-8018-4067-9bbc-2744c1c4fa47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:23.495876 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e452a67-8018-4067-9bbc-2744c1c4fa47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:23.497473 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e452a67-8018-4067-9bbc-2744c1c4fa47 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:23.508680 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 796/1600] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:23.510180 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e452a67-8018-4067-9bbc-2744c1c4fa47 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:23.512864 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 805/1601] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:23.514415 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b79705-8210-4f14-a5bd-6a7c08855f53 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:23.514879 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b79705-8210-4f14-a5bd-6a7c08855f53 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:23.515315 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b79705-8210-4f14-a5bd-6a7c08855f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:23.521263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e452a67-8018-4067-9bbc-2744c1c4fa47 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:23.527159 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15022c1-d808-4aef-9b35-a1df249302a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:23.527844 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15022c1-d808-4aef-9b35-a1df249302a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:23.528130 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15022c1-d808-4aef-9b35-a1df249302a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:23.528408 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15022c1-d808-4aef-9b35-a1df249302a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:23.529138 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15022c1-d808-4aef-9b35-a1df249302a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:23.531054 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15022c1-d808-4aef-9b35-a1df249302a8 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:23.539212 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-97b79705-8210-4f14-a5bd-6a7c08855f53 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:23.539955 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-97b79705-8210-4f14-a5bd-6a7c08855f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:23.542247 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 797/1602] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:23.545452 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15022c1-d808-4aef-9b35-a1df249302a8 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:23.552870 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 806/1603] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:23.553619 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b79705-8210-4f14-a5bd-6a7c08855f53 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:23.557386 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15022c1-d808-4aef-9b35-a1df249302a8 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:23.563961 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc4957-a2be-4bf6-ad6c-30ba823b61c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:23.565216 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc4957-a2be-4bf6-ad6c-30ba823b61c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:23.565728 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc4957-a2be-4bf6-ad6c-30ba823b61c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:23.566202 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc4957-a2be-4bf6-ad6c-30ba823b61c3 admin admin] PATH_INFO: `/v3/projects/92e4aeb775da4e0399886af39bce2eb7/users/c2c4a742ff244e298bdcdbc0c9ae5e48/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:23.569593 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b79705-8210-4f14-a5bd-6a7c08855f53 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:23.575924 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3f415-d485-4698-9f2c-6ba04c37ced6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:23.576928 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3f415-d485-4698-9f2c-6ba04c37ced6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:23.577214 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3f415-d485-4698-9f2c-6ba04c37ced6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:23.577489 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3f415-d485-4698-9f2c-6ba04c37ced6 admin admin] PATH_INFO: `/v3/projects/a2fa0da843464f9296f331a8b31d5c92/users/b002507260cb4939a8d140104d75d62d/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:23.583564 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc4957-a2be-4bf6-ad6c-30ba823b61c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92e4aeb775da4e0399886af39bce2eb7, user_id=c2c4a742ff244e298bdcdbc0c9ae5e48, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:23.586264 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc4957-a2be-4bf6-ad6c-30ba823b61c3 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:23.596050 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3f415-d485-4698-9f2c-6ba04c37ced6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2fa0da843464f9296f331a8b31d5c92, user_id=b002507260cb4939a8d140104d75d62d, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:23.599367 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3f415-d485-4698-9f2c-6ba04c37ced6 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:23.605455 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 798/1604] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:20:23 2022] PUT /identity/v3/projects/92e4aeb775da4e0399886af39bce2eb7/users/c2c4a742ff244e298bdcdbc0c9ae5e48/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:23.605455 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc4957-a2be-4bf6-ad6c-30ba823b61c3 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:23.620110 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 807/1605] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:20:23 2022] PUT /identity/v3/projects/a2fa0da843464f9296f331a8b31d5c92/users/b002507260cb4939a8d140104d75d62d/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:23.621044 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3f415-d485-4698-9f2c-6ba04c37ced6 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:23.686695 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3f415-d485-4698-9f2c-6ba04c37ced6 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:23.693422 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53837c-5ee8-40ff-b773-5fddfbe4ccfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:23.694572 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53837c-5ee8-40ff-b773-5fddfbe4ccfe admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:23.694914 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53837c-5ee8-40ff-b773-5fddfbe4ccfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:23.695214 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53837c-5ee8-40ff-b773-5fddfbe4ccfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:23.696051 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f53837c-5ee8-40ff-b773-5fddfbe4ccfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:23.698357 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f53837c-5ee8-40ff-b773-5fddfbe4ccfe admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:23.709273 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 808/1606] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:23.710189 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53837c-5ee8-40ff-b773-5fddfbe4ccfe admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:23.721627 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53837c-5ee8-40ff-b773-5fddfbe4ccfe admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:23.726958 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a734a2-8bd4-4962-ae4c-ce55b260be02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:23.729407 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a734a2-8bd4-4962-ae4c-ce55b260be02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:23.729913 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a734a2-8bd4-4962-ae4c-ce55b260be02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:23.730412 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a734a2-8bd4-4962-ae4c-ce55b260be02 admin admin] PATH_INFO: `/v3/projects/ee3a1950c9744172af7a2a2b41f64129/users/4b5d786e9d724129895f4299bd88fbcb/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:23.733038 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc4957-a2be-4bf6-ad6c-30ba823b61c3 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:23.749909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a734a2-8bd4-4962-ae4c-ce55b260be02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee3a1950c9744172af7a2a2b41f64129, user_id=4b5d786e9d724129895f4299bd88fbcb, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:23.753374 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a734a2-8bd4-4962-ae4c-ce55b260be02 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:23.769599 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 809/1607] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:20:23 2022] PUT /identity/v3/projects/ee3a1950c9744172af7a2a2b41f64129/users/4b5d786e9d724129895f4299bd88fbcb/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:23.771423 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a734a2-8bd4-4962-ae4c-ce55b260be02 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:23.812726 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca5984-0215-4766-9d54-4529115e8001 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:23.813449 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca5984-0215-4766-9d54-4529115e8001 service nova] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:23.813746 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca5984-0215-4766-9d54-4529115e8001 service nova] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:23.814015 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca5984-0215-4766-9d54-4529115e8001 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:23.856244 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a734a2-8bd4-4962-ae4c-ce55b260be02 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:23.861755 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e82b8-c7b0-40f5-9840-f950c447a28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:23.863174 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e82b8-c7b0-40f5-9840-f950c447a28c admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:23.863512 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e82b8-c7b0-40f5-9840-f950c447a28c admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:23.863790 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e82b8-c7b0-40f5-9840-f950c447a28c admin admin] PATH_INFO: `/v3/projects/04e5e8f4ea8642e69eddf80a399ed495/users/b84d13faf25d4eef9268435491fe865c/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:23.865410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:23.881004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca5984-0215-4766-9d54-4529115e8001 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:23.882766 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca5984-0215-4766-9d54-4529115e8001 service nova] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:23.886336 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e82b8-c7b0-40f5-9840-f950c447a28c admin admin] RBAC: Authorizing `identity:create_grant(project_id=04e5e8f4ea8642e69eddf80a399ed495, user_id=b84d13faf25d4eef9268435491fe865c, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:23.889116 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e82b8-c7b0-40f5-9840-f950c447a28c admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:23.891420 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:23.892700 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 799/1608] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:20:23.893370 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca5984-0215-4766-9d54-4529115e8001 service nova] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:23.918748 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 810/1609] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:20:23 2022] PUT /identity/v3/projects/04e5e8f4ea8642e69eddf80a399ed495/users/b84d13faf25d4eef9268435491fe865c/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:23.920300 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc37d9-06b2-4b0b-8bd7-a3710f3fc572 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:23.920644 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc37d9-06b2-4b0b-8bd7-a3710f3fc572 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:23.920872 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc37d9-06b2-4b0b-8bd7-a3710f3fc572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:23.968653 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-fedc37d9-06b2-4b0b-8bd7-a3710f3fc572 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:23.969895 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-fedc37d9-06b2-4b0b-8bd7-a3710f3fc572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:23.985572 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca5984-0215-4766-9d54-4529115e8001 service nova] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:24.063051 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 811/1610] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:24.063219 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77554ee-428a-460b-9189-417bce065997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:24.063219 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77554ee-428a-460b-9189-417bce065997 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:24.063219 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77554ee-428a-460b-9189-417bce065997 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:24.063219 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77554ee-428a-460b-9189-417bce065997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:24.063859 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bbfb9-87da-4637-9005-c910eeca60e0 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:24.063859 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bbfb9-87da-4637-9005-c910eeca60e0 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:24.063859 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bbfb9-87da-4637-9005-c910eeca60e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:24.084228 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-516bbfb9-87da-4637-9005-c910eeca60e0 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:24.085583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-516bbfb9-87da-4637-9005-c910eeca60e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:24.097254 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 812/1611] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:24.097426 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77554ee-428a-460b-9189-417bce065997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:24.098182 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bbfb9-87da-4637-9005-c910eeca60e0 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:24.099245 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77554ee-428a-460b-9189-417bce065997 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:24.109604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bbfb9-87da-4637-9005-c910eeca60e0 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:24.115668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10210110-b2db-4ff3-a7a0-a6708667f882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:24.116694 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10210110-b2db-4ff3-a7a0-a6708667f882 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:24.117044 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10210110-b2db-4ff3-a7a0-a6708667f882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:24.117462 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10210110-b2db-4ff3-a7a0-a6708667f882 admin admin] PATH_INFO: `/v3/projects/f9c6158c6a7d496b9352cf5ed1c9eca9/users/1b8578f2daae405a8116d042208dcdef/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:24.128739 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 800/1612] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:20:24.130299 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ba28e-b303-499b-9324-fbab833c9cc5 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:24.130597 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ba28e-b303-499b-9324-fbab833c9cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:24.130900 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ba28e-b303-499b-9324-fbab833c9cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:24.138953 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10210110-b2db-4ff3-a7a0-a6708667f882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c6158c6a7d496b9352cf5ed1c9eca9, user_id=1b8578f2daae405a8116d042208dcdef, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:24.142090 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10210110-b2db-4ff3-a7a0-a6708667f882 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:24.166510 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 813/1613] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:20:24 2022] PUT /identity/v3/projects/f9c6158c6a7d496b9352cf5ed1c9eca9/users/1b8578f2daae405a8116d042208dcdef/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:24.170287 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d1834-0fab-4d19-b0fa-ac8cef05316a None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:24.170858 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d1834-0fab-4d19-b0fa-ac8cef05316a None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:24.171148 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d1834-0fab-4d19-b0fa-ac8cef05316a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:24.200145 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-401ba28e-b303-499b-9324-fbab833c9cc5 None None] MFA Rules not processed for user `4b5d786e9d724129895f4299bd88fbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:24.206845 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-401ba28e-b303-499b-9324-fbab833c9cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:24.240205 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-cd4d1834-0fab-4d19-b0fa-ac8cef05316a None None] MFA Rules not processed for user `b84d13faf25d4eef9268435491fe865c`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:24.244986 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-cd4d1834-0fab-4d19-b0fa-ac8cef05316a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:24.338469 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 801/1614] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:24 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:24.339371 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ba28e-b303-499b-9324-fbab833c9cc5 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:24.365201 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 814/1615] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:24.366158 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d1834-0fab-4d19-b0fa-ac8cef05316a None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:24.405072 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:24.429892 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ba28e-b303-499b-9324-fbab833c9cc5 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:24.436832 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a6d11d-58d5-4a6c-9e73-6c5eed7dac4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:24.437485 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6d11d-58d5-4a6c-9e73-6c5eed7dac4a service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:24.438347 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6d11d-58d5-4a6c-9e73-6c5eed7dac4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:24.438489 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6d11d-58d5-4a6c-9e73-6c5eed7dac4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:24.463586 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d1834-0fab-4d19-b0fa-ac8cef05316a None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:24.469898 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c550dd7-2dd4-4679-8a89-1f87a00dc2be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:24.470866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c550dd7-2dd4-4679-8a89-1f87a00dc2be service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:24.471310 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c550dd7-2dd4-4679-8a89-1f87a00dc2be service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:24.471634 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c550dd7-2dd4-4679-8a89-1f87a00dc2be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:24.480100 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:24.518088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a6d11d-58d5-4a6c-9e73-6c5eed7dac4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:24.520568 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a6d11d-58d5-4a6c-9e73-6c5eed7dac4a service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:24.533403 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 802/1616] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:20:24.535013 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d19bf-73ea-4e83-9f26-d1c9448de969 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:24.535514 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d19bf-73ea-4e83-9f26-d1c9448de969 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:24.536166 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d19bf-73ea-4e83-9f26-d1c9448de969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:24.586629 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-457d19bf-73ea-4e83-9f26-d1c9448de969 None None] MFA Rules not processed for user `1b8578f2daae405a8116d042208dcdef`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:24.590226 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-457d19bf-73ea-4e83-9f26-d1c9448de969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:24.604604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c550dd7-2dd4-4679-8a89-1f87a00dc2be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:24.606554 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c550dd7-2dd4-4679-8a89-1f87a00dc2be service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:24.621231 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 815/1617] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:20:24.623216 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d2e4c-0a07-443b-9fbf-844bcba16747 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:24.623665 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d2e4c-0a07-443b-9fbf-844bcba16747 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:24.624352 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d2e4c-0a07-443b-9fbf-844bcba16747 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:24.626574 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 816/1618] 10.222.0.13 () {54 vars in 912 bytes} [Wed Jun 29 12:20:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:20:24.628533 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d2e4c-0a07-443b-9fbf-844bcba16747 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:24.645941 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d2e4c-0a07-443b-9fbf-844bcba16747 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:24.651802 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943d869-43ab-4046-8eb3-d4ec5a73ea10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:24.653416 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943d869-43ab-4046-8eb3-d4ec5a73ea10 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:24.653873 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943d869-43ab-4046-8eb3-d4ec5a73ea10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:24.654700 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943d869-43ab-4046-8eb3-d4ec5a73ea10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:24.656326 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943d869-43ab-4046-8eb3-d4ec5a73ea10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:24.659510 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943d869-43ab-4046-8eb3-d4ec5a73ea10 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:24.703607 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 817/1619] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:20:24 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:24.703607 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bcbdf-9565-430e-84a9-983faeda90ad None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:24.703607 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bcbdf-9565-430e-84a9-983faeda90ad None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:24.703607 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bcbdf-9565-430e-84a9-983faeda90ad None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:24.705734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 818/1620] 10.222.0.13 () {54 vars in 961 bytes} [Wed Jun 29 12:20:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:20:24.707366 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17373b7-ab02-46b6-b7f8-617446a885fb None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:24.708211 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17373b7-ab02-46b6-b7f8-617446a885fb None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:24.708545 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17373b7-ab02-46b6-b7f8-617446a885fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:24.733308 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 803/1621] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:24.733308 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d19bf-73ea-4e83-9f26-d1c9448de969 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:24.736740 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-e17373b7-ab02-46b6-b7f8-617446a885fb None None] MFA Rules not processed for user `3fbcf547421b42e4b520f9246326bff8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:24.738834 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-e17373b7-ab02-46b6-b7f8-617446a885fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:24.758620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d19bf-73ea-4e83-9f26-d1c9448de969 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:24.843749 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 819/1622] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Jun 29 12:20:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:24.845709 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d048742-531c-4c8b-a98a-7eaf949f9232 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:24.846005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d048742-531c-4c8b-a98a-7eaf949f9232 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:24.846289 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d048742-531c-4c8b-a98a-7eaf949f9232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:24.885984 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-5d048742-531c-4c8b-a98a-7eaf949f9232 None None] MFA Rules not processed for user `3fbcf547421b42e4b520f9246326bff8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:24.887929 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-5d048742-531c-4c8b-a98a-7eaf949f9232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:24.900847 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 820/1623] 10.222.0.13 () {58 vars in 1058 bytes} [Wed Jun 29 12:20:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:24.902515 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d048742-531c-4c8b-a98a-7eaf949f9232 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:24.948807 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06b055-2a04-4f67-a263-6adc56b4ca77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:24.950544 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06b055-2a04-4f67-a263-6adc56b4ca77 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:24.950898 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06b055-2a04-4f67-a263-6adc56b4ca77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:24.952700 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06b055-2a04-4f67-a263-6adc56b4ca77 admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:24.953435 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06b055-2a04-4f67-a263-6adc56b4ca77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:24.968760 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06b055-2a04-4f67-a263-6adc56b4ca77 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:25.025116 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 804/1624] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:20:24 2022] POST /identity/v3/users => generated 293 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:25.033344 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06b055-2a04-4f67-a263-6adc56b4ca77 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:25.052854 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:25.099601 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d048742-531c-4c8b-a98a-7eaf949f9232 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:25.107520 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2d4f8-5d28-4db5-b6d5-bab85a78d450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:25.108328 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2d4f8-5d28-4db5-b6d5-bab85a78d450 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:25.108619 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2d4f8-5d28-4db5-b6d5-bab85a78d450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:25.108895 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2d4f8-5d28-4db5-b6d5-bab85a78d450 admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:25.110566 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2d4f8-5d28-4db5-b6d5-bab85a78d450 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:25.114506 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2d4f8-5d28-4db5-b6d5-bab85a78d450 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:25.132740 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06b055-2a04-4f67-a263-6adc56b4ca77 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:25.137984 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e5680-5362-460f-91b2-18dca97ebe23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:25.138621 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e5680-5362-460f-91b2-18dca97ebe23 service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:25.138967 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e5680-5362-460f-91b2-18dca97ebe23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:25.139389 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e5680-5362-460f-91b2-18dca97ebe23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:25.139811 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:25.176485 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e5680-5362-460f-91b2-18dca97ebe23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:25.177841 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 821/1625] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:20:24 2022] POST /identity/v3/projects => generated 381 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:25.178732 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e5680-5362-460f-91b2-18dca97ebe23 service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:25.178862 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2d4f8-5d28-4db5-b6d5-bab85a78d450 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:25.206962 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 805/1626] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:20:25.219708 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e5680-5362-460f-91b2-18dca97ebe23 service cinder] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:25.250620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e5680-5362-460f-91b2-18dca97ebe23 service cinder] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:25.435815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372dae5-518f-48b1-9270-3624ff577952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:25.436496 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372dae5-518f-48b1-9270-3624ff577952 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:25.436782 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372dae5-518f-48b1-9270-3624ff577952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:25.437062 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372dae5-518f-48b1-9270-3624ff577952 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:25.437799 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372dae5-518f-48b1-9270-3624ff577952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:25.439462 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372dae5-518f-48b1-9270-3624ff577952 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:25.443658 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2d4f8-5d28-4db5-b6d5-bab85a78d450 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:25.451980 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 806/1627] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:25.457535 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372dae5-518f-48b1-9270-3624ff577952 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:25.461251 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4fde6-c02a-46e7-b9ca-ad361fadf0b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:25.464181 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4fde6-c02a-46e7-b9ca-ad361fadf0b6 service nova] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:25.466110 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4fde6-c02a-46e7-b9ca-ad361fadf0b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:25.466858 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4fde6-c02a-46e7-b9ca-ad361fadf0b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:25.470142 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372dae5-518f-48b1-9270-3624ff577952 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:25.477386 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d0bcf-a17c-415f-a91f-d15eb853981e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:25.478739 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d0bcf-a17c-415f-a91f-d15eb853981e admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:25.480518 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d0bcf-a17c-415f-a91f-d15eb853981e admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:25.480810 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d0bcf-a17c-415f-a91f-d15eb853981e admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:25.481577 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d0bcf-a17c-415f-a91f-d15eb853981e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:25.483606 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d0bcf-a17c-415f-a91f-d15eb853981e admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:25.532816 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 807/1628] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:20:25 2022] POST /identity/v3/users => generated 297 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:25.534650 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d0bcf-a17c-415f-a91f-d15eb853981e admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:25.555523 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d0bcf-a17c-415f-a91f-d15eb853981e admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:25.565468 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389f851-b88b-448b-9831-399ee6b7076d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:25.566475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389f851-b88b-448b-9831-399ee6b7076d admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:25.566839 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389f851-b88b-448b-9831-399ee6b7076d admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:25.567122 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389f851-b88b-448b-9831-399ee6b7076d admin admin] PATH_INFO: `/v3/projects/8379ffae441743b28f3390f8c262c25f/users/9d4639df79ea4aa1b074d40805672549/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:25.597560 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389f851-b88b-448b-9831-399ee6b7076d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8379ffae441743b28f3390f8c262c25f, user_id=9d4639df79ea4aa1b074d40805672549, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:25.600796 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389f851-b88b-448b-9831-399ee6b7076d admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:25.622038 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 808/1629] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:20:25 2022] PUT /identity/v3/projects/8379ffae441743b28f3390f8c262c25f/users/9d4639df79ea4aa1b074d40805672549/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:25.623171 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389f851-b88b-448b-9831-399ee6b7076d admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:25.626179 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c4fde6-c02a-46e7-b9ca-ad361fadf0b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:25.627868 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c4fde6-c02a-46e7-b9ca-ad361fadf0b6 service nova] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:25.640906 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 822/1630] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:20:25.643225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4fde6-c02a-46e7-b9ca-ad361fadf0b6 service nova] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:25.671780 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4fde6-c02a-46e7-b9ca-ad361fadf0b6 service nova] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:25.772815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389f851-b88b-448b-9831-399ee6b7076d admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:25.786993 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24853c48-8547-442c-8a4f-08261b8787b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:25.788715 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24853c48-8547-442c-8a4f-08261b8787b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:25.789327 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24853c48-8547-442c-8a4f-08261b8787b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:25.789847 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24853c48-8547-442c-8a4f-08261b8787b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:25.791466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24853c48-8547-442c-8a4f-08261b8787b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:25.793503 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24853c48-8547-442c-8a4f-08261b8787b9 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:25.808234 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:25.819816 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 809/1631] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:25.820889 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24853c48-8547-442c-8a4f-08261b8787b9 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:25.835707 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24853c48-8547-442c-8a4f-08261b8787b9 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:25.843267 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7e580-1777-4e7b-a4fc-d0e0073d1f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:25.844463 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7e580-1777-4e7b-a4fc-d0e0073d1f82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:25.844810 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7e580-1777-4e7b-a4fc-d0e0073d1f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:25.845161 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7e580-1777-4e7b-a4fc-d0e0073d1f82 admin admin] PATH_INFO: `/v3/projects/4c0d8d66ee5140b09be5e92976b85ecd/users/19cef9d8d2d9428198172d946dd73ec7/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:25.865589 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7e580-1777-4e7b-a4fc-d0e0073d1f82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c0d8d66ee5140b09be5e92976b85ecd, user_id=19cef9d8d2d9428198172d946dd73ec7, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:25.869091 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7e580-1777-4e7b-a4fc-d0e0073d1f82 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:25.872281 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26133b66-42b2-4c73-b033-ada2103d083e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:25.874243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26133b66-42b2-4c73-b033-ada2103d083e admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:25.875144 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26133b66-42b2-4c73-b033-ada2103d083e admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:25.877120 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26133b66-42b2-4c73-b033-ada2103d083e admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:25.878431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26133b66-42b2-4c73-b033-ada2103d083e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:25.883827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26133b66-42b2-4c73-b033-ada2103d083e admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:25.901357 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 810/1632] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:20:25 2022] PUT /identity/v3/projects/4c0d8d66ee5140b09be5e92976b85ecd/users/19cef9d8d2d9428198172d946dd73ec7/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:25.905737 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7e580-1777-4e7b-a4fc-d0e0073d1f82 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:25.919377 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 823/1633] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:25.919377 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26133b66-42b2-4c73-b033-ada2103d083e admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:25.944752 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26133b66-42b2-4c73-b033-ada2103d083e admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:26.030170 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:26.109412 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7e580-1777-4e7b-a4fc-d0e0073d1f82 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:26.124310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6573e92-0dcf-4e43-a045-bc6543518d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:26.127145 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6573e92-0dcf-4e43-a045-bc6543518d0d admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:26.127342 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6573e92-0dcf-4e43-a045-bc6543518d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:26.127722 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6573e92-0dcf-4e43-a045-bc6543518d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:26.130442 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dab881-153a-4bd3-a8e7-dcd20cb562f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:26.131159 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6573e92-0dcf-4e43-a045-bc6543518d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:26.131517 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dab881-153a-4bd3-a8e7-dcd20cb562f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:26.131865 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dab881-153a-4bd3-a8e7-dcd20cb562f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:26.132205 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dab881-153a-4bd3-a8e7-dcd20cb562f4 admin admin] PATH_INFO: `/v3/projects/8379ffae441743b28f3390f8c262c25f/users/9d4639df79ea4aa1b074d40805672549/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:26.134539 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6573e92-0dcf-4e43-a045-bc6543518d0d admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:26.135273 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dab881-153a-4bd3-a8e7-dcd20cb562f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8379ffae441743b28f3390f8c262c25f, user_id=9d4639df79ea4aa1b074d40805672549, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:26.138500 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dab881-153a-4bd3-a8e7-dcd20cb562f4 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:26.166196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 811/1634] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:26.167686 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 824/1635] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:20:25 2022] PUT /identity/v3/projects/8379ffae441743b28f3390f8c262c25f/users/9d4639df79ea4aa1b074d40805672549/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:26.170849 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6573e92-0dcf-4e43-a045-bc6543518d0d admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:26.178441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b6e31-2a84-466a-b74b-e645bf7462b6 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:26.178755 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b6e31-2a84-466a-b74b-e645bf7462b6 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:26.179042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b6e31-2a84-466a-b74b-e645bf7462b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:26.192752 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6573e92-0dcf-4e43-a045-bc6543518d0d admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:26.244375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-765b6e31-2a84-466a-b74b-e645bf7462b6 None None] MFA Rules not processed for user `9d4639df79ea4aa1b074d40805672549`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:26.245967 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-765b6e31-2a84-466a-b74b-e645bf7462b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:26.375212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a4d7b-bb63-4f1d-b60d-0e292086374a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:26.376135 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a4d7b-bb63-4f1d-b60d-0e292086374a admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:26.376418 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a4d7b-bb63-4f1d-b60d-0e292086374a admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:26.376694 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a4d7b-bb63-4f1d-b60d-0e292086374a admin admin] PATH_INFO: `/v3/projects/4c0d8d66ee5140b09be5e92976b85ecd/users/19cef9d8d2d9428198172d946dd73ec7/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:26.378776 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a4d7b-bb63-4f1d-b60d-0e292086374a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c0d8d66ee5140b09be5e92976b85ecd, user_id=19cef9d8d2d9428198172d946dd73ec7, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:26.384341 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a4d7b-bb63-4f1d-b60d-0e292086374a admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:26.448689 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 812/1636] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:20:26 2022] PUT /identity/v3/projects/4c0d8d66ee5140b09be5e92976b85ecd/users/19cef9d8d2d9428198172d946dd73ec7/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:26.453602 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb41b6a-0a5b-4092-9813-bd8eaec30859 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:26.453908 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb41b6a-0a5b-4092-9813-bd8eaec30859 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:26.454193 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb41b6a-0a5b-4092-9813-bd8eaec30859 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:26.455786 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 813/1637] 10.222.0.13 () {54 vars in 912 bytes} [Wed Jun 29 12:20:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:20:26.465583 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2120c-cbae-41f6-8559-ab10b986b276 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:26.465939 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2120c-cbae-41f6-8559-ab10b986b276 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:26.467375 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2120c-cbae-41f6-8559-ab10b986b276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:26.474458 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 825/1638] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:26.476927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1909730-0084-4832-9617-3ac18c1579fc None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:26.477320 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1909730-0084-4832-9617-3ac18c1579fc None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:26.477739 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1909730-0084-4832-9617-3ac18c1579fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:26.508427 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-f1909730-0084-4832-9617-3ac18c1579fc None None] MFA Rules not processed for user `3fbcf547421b42e4b520f9246326bff8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:26.510372 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-f1909730-0084-4832-9617-3ac18c1579fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:26.550164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-6dc2120c-cbae-41f6-8559-ab10b986b276 None None] MFA Rules not processed for user `19cef9d8d2d9428198172d946dd73ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:26.551409 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-6dc2120c-cbae-41f6-8559-ab10b986b276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:26.798815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:26.800434 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 826/1639] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Jun 29 12:20:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:26.803321 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1909730-0084-4832-9617-3ac18c1579fc None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:26.850912 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 814/1640] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:26 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:26.850912 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2120c-cbae-41f6-8559-ab10b986b276 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:26.890400 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:26.928293 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1909730-0084-4832-9617-3ac18c1579fc None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:26.941229 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e9e93-8e59-49a0-bf9b-d03875eee62e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:26.942170 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e9e93-8e59-49a0-bf9b-d03875eee62e service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:26.942605 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e9e93-8e59-49a0-bf9b-d03875eee62e service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:26.943000 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e9e93-8e59-49a0-bf9b-d03875eee62e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:26.983218 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2120c-cbae-41f6-8559-ab10b986b276 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:26.995076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596b778-74b8-4796-a6f7-5f11e53f14af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:26.997071 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596b778-74b8-4796-a6f7-5f11e53f14af service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:26.997674 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596b778-74b8-4796-a6f7-5f11e53f14af service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:26.997808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596b778-74b8-4796-a6f7-5f11e53f14af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:27.021915 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596b778-74b8-4796-a6f7-5f11e53f14af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:27.026297 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596b778-74b8-4796-a6f7-5f11e53f14af service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:27.048099 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 815/1641] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:20:27.066931 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e9e93-8e59-49a0-bf9b-d03875eee62e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:27.068787 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e9e93-8e59-49a0-bf9b-d03875eee62e service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:27.082200 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 827/1642] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:20:27.163240 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596b778-74b8-4796-a6f7-5f11e53f14af service cinder] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:27.175067 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596b778-74b8-4796-a6f7-5f11e53f14af service cinder] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:27.180429 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807331d8-1cf8-4439-be74-b93e2f46d424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:27.182571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807331d8-1cf8-4439-be74-b93e2f46d424 service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:27.183028 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807331d8-1cf8-4439-be74-b93e2f46d424 service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:27.183400 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807331d8-1cf8-4439-be74-b93e2f46d424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:27.195393 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807331d8-1cf8-4439-be74-b93e2f46d424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:27.198081 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807331d8-1cf8-4439-be74-b93e2f46d424 service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:27.210279 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 816/1643] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:27 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:20:27.395560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e9e93-8e59-49a0-bf9b-d03875eee62e service cinder] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:27.407435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e9e93-8e59-49a0-bf9b-d03875eee62e service cinder] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:27.411836 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a39a6-b501-4704-8d1d-8a28d8567ae1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:27.412728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a39a6-b501-4704-8d1d-8a28d8567ae1 service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:27.413162 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a39a6-b501-4704-8d1d-8a28d8567ae1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:27.413646 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a39a6-b501-4704-8d1d-8a28d8567ae1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:27.506572 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a39a6-b501-4704-8d1d-8a28d8567ae1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:27.508257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a39a6-b501-4704-8d1d-8a28d8567ae1 service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:27.522186 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 828/1644] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:27 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:20:27.688488 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807331d8-1cf8-4439-be74-b93e2f46d424 service cinder] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:27.698999 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807331d8-1cf8-4439-be74-b93e2f46d424 service cinder] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:27.713874 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb221ca-fc95-4da1-bda6-72bfa2d3a402 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:27.721051 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb221ca-fc95-4da1-bda6-72bfa2d3a402 service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:27.725076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb221ca-fc95-4da1-bda6-72bfa2d3a402 service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:27.725076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb221ca-fc95-4da1-bda6-72bfa2d3a402 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:27.872978 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb221ca-fc95-4da1-bda6-72bfa2d3a402 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:27.874625 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb221ca-fc95-4da1-bda6-72bfa2d3a402 service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:27.917225 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 817/1645] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:20:28.064777 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c758c98-90dd-47fd-8ae8-3776f24b194d None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:28.065303 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c758c98-90dd-47fd-8ae8-3776f24b194d None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:28.065632 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c758c98-90dd-47fd-8ae8-3776f24b194d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:28.111426 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-5c758c98-90dd-47fd-8ae8-3776f24b194d None None] MFA Rules not processed for user `b002507260cb4939a8d140104d75d62d`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:28.113686 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-5c758c98-90dd-47fd-8ae8-3776f24b194d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:28.297901 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 829/1646] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:28 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:28.302428 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb221ca-fc95-4da1-bda6-72bfa2d3a402 service cinder] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:28.482199 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb221ca-fc95-4da1-bda6-72bfa2d3a402 service cinder] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:28.496351 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d4719-5886-470d-83ff-f14e40919575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:28.497598 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d4719-5886-470d-83ff-f14e40919575 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:28.498069 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d4719-5886-470d-83ff-f14e40919575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:28.498548 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d4719-5886-470d-83ff-f14e40919575 admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:28.499520 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8d4719-5886-470d-83ff-f14e40919575 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:28.503734 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8d4719-5886-470d-83ff-f14e40919575 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:28.569697 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 818/1647] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:20:28 2022] POST /identity/v3/projects => generated 403 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:28.574400 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c758c98-90dd-47fd-8ae8-3776f24b194d None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:28.592231 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c758c98-90dd-47fd-8ae8-3776f24b194d None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:28.611322 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:28.682584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83db076-50a7-4152-8a25-225034642d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:28.683339 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83db076-50a7-4152-8a25-225034642d5e admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:28.683625 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83db076-50a7-4152-8a25-225034642d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:28.683904 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83db076-50a7-4152-8a25-225034642d5e admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:28.684866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83db076-50a7-4152-8a25-225034642d5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:28.687136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83db076-50a7-4152-8a25-225034642d5e admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:28.723060 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 830/1648] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:20:28 2022] POST /identity/v3/users => generated 308 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:28.728465 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d4719-5886-470d-83ff-f14e40919575 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:28.736438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:28.742123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d4719-5886-470d-83ff-f14e40919575 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:28.750376 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daafd3ef-0540-424e-a9d3-34b5846493ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:28.751630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafd3ef-0540-424e-a9d3-34b5846493ac admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:28.752069 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafd3ef-0540-424e-a9d3-34b5846493ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:28.752311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafd3ef-0540-424e-a9d3-34b5846493ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:28.753072 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daafd3ef-0540-424e-a9d3-34b5846493ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:28.755041 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daafd3ef-0540-424e-a9d3-34b5846493ac admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:28.769014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 819/1649] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:28.775582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83db076-50a7-4152-8a25-225034642d5e admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:28.791347 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83db076-50a7-4152-8a25-225034642d5e admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:28.804906 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07240595-a7ef-4303-ba09-36e77545c23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:28.806690 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07240595-a7ef-4303-ba09-36e77545c23a admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:28.807179 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07240595-a7ef-4303-ba09-36e77545c23a admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:28.807606 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07240595-a7ef-4303-ba09-36e77545c23a admin admin] PATH_INFO: `/v3/projects/d22f4e7f937e45ca9592db30b6a8d318/users/f51824a27ae14a12967a4885a616ab62/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:28.840882 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07240595-a7ef-4303-ba09-36e77545c23a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d22f4e7f937e45ca9592db30b6a8d318, user_id=f51824a27ae14a12967a4885a616ab62, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:28.844740 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07240595-a7ef-4303-ba09-36e77545c23a admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:28.905735 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 831/1650] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:20:28 2022] PUT /identity/v3/projects/d22f4e7f937e45ca9592db30b6a8d318/users/f51824a27ae14a12967a4885a616ab62/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:28.910431 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daafd3ef-0540-424e-a9d3-34b5846493ac admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:28.929770 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daafd3ef-0540-424e-a9d3-34b5846493ac admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:29.076459 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cc0ea-db48-425f-aa7a-bfbb7e36fc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:29.077426 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cc0ea-db48-425f-aa7a-bfbb7e36fc68 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:29.077867 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cc0ea-db48-425f-aa7a-bfbb7e36fc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:29.078513 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cc0ea-db48-425f-aa7a-bfbb7e36fc68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:29.081083 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cc0ea-db48-425f-aa7a-bfbb7e36fc68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:29.083323 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cc0ea-db48-425f-aa7a-bfbb7e36fc68 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:29.099539 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 820/1651] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:20:29.104402 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07240595-a7ef-4303-ba09-36e77545c23a admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:29.115804 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07240595-a7ef-4303-ba09-36e77545c23a admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:29.141081 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d0bca-7b9d-4796-8b80-a76d2d3fbe87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:29.142874 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d0bca-7b9d-4796-8b80-a76d2d3fbe87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:29.143389 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d0bca-7b9d-4796-8b80-a76d2d3fbe87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:29.143847 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d0bca-7b9d-4796-8b80-a76d2d3fbe87 admin admin] PATH_INFO: `/v3/projects/d22f4e7f937e45ca9592db30b6a8d318/users/f51824a27ae14a12967a4885a616ab62/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:29.148913 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d0bca-7b9d-4796-8b80-a76d2d3fbe87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d22f4e7f937e45ca9592db30b6a8d318, user_id=f51824a27ae14a12967a4885a616ab62, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:29.160905 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d0bca-7b9d-4796-8b80-a76d2d3fbe87 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:29.181869 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 832/1652] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:20:29 2022] PUT /identity/v3/projects/d22f4e7f937e45ca9592db30b6a8d318/users/f51824a27ae14a12967a4885a616ab62/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:20:30.000006 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cc0ea-db48-425f-aa7a-bfbb7e36fc68 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:30.029775 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cc0ea-db48-425f-aa7a-bfbb7e36fc68 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:30.161906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc75052-5ebf-46e6-a03f-84e7d8869c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:30.163152 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc75052-5ebf-46e6-a03f-84e7d8869c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:30.163544 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc75052-5ebf-46e6-a03f-84e7d8869c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:30.172955 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc75052-5ebf-46e6-a03f-84e7d8869c3a admin admin] PATH_INFO: `/v3/users/6fb208908c78467f8495350e6446d379` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:30.175970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc75052-5ebf-46e6-a03f-84e7d8869c3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fb208908c78467f8495350e6446d379)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:30.177217 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: WARNING py.warnings [None req-abc75052-5ebf-46e6-a03f-84e7d8869c3a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:20:30.177217 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: warnings.warn(msg) Jun 29 12:20:30.177217 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: Jun 29 12:20:30.178372 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc75052-5ebf-46e6-a03f-84e7d8869c3a admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:30.276943 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-abc75052-5ebf-46e6-a03f-84e7d8869c3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fb208908c78467f8495350e6446d379'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:30.278073 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-abc75052-5ebf-46e6-a03f-84e7d8869c3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fb208908c78467f8495350e6446d379'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:30.331400 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-abc75052-5ebf-46e6-a03f-84e7d8869c3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fb208908c78467f8495350e6446d379'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:30.335749 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-abc75052-5ebf-46e6-a03f-84e7d8869c3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fb208908c78467f8495350e6446d379'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:30.361196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-abc75052-5ebf-46e6-a03f-84e7d8869c3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fb208908c78467f8495350e6446d379'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:30.393128 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 821/1653] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:20:29 2022] DELETE /identity/v3/users/6fb208908c78467f8495350e6446d379 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:20:30.397825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d818b-d2a6-4243-812d-7dda8474624e None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:30.398298 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d818b-d2a6-4243-812d-7dda8474624e None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:30.398373 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d818b-d2a6-4243-812d-7dda8474624e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:30.421506 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-fc1d818b-d2a6-4243-812d-7dda8474624e None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:30.424566 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-fc1d818b-d2a6-4243-812d-7dda8474624e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:30.578706 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 833/1654] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:30.596461 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc75052-5ebf-46e6-a03f-84e7d8869c3a admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:30.598015 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-abc75052-5ebf-46e6-a03f-84e7d8869c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:30.626785 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:30.741136 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc75052-5ebf-46e6-a03f-84e7d8869c3a admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:30.757479 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447250bb-68bb-4f34-bc72-18b8e3ff955d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:30.758172 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447250bb-68bb-4f34-bc72-18b8e3ff955d service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:30.758460 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447250bb-68bb-4f34-bc72-18b8e3ff955d service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:30.758829 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447250bb-68bb-4f34-bc72-18b8e3ff955d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:30.790883 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447250bb-68bb-4f34-bc72-18b8e3ff955d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:30.792643 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447250bb-68bb-4f34-bc72-18b8e3ff955d service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:30.830717 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 822/1655] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:20:31.862241 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d818b-d2a6-4243-812d-7dda8474624e None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:31.864695 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-fc1d818b-d2a6-4243-812d-7dda8474624e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:31.893029 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d818b-d2a6-4243-812d-7dda8474624e None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:31.907456 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d810e3-d9d9-457e-b57c-dd2a97918122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:31.908551 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d810e3-d9d9-457e-b57c-dd2a97918122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:31.908970 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d810e3-d9d9-457e-b57c-dd2a97918122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:31.909402 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d810e3-d9d9-457e-b57c-dd2a97918122 admin admin] PATH_INFO: `/v3/projects/41fc31c54d6747588064e8585e68df9e` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:31.913750 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d810e3-d9d9-457e-b57c-dd2a97918122 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41fc31c54d6747588064e8585e68df9e)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:31.915665 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: WARNING py.warnings [None req-22d810e3-d9d9-457e-b57c-dd2a97918122 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:20:31.915665 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: warnings.warn(msg) Jun 29 12:20:31.915665 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: Jun 29 12:20:31.917271 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d810e3-d9d9-457e-b57c-dd2a97918122 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:32.103093 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-22d810e3-d9d9-457e-b57c-dd2a97918122 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41fc31c54d6747588064e8585e68df9e', 'request_id': 'req-22d810e3-d9d9-457e-b57c-dd2a97918122'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:32.330663 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-22d810e3-d9d9-457e-b57c-dd2a97918122 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41fc31c54d6747588064e8585e68df9e', 'request_id': 'req-22d810e3-d9d9-457e-b57c-dd2a97918122'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:32.342099 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:32.343533 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-22d810e3-d9d9-457e-b57c-dd2a97918122 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41fc31c54d6747588064e8585e68df9e', 'request_id': 'req-22d810e3-d9d9-457e-b57c-dd2a97918122'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:32.372162 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-22d810e3-d9d9-457e-b57c-dd2a97918122 admin admin] The token cache is being invalidate because project 41fc31c54d6747588064e8585e68df9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:20:32.372703 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-22d810e3-d9d9-457e-b57c-dd2a97918122 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:32.374570 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-22d810e3-d9d9-457e-b57c-dd2a97918122 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:32.379211 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 834/1656] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:20:31 2022] DELETE /identity/v3/projects/41fc31c54d6747588064e8585e68df9e => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:32.385190 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004d72a-85b8-4cf6-9bd8-ba45f06a56ac None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:32.387767 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004d72a-85b8-4cf6-9bd8-ba45f06a56ac None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:32.388237 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004d72a-85b8-4cf6-9bd8-ba45f06a56ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:32.430459 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-5004d72a-85b8-4cf6-9bd8-ba45f06a56ac None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:32.431741 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-5004d72a-85b8-4cf6-9bd8-ba45f06a56ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:32.572276 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 823/1657] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:32.573666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e08c9a-b81f-4a3b-9d4e-e2d8374e6d85 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:32.573966 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e08c9a-b81f-4a3b-9d4e-e2d8374e6d85 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:32.574240 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e08c9a-b81f-4a3b-9d4e-e2d8374e6d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:32.609992 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-57e08c9a-b81f-4a3b-9d4e-e2d8374e6d85 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:32.629093 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-57e08c9a-b81f-4a3b-9d4e-e2d8374e6d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:32.644856 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 835/1658] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:20:32.648889 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004d72a-85b8-4cf6-9bd8-ba45f06a56ac None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:32.662433 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004d72a-85b8-4cf6-9bd8-ba45f06a56ac None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:32.678873 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391945b9-03ea-446a-bfa8-81261813d6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:32.678873 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391945b9-03ea-446a-bfa8-81261813d6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:32.678873 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391945b9-03ea-446a-bfa8-81261813d6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:32.678873 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391945b9-03ea-446a-bfa8-81261813d6d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:32.679151 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391945b9-03ea-446a-bfa8-81261813d6d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:20:32.679151 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391945b9-03ea-446a-bfa8-81261813d6d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:32.679390 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391945b9-03ea-446a-bfa8-81261813d6d9 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:32.685335 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a16c8-ac13-475f-bbb8-628be27736e7 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:32.685829 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a16c8-ac13-475f-bbb8-628be27736e7 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:32.686323 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a16c8-ac13-475f-bbb8-628be27736e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:32.716891 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 824/1659] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:20:32.734130 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391945b9-03ea-446a-bfa8-81261813d6d9 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:32.765483 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391945b9-03ea-446a-bfa8-81261813d6d9 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:32.769548 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-379a16c8-ac13-475f-bbb8-628be27736e7 None None] MFA Rules not processed for user `f51824a27ae14a12967a4885a616ab62`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:32.771212 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-379a16c8-ac13-475f-bbb8-628be27736e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:32.777970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fff0b4-9fa5-454a-88b7-376e10b2331d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:32.778788 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fff0b4-9fa5-454a-88b7-376e10b2331d admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:32.782472 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fff0b4-9fa5-454a-88b7-376e10b2331d admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:32.782912 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fff0b4-9fa5-454a-88b7-376e10b2331d admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:32.784015 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fff0b4-9fa5-454a-88b7-376e10b2331d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:32.789144 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fff0b4-9fa5-454a-88b7-376e10b2331d admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:32.873482 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 825/1660] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:20:32 2022] POST /identity/v3/projects => generated 369 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:32.877443 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fff0b4-9fa5-454a-88b7-376e10b2331d admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:32.980055 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 836/1661] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:32 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:33.011733 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fff0b4-9fa5-454a-88b7-376e10b2331d admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:33.018356 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef69887-8437-4a93-899c-83660a126c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:33.019087 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef69887-8437-4a93-899c-83660a126c72 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:33.019375 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef69887-8437-4a93-899c-83660a126c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:33.019656 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef69887-8437-4a93-899c-83660a126c72 admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:33.020412 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef69887-8437-4a93-899c-83660a126c72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:33.022426 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef69887-8437-4a93-899c-83660a126c72 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:33.063156 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 826/1662] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:20:32 2022] POST /identity/v3/users => generated 285 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:20:33.063809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a16c8-ac13-475f-bbb8-628be27736e7 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:33.083432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a16c8-ac13-475f-bbb8-628be27736e7 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:33.094883 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1ed30-ad79-4e90-90f6-76846826a17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:33.095661 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1ed30-ad79-4e90-90f6-76846826a17a admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:33.096013 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1ed30-ad79-4e90-90f6-76846826a17a admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:33.096361 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1ed30-ad79-4e90-90f6-76846826a17a admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:33.097196 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1ed30-ad79-4e90-90f6-76846826a17a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:33.103882 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1ed30-ad79-4e90-90f6-76846826a17a admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:33.128385 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 837/1663] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:33.132609 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef69887-8437-4a93-899c-83660a126c72 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:33.146913 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef69887-8437-4a93-899c-83660a126c72 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:33.156420 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4764c64-d12f-4d1b-a894-ff0580160d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:33.158692 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4764c64-d12f-4d1b-a894-ff0580160d28 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:33.159471 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4764c64-d12f-4d1b-a894-ff0580160d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:33.159930 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4764c64-d12f-4d1b-a894-ff0580160d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:33.161453 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4764c64-d12f-4d1b-a894-ff0580160d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:33.164423 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4764c64-d12f-4d1b-a894-ff0580160d28 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:33.167043 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:33.186800 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1ed30-ad79-4e90-90f6-76846826a17a admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:33.187569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 827/1664] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:33.200981 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1ed30-ad79-4e90-90f6-76846826a17a admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:33.213332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5000ee-0ef5-404c-8f20-a905e722c8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:33.214251 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5000ee-0ef5-404c-8f20-a905e722c8ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:33.214532 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5000ee-0ef5-404c-8f20-a905e722c8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:33.214827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5000ee-0ef5-404c-8f20-a905e722c8ff admin admin] PATH_INFO: `/v3/projects/d846c1e629f44de4b93824a8e960ae95/users/653f80e461e64a758561091e5a5a2548/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:33.256823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5000ee-0ef5-404c-8f20-a905e722c8ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=d846c1e629f44de4b93824a8e960ae95, user_id=653f80e461e64a758561091e5a5a2548, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:33.259559 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5000ee-0ef5-404c-8f20-a905e722c8ff admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:33.288339 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 838/1665] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:20:33 2022] PUT /identity/v3/projects/d846c1e629f44de4b93824a8e960ae95/users/653f80e461e64a758561091e5a5a2548/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:20:33.299520 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62dedd-6f0c-4bc7-9997-5b3e857ba6da None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:33.300062 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62dedd-6f0c-4bc7-9997-5b3e857ba6da None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:33.300447 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62dedd-6f0c-4bc7-9997-5b3e857ba6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:33.393663 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-8d62dedd-6f0c-4bc7-9997-5b3e857ba6da None None] MFA Rules not processed for user `653f80e461e64a758561091e5a5a2548`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:33.397217 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-8d62dedd-6f0c-4bc7-9997-5b3e857ba6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:33.603019 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 828/1666] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:33.606568 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5000ee-0ef5-404c-8f20-a905e722c8ff admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:33.895311 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5000ee-0ef5-404c-8f20-a905e722c8ff admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:33.906729 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c66202-f89b-4b3c-9c28-ba7131c181b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:33.907763 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c66202-f89b-4b3c-9c28-ba7131c181b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:33.908220 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c66202-f89b-4b3c-9c28-ba7131c181b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:33.908663 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c66202-f89b-4b3c-9c28-ba7131c181b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:33.909888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c66202-f89b-4b3c-9c28-ba7131c181b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:33.923211 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c66202-f89b-4b3c-9c28-ba7131c181b9 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:34.027458 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 839/1667] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:20:33 2022] POST /identity/v3/projects => generated 369 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:34.032096 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62dedd-6f0c-4bc7-9997-5b3e857ba6da None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:34.054037 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62dedd-6f0c-4bc7-9997-5b3e857ba6da None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:34.241856 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52573a6f-79ae-41e8-ba3a-c4d6953ef3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:34.242583 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52573a6f-79ae-41e8-ba3a-c4d6953ef3e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:34.242969 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52573a6f-79ae-41e8-ba3a-c4d6953ef3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:34.243252 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52573a6f-79ae-41e8-ba3a-c4d6953ef3e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:34.243989 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52573a6f-79ae-41e8-ba3a-c4d6953ef3e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:34.245989 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52573a6f-79ae-41e8-ba3a-c4d6953ef3e0 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:34.292543 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 829/1668] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:20:34 2022] POST /identity/v3/users => generated 291 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:20:34.293398 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c66202-f89b-4b3c-9c28-ba7131c181b9 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:34.323164 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c66202-f89b-4b3c-9c28-ba7131c181b9 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:34.348191 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef80a0-ddfc-45e4-9472-485cd167e2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:34.349113 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef80a0-ddfc-45e4-9472-485cd167e2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:34.353072 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef80a0-ddfc-45e4-9472-485cd167e2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:34.353598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef80a0-ddfc-45e4-9472-485cd167e2f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:34.355058 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef80a0-ddfc-45e4-9472-485cd167e2f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:34.359230 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef80a0-ddfc-45e4-9472-485cd167e2f3 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:34.419682 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52573a6f-79ae-41e8-ba3a-c4d6953ef3e0 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:34.426658 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 840/1669] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:34.438084 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52573a6f-79ae-41e8-ba3a-c4d6953ef3e0 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:34.447510 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95503fcf-ad9c-4853-bbd1-eb527ce5a1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:34.448623 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95503fcf-ad9c-4853-bbd1-eb527ce5a1bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:34.449207 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95503fcf-ad9c-4853-bbd1-eb527ce5a1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:34.449783 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95503fcf-ad9c-4853-bbd1-eb527ce5a1bf admin admin] PATH_INFO: `/v3/projects/af438cad8d294a6b89e7ed4228bbf185/users/7cf5f286571043c8a0f0dc174c04be84/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:34.484097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95503fcf-ad9c-4853-bbd1-eb527ce5a1bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=af438cad8d294a6b89e7ed4228bbf185, user_id=7cf5f286571043c8a0f0dc174c04be84, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:34.490758 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95503fcf-ad9c-4853-bbd1-eb527ce5a1bf admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:34.523691 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef80a0-ddfc-45e4-9472-485cd167e2f3 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:34.525536 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 830/1670] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:20:34 2022] PUT /identity/v3/projects/af438cad8d294a6b89e7ed4228bbf185/users/7cf5f286571043c8a0f0dc174c04be84/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:34.540196 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef80a0-ddfc-45e4-9472-485cd167e2f3 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:34.555720 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:34.772742 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d791a-56a8-4764-a030-a3ffdaeefc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:34.775777 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d791a-56a8-4764-a030-a3ffdaeefc01 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:34.776182 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d791a-56a8-4764-a030-a3ffdaeefc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:34.776582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d791a-56a8-4764-a030-a3ffdaeefc01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:34.778398 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d791a-56a8-4764-a030-a3ffdaeefc01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:34.780709 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d791a-56a8-4764-a030-a3ffdaeefc01 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:34.808528 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 841/1671] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:34.812010 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95503fcf-ad9c-4853-bbd1-eb527ce5a1bf admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:34.833527 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95503fcf-ad9c-4853-bbd1-eb527ce5a1bf admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:34.867337 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd49c1-65d0-4b60-b4f6-4c2e6d8675e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:34.868201 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd49c1-65d0-4b60-b4f6-4c2e6d8675e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:34.868483 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd49c1-65d0-4b60-b4f6-4c2e6d8675e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:34.868759 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd49c1-65d0-4b60-b4f6-4c2e6d8675e4 admin admin] PATH_INFO: `/v3/projects/af438cad8d294a6b89e7ed4228bbf185/users/7cf5f286571043c8a0f0dc174c04be84/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:34.877296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd49c1-65d0-4b60-b4f6-4c2e6d8675e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af438cad8d294a6b89e7ed4228bbf185, user_id=7cf5f286571043c8a0f0dc174c04be84, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:34.888237 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd49c1-65d0-4b60-b4f6-4c2e6d8675e4 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:34.922242 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 831/1672] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:20:34 2022] PUT /identity/v3/projects/af438cad8d294a6b89e7ed4228bbf185/users/7cf5f286571043c8a0f0dc174c04be84/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:34.934395 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759344b9-99d5-4183-88d9-543f460bc66d None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:34.934746 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759344b9-99d5-4183-88d9-543f460bc66d None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:34.934990 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759344b9-99d5-4183-88d9-543f460bc66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:35.017761 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-759344b9-99d5-4183-88d9-543f460bc66d None None] MFA Rules not processed for user `7cf5f286571043c8a0f0dc174c04be84`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:35.019770 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-759344b9-99d5-4183-88d9-543f460bc66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:35.196633 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 842/1673] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:34 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:35.204938 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd49c1-65d0-4b60-b4f6-4c2e6d8675e4 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:35.206973 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-befd49c1-65d0-4b60-b4f6-4c2e6d8675e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:35.284817 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:35.328277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd49c1-65d0-4b60-b4f6-4c2e6d8675e4 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:35.346185 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af582cd-bc9e-47f3-ab8d-1ed3ec5962de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:35.346918 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af582cd-bc9e-47f3-ab8d-1ed3ec5962de service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:35.347183 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af582cd-bc9e-47f3-ab8d-1ed3ec5962de service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:35.347457 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af582cd-bc9e-47f3-ab8d-1ed3ec5962de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:35.368088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af582cd-bc9e-47f3-ab8d-1ed3ec5962de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:35.369557 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af582cd-bc9e-47f3-ab8d-1ed3ec5962de service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:35.384793 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 832/1674] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:35 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:20:35.673168 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d3aa3-f9bb-47eb-b61d-94800600265e None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:35.673707 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d3aa3-f9bb-47eb-b61d-94800600265e None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:35.674156 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d3aa3-f9bb-47eb-b61d-94800600265e None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:35.676111 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 843/1675] 10.222.0.13 () {54 vars in 921 bytes} [Wed Jun 29 12:20:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:20:35.726798 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018786a-7276-4542-b114-3a1764339d9c None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:35.728676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018786a-7276-4542-b114-3a1764339d9c None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:35.729131 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018786a-7276-4542-b114-3a1764339d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:35.779611 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-e018786a-7276-4542-b114-3a1764339d9c None None] MFA Rules not processed for user `cd57c8b894e74c709ea389ed462184fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:35.782055 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-e018786a-7276-4542-b114-3a1764339d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:36.110969 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 833/1676] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Jun 29 12:20:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:36.176053 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351bdc5-c794-47e4-8891-eda0bd21d07f None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:36.176675 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351bdc5-c794-47e4-8891-eda0bd21d07f None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:36.177243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351bdc5-c794-47e4-8891-eda0bd21d07f None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:36.179684 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 844/1677] 10.222.0.13 () {54 vars in 960 bytes} [Wed Jun 29 12:20:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:20:36.189320 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e4f45-5780-4e1b-b6be-e98af0563d1f None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:36.190751 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e4f45-5780-4e1b-b6be-e98af0563d1f None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:36.191630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e4f45-5780-4e1b-b6be-e98af0563d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:36.233896 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-720e4f45-5780-4e1b-b6be-e98af0563d1f None None] MFA Rules not processed for user `cd57c8b894e74c709ea389ed462184fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:36.235772 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-720e4f45-5780-4e1b-b6be-e98af0563d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:36.259921 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 834/1678] 10.222.0.13 () {58 vars in 1057 bytes} [Wed Jun 29 12:20:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:20:36.270951 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351bdc5-c794-47e4-8891-eda0bd21d07f None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:36.307393 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351bdc5-c794-47e4-8891-eda0bd21d07f None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:36.323297 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af890f-6579-485c-b4c7-f6b4313b0e36 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57c8b894e74c709ea389ed462184fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:36.329885 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af890f-6579-485c-b4c7-f6b4313b0e36 service placement] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:36.330181 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af890f-6579-485c-b4c7-f6b4313b0e36 service placement] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:36.330472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af890f-6579-485c-b4c7-f6b4313b0e36 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:36.370289 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6af890f-6579-485c-b4c7-f6b4313b0e36 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:36.375567 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6af890f-6579-485c-b4c7-f6b4313b0e36 service placement] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:36.410280 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 845/1679] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:20:36.502834 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b57e9c-5959-4589-9dd0-b5acf2148855 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:36.503132 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b57e9c-5959-4589-9dd0-b5acf2148855 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:36.503686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b57e9c-5959-4589-9dd0-b5acf2148855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:36.633028 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-90b57e9c-5959-4589-9dd0-b5acf2148855 None None] MFA Rules not processed for user `026de546e4f448b3b5258cafedf8bf78`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:36.635001 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-90b57e9c-5959-4589-9dd0-b5acf2148855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:36.835917 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 835/1680] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:36.847852 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af890f-6579-485c-b4c7-f6b4313b0e36 service placement] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:36.853853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-c6af890f-6579-485c-b4c7-f6b4313b0e36 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:37.090814 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17cd5c-a911-4d70-b5de-30456be80d4e None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:37.091116 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17cd5c-a911-4d70-b5de-30456be80d4e None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:37.091399 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17cd5c-a911-4d70-b5de-30456be80d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:37.096230 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af890f-6579-485c-b4c7-f6b4313b0e36 service placement] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:37.109905 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da5a12-992e-4343-a9a4-2112d4c2a914 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:37.118701 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da5a12-992e-4343-a9a4-2112d4c2a914 service nova] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:37.119000 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da5a12-992e-4343-a9a4-2112d4c2a914 service nova] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:37.119280 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da5a12-992e-4343-a9a4-2112d4c2a914 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:37.143250 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da5a12-992e-4343-a9a4-2112d4c2a914 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:37.151162 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da5a12-992e-4343-a9a4-2112d4c2a914 service nova] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:37.164287 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:37.173049 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-fa17cd5c-a911-4d70-b5de-30456be80d4e None None] MFA Rules not processed for user `00a1e1a5b2044f2bb37bb4bd52f3afb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:37.178747 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-fa17cd5c-a911-4d70-b5de-30456be80d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:37.210782 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 846/1681] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:20:37.388497 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b8f25-6a26-4835-b974-0540e60f7c0c None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:37.389055 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b8f25-6a26-4835-b974-0540e60f7c0c None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:37.389055 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b8f25-6a26-4835-b974-0540e60f7c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:37.391855 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:37.471704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 836/1682] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:37.489254 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-8d0b8f25-6a26-4835-b974-0540e60f7c0c None None] MFA Rules not processed for user `c2c4a742ff244e298bdcdbc0c9ae5e48`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:37.495498 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-8d0b8f25-6a26-4835-b974-0540e60f7c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:37.601321 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17cd5c-a911-4d70-b5de-30456be80d4e None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:37.624356 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17cd5c-a911-4d70-b5de-30456be80d4e None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:37.646620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68409f6-3f38-4570-8838-d2990442609d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:37.647423 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68409f6-3f38-4570-8838-d2990442609d service nova] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:37.647652 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68409f6-3f38-4570-8838-d2990442609d service nova] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:37.647954 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68409f6-3f38-4570-8838-d2990442609d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:37.672990 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68409f6-3f38-4570-8838-d2990442609d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:37.675076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68409f6-3f38-4570-8838-d2990442609d service nova] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:37.707360 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 837/1683] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:20:37.753364 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 847/1684] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:37.764716 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bd916-360e-4733-88f1-87f29305dfac None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:37.765708 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bd916-360e-4733-88f1-87f29305dfac None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:37.766678 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bd916-360e-4733-88f1-87f29305dfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:37.831260 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-1c5bd916-360e-4733-88f1-87f29305dfac None None] MFA Rules not processed for user `c2c4a742ff244e298bdcdbc0c9ae5e48`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:37.851069 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-1c5bd916-360e-4733-88f1-87f29305dfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:37.889637 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 838/1685] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:37.901427 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b8f25-6a26-4835-b974-0540e60f7c0c None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:37.903566 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-8d0b8f25-6a26-4835-b974-0540e60f7c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:37.941684 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b8f25-6a26-4835-b974-0540e60f7c0c None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:37.962521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea49e4-29e0-4706-afcf-288d37af2ffd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:37.963262 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea49e4-29e0-4706-afcf-288d37af2ffd service nova] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:37.963544 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea49e4-29e0-4706-afcf-288d37af2ffd service nova] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:37.963980 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea49e4-29e0-4706-afcf-288d37af2ffd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:37.999293 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea49e4-29e0-4706-afcf-288d37af2ffd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:38.000935 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea49e4-29e0-4706-afcf-288d37af2ffd service nova] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:38.036781 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 848/1686] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:20:38.224551 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5bd916-360e-4733-88f1-87f29305dfac None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:38.226064 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-1c5bd916-360e-4733-88f1-87f29305dfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:38.455032 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5bd916-360e-4733-88f1-87f29305dfac None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:38.489054 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619873a1-f1f4-40e5-b880-aa93882da556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:38.490257 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619873a1-f1f4-40e5-b880-aa93882da556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:38.490879 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619873a1-f1f4-40e5-b880-aa93882da556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:38.491502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619873a1-f1f4-40e5-b880-aa93882da556 admin admin] PATH_INFO: `/v3/users/b002507260cb4939a8d140104d75d62d` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:38.494201 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619873a1-f1f4-40e5-b880-aa93882da556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b002507260cb4939a8d140104d75d62d)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:38.503671 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619873a1-f1f4-40e5-b880-aa93882da556 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:38.660451 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-619873a1-f1f4-40e5-b880-aa93882da556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b002507260cb4939a8d140104d75d62d'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:38.661220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-619873a1-f1f4-40e5-b880-aa93882da556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b002507260cb4939a8d140104d75d62d'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:38.712240 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-619873a1-f1f4-40e5-b880-aa93882da556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b002507260cb4939a8d140104d75d62d'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:38.716549 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-619873a1-f1f4-40e5-b880-aa93882da556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b002507260cb4939a8d140104d75d62d'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:38.762556 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-619873a1-f1f4-40e5-b880-aa93882da556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b002507260cb4939a8d140104d75d62d'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:38.803677 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 839/1687] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:20:38 2022] DELETE /identity/v3/users/b002507260cb4939a8d140104d75d62d => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:39.035823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea49e4-29e0-4706-afcf-288d37af2ffd service nova] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:39.038238 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-05ea49e4-29e0-4706-afcf-288d37af2ffd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:39.081778 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea49e4-29e0-4706-afcf-288d37af2ffd service nova] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:39.277226 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b843986-2309-494f-8a06-2a91a613ddda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:39.280132 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b843986-2309-494f-8a06-2a91a613ddda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:39.280685 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b843986-2309-494f-8a06-2a91a613ddda admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:39.280967 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b843986-2309-494f-8a06-2a91a613ddda admin admin] PATH_INFO: `/v3/users/b84d13faf25d4eef9268435491fe865c` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:39.284975 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b843986-2309-494f-8a06-2a91a613ddda admin admin] RBAC: Authorizing `identity:delete_user(user_id=b84d13faf25d4eef9268435491fe865c)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:39.298060 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b843986-2309-494f-8a06-2a91a613ddda admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:39.433255 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-4b843986-2309-494f-8a06-2a91a613ddda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b84d13faf25d4eef9268435491fe865c'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:39.435028 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-4b843986-2309-494f-8a06-2a91a613ddda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b84d13faf25d4eef9268435491fe865c'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:39.481248 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-4b843986-2309-494f-8a06-2a91a613ddda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b84d13faf25d4eef9268435491fe865c'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:39.508479 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-4b843986-2309-494f-8a06-2a91a613ddda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b84d13faf25d4eef9268435491fe865c'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:39.509173 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-4b843986-2309-494f-8a06-2a91a613ddda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b84d13faf25d4eef9268435491fe865c'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:39.515541 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:39.549654 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 849/1688] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:20:39 2022] DELETE /identity/v3/users/b84d13faf25d4eef9268435491fe865c => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:39.551315 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a026653-47b4-4d30-b5b4-c33618a82a4a None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:39.551811 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a026653-47b4-4d30-b5b4-c33618a82a4a None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:39.551924 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a026653-47b4-4d30-b5b4-c33618a82a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:39.593801 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-6a026653-47b4-4d30-b5b4-c33618a82a4a None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:39.599615 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-6a026653-47b4-4d30-b5b4-c33618a82a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:39.621632 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b843986-2309-494f-8a06-2a91a613ddda admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:39.623301 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-4b843986-2309-494f-8a06-2a91a613ddda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:39.734081 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:39.797364 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b843986-2309-494f-8a06-2a91a613ddda admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:39.803164 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff8e03-038d-4064-b374-acc78c8cf91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:39.808916 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff8e03-038d-4064-b374-acc78c8cf91b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:39.809337 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff8e03-038d-4064-b374-acc78c8cf91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:39.810273 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff8e03-038d-4064-b374-acc78c8cf91b admin admin] PATH_INFO: `/v3/projects/a2fa0da843464f9296f331a8b31d5c92` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:39.824012 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff8e03-038d-4064-b374-acc78c8cf91b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2fa0da843464f9296f331a8b31d5c92)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:39.826837 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff8e03-038d-4064-b374-acc78c8cf91b admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:39.835087 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 840/1689] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:39.841673 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd44d7-2758-4fa9-a4bd-2fda91bddb17 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:39.841975 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd44d7-2758-4fa9-a4bd-2fda91bddb17 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:39.842436 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd44d7-2758-4fa9-a4bd-2fda91bddb17 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:39.847885 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 841/1690] 10.222.0.13 () {54 vars in 912 bytes} [Wed Jun 29 12:20:39 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:20:39.849107 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd44d7-2758-4fa9-a4bd-2fda91bddb17 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:39.854227 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-4bfd44d7-2758-4fa9-a4bd-2fda91bddb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:39.915830 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd44d7-2758-4fa9-a4bd-2fda91bddb17 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:39.934204 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6edb3-6e03-43b8-96c3-f6b3632765f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:39.937038 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6edb3-6e03-43b8-96c3-f6b3632765f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:39.938744 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6edb3-6e03-43b8-96c3-f6b3632765f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:39.939991 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6edb3-6e03-43b8-96c3-f6b3632765f5 admin admin] PATH_INFO: `/v3/users/653f80e461e64a758561091e5a5a2548` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:39.943565 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6edb3-6e03-43b8-96c3-f6b3632765f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=653f80e461e64a758561091e5a5a2548)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:39.948389 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6edb3-6e03-43b8-96c3-f6b3632765f5 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:39.972865 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-46ff8e03-038d-4064-b374-acc78c8cf91b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2fa0da843464f9296f331a8b31d5c92', 'request_id': 'req-46ff8e03-038d-4064-b374-acc78c8cf91b'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:39.984515 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-46ff8e03-038d-4064-b374-acc78c8cf91b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2fa0da843464f9296f331a8b31d5c92', 'request_id': 'req-46ff8e03-038d-4064-b374-acc78c8cf91b'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:40.003083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-46ff8e03-038d-4064-b374-acc78c8cf91b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2fa0da843464f9296f331a8b31d5c92', 'request_id': 'req-46ff8e03-038d-4064-b374-acc78c8cf91b'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:40.035846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-46ff8e03-038d-4064-b374-acc78c8cf91b admin admin] The token cache is being invalidate because project a2fa0da843464f9296f331a8b31d5c92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:20:40.036505 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-46ff8e03-038d-4064-b374-acc78c8cf91b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:40.037128 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-46ff8e03-038d-4064-b374-acc78c8cf91b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:40.045838 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 850/1691] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:20:39 2022] DELETE /identity/v3/projects/a2fa0da843464f9296f331a8b31d5c92 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:40.053012 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a60e1d-8aa0-47c3-9b17-0818a058211b None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:40.056040 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a60e1d-8aa0-47c3-9b17-0818a058211b None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:40.056473 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a60e1d-8aa0-47c3-9b17-0818a058211b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:40.070089 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-82a6edb3-6e03-43b8-96c3-f6b3632765f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '653f80e461e64a758561091e5a5a2548'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:40.074259 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-82a6edb3-6e03-43b8-96c3-f6b3632765f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '653f80e461e64a758561091e5a5a2548'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:40.112072 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-82a6edb3-6e03-43b8-96c3-f6b3632765f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '653f80e461e64a758561091e5a5a2548'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:40.115771 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-82a6edb3-6e03-43b8-96c3-f6b3632765f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '653f80e461e64a758561091e5a5a2548'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:40.138561 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-82a6edb3-6e03-43b8-96c3-f6b3632765f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '653f80e461e64a758561091e5a5a2548'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:40.157594 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-d5a60e1d-8aa0-47c3-9b17-0818a058211b None None] MFA Rules not processed for user `50f5cc247f6b445f81fc3715d7bce92d`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:40.163405 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 842/1692] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:20:39 2022] DELETE /identity/v3/users/653f80e461e64a758561091e5a5a2548 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:40.164506 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6edb3-6e03-43b8-96c3-f6b3632765f5 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:40.165800 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-d5a60e1d-8aa0-47c3-9b17-0818a058211b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:40.169336 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-82a6edb3-6e03-43b8-96c3-f6b3632765f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:40.275450 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 851/1693] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Jun 29 12:20:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:40.276888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a60e1d-8aa0-47c3-9b17-0818a058211b None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:40.278846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-d5a60e1d-8aa0-47c3-9b17-0818a058211b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:40.296694 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6edb3-6e03-43b8-96c3-f6b3632765f5 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:40.309717 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60614cfe-b702-4beb-a467-b0daa44e689f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:40.310405 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60614cfe-b702-4beb-a467-b0daa44e689f service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:40.310715 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60614cfe-b702-4beb-a467-b0daa44e689f service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:40.310995 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60614cfe-b702-4beb-a467-b0daa44e689f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:40.315986 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-60614cfe-b702-4beb-a467-b0daa44e689f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:40.327291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:40.402574 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a60e1d-8aa0-47c3-9b17-0818a058211b None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:40.426174 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204520b-34b8-4295-b47a-b607de9aa90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:40.427219 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204520b-34b8-4295-b47a-b607de9aa90a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:40.427505 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204520b-34b8-4295-b47a-b607de9aa90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:40.427871 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204520b-34b8-4295-b47a-b607de9aa90a admin admin] PATH_INFO: `/v3/users/f51824a27ae14a12967a4885a616ab62` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:40.429891 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204520b-34b8-4295-b47a-b607de9aa90a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f51824a27ae14a12967a4885a616ab62)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:40.432788 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204520b-34b8-4295-b47a-b607de9aa90a admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:40.513729 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60614cfe-b702-4beb-a467-b0daa44e689f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:40.518812 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60614cfe-b702-4beb-a467-b0daa44e689f service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:40.549429 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 843/1694] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:20:40.551060 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71888584-a619-4e90-9ea0-bd937831642b None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:40.552678 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71888584-a619-4e90-9ea0-bd937831642b None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:40.553194 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71888584-a619-4e90-9ea0-bd937831642b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:40.561286 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a204520b-34b8-4295-b47a-b607de9aa90a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f51824a27ae14a12967a4885a616ab62'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:40.562404 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a204520b-34b8-4295-b47a-b607de9aa90a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f51824a27ae14a12967a4885a616ab62'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:40.595949 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a204520b-34b8-4295-b47a-b607de9aa90a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f51824a27ae14a12967a4885a616ab62'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:40.601153 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-71888584-a619-4e90-9ea0-bd937831642b None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:40.604826 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-71888584-a619-4e90-9ea0-bd937831642b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:40.616905 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a204520b-34b8-4295-b47a-b607de9aa90a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f51824a27ae14a12967a4885a616ab62'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:40.618284 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a204520b-34b8-4295-b47a-b607de9aa90a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f51824a27ae14a12967a4885a616ab62'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:40.631784 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 844/1695] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:40.633073 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71888584-a619-4e90-9ea0-bd937831642b None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:40.640284 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-71888584-a619-4e90-9ea0-bd937831642b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:40.647143 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 852/1696] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:20:40 2022] DELETE /identity/v3/users/f51824a27ae14a12967a4885a616ab62 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:40.674419 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:40.679828 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71888584-a619-4e90-9ea0-bd937831642b None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:40.776442 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204520b-34b8-4295-b47a-b607de9aa90a admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:40.828668 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfec1e-2235-45bd-be81-5f198f70308d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:40.829840 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfec1e-2235-45bd-be81-5f198f70308d service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:40.830272 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfec1e-2235-45bd-be81-5f198f70308d service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:40.830739 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfec1e-2235-45bd-be81-5f198f70308d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:40.833236 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-dfcfec1e-2235-45bd-be81-5f198f70308d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:40.852108 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcfec1e-2235-45bd-be81-5f198f70308d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:40.854849 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcfec1e-2235-45bd-be81-5f198f70308d service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:40.869804 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 845/1697] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:20:40.933163 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204520b-34b8-4295-b47a-b607de9aa90a admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:40.949870 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007d51e-db94-4f7e-96bc-ad235c1c5b85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:40.950664 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007d51e-db94-4f7e-96bc-ad235c1c5b85 service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:40.950956 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007d51e-db94-4f7e-96bc-ad235c1c5b85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:40.951218 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007d51e-db94-4f7e-96bc-ad235c1c5b85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:41.089125 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:41.122140 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007d51e-db94-4f7e-96bc-ad235c1c5b85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:41.129264 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007d51e-db94-4f7e-96bc-ad235c1c5b85 service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:41.146447 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 853/1698] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:20:41.355386 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f317b85-dfde-42bc-baff-959d71e8b6b5 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:41.355674 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f317b85-dfde-42bc-baff-959d71e8b6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:41.355955 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f317b85-dfde-42bc-baff-959d71e8b6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:41.402927 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-8f317b85-dfde-42bc-baff-959d71e8b6b5 None None] MFA Rules not processed for user `026de546e4f448b3b5258cafedf8bf78`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:41.407905 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-8f317b85-dfde-42bc-baff-959d71e8b6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:41.528036 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 846/1699] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:41.774757 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007d51e-db94-4f7e-96bc-ad235c1c5b85 service neutron] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:41.776986 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-2007d51e-db94-4f7e-96bc-ad235c1c5b85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:41.799853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007d51e-db94-4f7e-96bc-ad235c1c5b85 service neutron] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:41.807479 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024107f5-8cf9-4ddf-95dc-957ca8e058d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:41.809161 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024107f5-8cf9-4ddf-95dc-957ca8e058d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:41.811453 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024107f5-8cf9-4ddf-95dc-957ca8e058d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:41.811891 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024107f5-8cf9-4ddf-95dc-957ca8e058d3 admin admin] PATH_INFO: `/v3/projects/04e5e8f4ea8642e69eddf80a399ed495` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:41.813636 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024107f5-8cf9-4ddf-95dc-957ca8e058d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04e5e8f4ea8642e69eddf80a399ed495)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:41.828401 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024107f5-8cf9-4ddf-95dc-957ca8e058d3 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:42.088517 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-024107f5-8cf9-4ddf-95dc-957ca8e058d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04e5e8f4ea8642e69eddf80a399ed495', 'request_id': 'req-024107f5-8cf9-4ddf-95dc-957ca8e058d3'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:42.106058 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-024107f5-8cf9-4ddf-95dc-957ca8e058d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04e5e8f4ea8642e69eddf80a399ed495', 'request_id': 'req-024107f5-8cf9-4ddf-95dc-957ca8e058d3'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:42.134231 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-024107f5-8cf9-4ddf-95dc-957ca8e058d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04e5e8f4ea8642e69eddf80a399ed495', 'request_id': 'req-024107f5-8cf9-4ddf-95dc-957ca8e058d3'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:42.167351 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-024107f5-8cf9-4ddf-95dc-957ca8e058d3 admin admin] The token cache is being invalidate because project 04e5e8f4ea8642e69eddf80a399ed495 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:20:42.168904 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-024107f5-8cf9-4ddf-95dc-957ca8e058d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:42.169103 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-024107f5-8cf9-4ddf-95dc-957ca8e058d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:42.170411 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f317b85-dfde-42bc-baff-959d71e8b6b5 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:42.171637 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 854/1700] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:20:41 2022] DELETE /identity/v3/projects/04e5e8f4ea8642e69eddf80a399ed495 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:42.175727 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-8f317b85-dfde-42bc-baff-959d71e8b6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:42.179584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412ab75-4e22-434e-87cb-ff4b458ec32b None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:42.180499 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412ab75-4e22-434e-87cb-ff4b458ec32b None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:42.180794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412ab75-4e22-434e-87cb-ff4b458ec32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:42.228286 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f317b85-dfde-42bc-baff-959d71e8b6b5 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:42.290288 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-9412ab75-4e22-434e-87cb-ff4b458ec32b None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:42.291557 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-9412ab75-4e22-434e-87cb-ff4b458ec32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:42.522440 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 855/1701] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:42.523846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412ab75-4e22-434e-87cb-ff4b458ec32b None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:42.530557 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-9412ab75-4e22-434e-87cb-ff4b458ec32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:42.541853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf0851-71b0-49d0-ac16-395faa9c0f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:42.542782 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf0851-71b0-49d0-ac16-395faa9c0f93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:42.544500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf0851-71b0-49d0-ac16-395faa9c0f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:42.547054 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf0851-71b0-49d0-ac16-395faa9c0f93 admin admin] PATH_INFO: `/v3/projects/d22f4e7f937e45ca9592db30b6a8d318` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:42.552249 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf0851-71b0-49d0-ac16-395faa9c0f93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d22f4e7f937e45ca9592db30b6a8d318)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:42.554411 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf0851-71b0-49d0-ac16-395faa9c0f93 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:42.751583 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d8cf0851-71b0-49d0-ac16-395faa9c0f93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd22f4e7f937e45ca9592db30b6a8d318', 'request_id': 'req-d8cf0851-71b0-49d0-ac16-395faa9c0f93'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:42.757979 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:42.774818 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d8cf0851-71b0-49d0-ac16-395faa9c0f93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd22f4e7f937e45ca9592db30b6a8d318', 'request_id': 'req-d8cf0851-71b0-49d0-ac16-395faa9c0f93'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:42.785193 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d8cf0851-71b0-49d0-ac16-395faa9c0f93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd22f4e7f937e45ca9592db30b6a8d318', 'request_id': 'req-d8cf0851-71b0-49d0-ac16-395faa9c0f93'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:42.798443 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412ab75-4e22-434e-87cb-ff4b458ec32b None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:42.810519 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d8cf0851-71b0-49d0-ac16-395faa9c0f93 admin admin] The token cache is being invalidate because project d22f4e7f937e45ca9592db30b6a8d318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:20:42.811097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d8cf0851-71b0-49d0-ac16-395faa9c0f93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:42.812016 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d8cf0851-71b0-49d0-ac16-395faa9c0f93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:42.822572 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 847/1702] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:20:42 2022] DELETE /identity/v3/projects/d22f4e7f937e45ca9592db30b6a8d318 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:42.826212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfbc9b-f897-41b0-a496-fbc72cd20ebb None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:42.827943 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfbc9b-f897-41b0-a496-fbc72cd20ebb None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:42.828931 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfbc9b-f897-41b0-a496-fbc72cd20ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:42.842246 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:42.892403 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-e3bfbc9b-f897-41b0-a496-fbc72cd20ebb None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:42.893888 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-e3bfbc9b-f897-41b0-a496-fbc72cd20ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:43.008083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def497e-6b13-43de-a542-d437695b379a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57c8b894e74c709ea389ed462184fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:43.008816 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def497e-6b13-43de-a542-d437695b379a service placement] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:43.009075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def497e-6b13-43de-a542-d437695b379a service placement] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:43.010429 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def497e-6b13-43de-a542-d437695b379a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:43.015268 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-6def497e-6b13-43de-a542-d437695b379a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:43.058047 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def497e-6b13-43de-a542-d437695b379a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:43.064141 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def497e-6b13-43de-a542-d437695b379a service placement] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:43.076093 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 848/1703] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:43.077869 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e20a8-e68d-400d-807c-67e30ed1cceb None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:43.078380 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e20a8-e68d-400d-807c-67e30ed1cceb None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:43.079284 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e20a8-e68d-400d-807c-67e30ed1cceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:43.087546 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 856/1704] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:20:43.097553 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa3f61-98f9-401b-88d8-3c7e04658ec7 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:43.097852 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa3f61-98f9-401b-88d8-3c7e04658ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:43.098132 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa3f61-98f9-401b-88d8-3c7e04658ec7 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:43.100560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 857/1705] 10.222.0.13 () {54 vars in 912 bytes} [Wed Jun 29 12:20:43 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:20:43.101401 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa3f61-98f9-401b-88d8-3c7e04658ec7 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:43.155768 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa3f61-98f9-401b-88d8-3c7e04658ec7 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:43.163710 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-777e20a8-e68d-400d-807c-67e30ed1cceb None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:43.171416 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c9c4a-30ce-445c-9783-2ec6bd2d437f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:43.172101 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c9c4a-30ce-445c-9783-2ec6bd2d437f admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:43.172383 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c9c4a-30ce-445c-9783-2ec6bd2d437f admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:43.172656 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c9c4a-30ce-445c-9783-2ec6bd2d437f admin admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:43.173551 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c9c4a-30ce-445c-9783-2ec6bd2d437f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:20:43.174907 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c9c4a-30ce-445c-9783-2ec6bd2d437f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:43.175876 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-777e20a8-e68d-400d-807c-67e30ed1cceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:43.177288 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c9c4a-30ce-445c-9783-2ec6bd2d437f admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:43.205285 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 858/1706] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:20:43.208785 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ad009-5c28-4e8c-a06d-e987c7bc1f50 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:43.210768 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ad009-5c28-4e8c-a06d-e987c7bc1f50 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:43.211920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ad009-5c28-4e8c-a06d-e987c7bc1f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:43.214263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 849/1707] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:43.221123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e20a8-e68d-400d-807c-67e30ed1cceb None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:43.246374 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e20a8-e68d-400d-807c-67e30ed1cceb None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:43.253390 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb5486-5dab-45e7-a43e-759f30f7d176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:43.255171 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb5486-5dab-45e7-a43e-759f30f7d176 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:43.255644 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb5486-5dab-45e7-a43e-759f30f7d176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:43.256120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb5486-5dab-45e7-a43e-759f30f7d176 admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:43.257294 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb5486-5dab-45e7-a43e-759f30f7d176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:43.259857 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb5486-5dab-45e7-a43e-759f30f7d176 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:43.281638 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-773ad009-5c28-4e8c-a06d-e987c7bc1f50 None None] MFA Rules not processed for user `50f5cc247f6b445f81fc3715d7bce92d`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:43.284387 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-773ad009-5c28-4e8c-a06d-e987c7bc1f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:43.362763 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 850/1708] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:20:43 2022] POST /identity/v3/projects => generated 403 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:43.368301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c60d7-e6bf-4957-834e-f4177ebfe396 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:43.371852 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c60d7-e6bf-4957-834e-f4177ebfe396 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:43.372363 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c60d7-e6bf-4957-834e-f4177ebfe396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:43.437180 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-dd0c60d7-e6bf-4957-834e-f4177ebfe396 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:43.443252 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-dd0c60d7-e6bf-4957-834e-f4177ebfe396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:43.529207 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 859/1709] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Jun 29 12:20:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:43.529889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ad009-5c28-4e8c-a06d-e987c7bc1f50 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:43.595963 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ad009-5c28-4e8c-a06d-e987c7bc1f50 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:43.785981 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 851/1710] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:43.787617 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c60d7-e6bf-4957-834e-f4177ebfe396 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:43.789868 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-dd0c60d7-e6bf-4957-834e-f4177ebfe396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:43.799508 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c536155-93ad-423a-a883-8851661acbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:43.799821 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c536155-93ad-423a-a883-8851661acbcc admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:43.800116 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c536155-93ad-423a-a883-8851661acbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:43.800411 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c536155-93ad-423a-a883-8851661acbcc admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:43.801120 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c536155-93ad-423a-a883-8851661acbcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:43.803175 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c536155-93ad-423a-a883-8851661acbcc admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:43.871747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 860/1711] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:20:43 2022] POST /identity/v3/users => generated 302 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:43.873976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2c916-da8a-4b1d-af6a-f4e478ff7477 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:43.874210 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2c916-da8a-4b1d-af6a-f4e478ff7477 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:43.874730 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2c916-da8a-4b1d-af6a-f4e478ff7477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:43.900610 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-c3b2c916-da8a-4b1d-af6a-f4e478ff7477 None None] MFA Rules not processed for user `00a1e1a5b2044f2bb37bb4bd52f3afb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:43.904519 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-c3b2c916-da8a-4b1d-af6a-f4e478ff7477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:43.949904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c60d7-e6bf-4957-834e-f4177ebfe396 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:43.959273 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3572c-2956-4a48-a69a-9be33176163a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:43.960264 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3572c-2956-4a48-a69a-9be33176163a service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:43.960264 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3572c-2956-4a48-a69a-9be33176163a service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:43.960541 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3572c-2956-4a48-a69a-9be33176163a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:43.967105 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:43.980985 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3572c-2956-4a48-a69a-9be33176163a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:43.986079 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3572c-2956-4a48-a69a-9be33176163a service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:44.004762 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:44.018748 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 861/1712] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:44.021166 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2c916-da8a-4b1d-af6a-f4e478ff7477 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:44.039600 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-c3b2c916-da8a-4b1d-af6a-f4e478ff7477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:44.048374 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 852/1713] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:20:44.051613 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3572c-2956-4a48-a69a-9be33176163a service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:44.085315 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2c916-da8a-4b1d-af6a-f4e478ff7477 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:44.107898 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ecd59-ebff-466f-8911-988ab195ffb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:44.111999 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ecd59-ebff-466f-8911-988ab195ffb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:44.113647 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ecd59-ebff-466f-8911-988ab195ffb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:44.114531 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ecd59-ebff-466f-8911-988ab195ffb4 admin admin] PATH_INFO: `/v3/projects/d846c1e629f44de4b93824a8e960ae95` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:44.119019 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463ecd59-ebff-466f-8911-988ab195ffb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d846c1e629f44de4b93824a8e960ae95)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:44.119184 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3572c-2956-4a48-a69a-9be33176163a service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:44.126593 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463ecd59-ebff-466f-8911-988ab195ffb4 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:44.140343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eaa983-c63e-4d96-9338-3fe2993d0b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:44.146904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eaa983-c63e-4d96-9338-3fe2993d0b4c admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:44.148980 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eaa983-c63e-4d96-9338-3fe2993d0b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:44.150972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eaa983-c63e-4d96-9338-3fe2993d0b4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:44.155460 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eaa983-c63e-4d96-9338-3fe2993d0b4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:20:44.155833 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eaa983-c63e-4d96-9338-3fe2993d0b4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:44.161170 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eaa983-c63e-4d96-9338-3fe2993d0b4c admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:44.221778 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 853/1714] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:20:44.232216 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eaa983-c63e-4d96-9338-3fe2993d0b4c admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:44.250822 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-463ecd59-ebff-466f-8911-988ab195ffb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd846c1e629f44de4b93824a8e960ae95', 'request_id': 'req-463ecd59-ebff-466f-8911-988ab195ffb4'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:44.266606 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-463ecd59-ebff-466f-8911-988ab195ffb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd846c1e629f44de4b93824a8e960ae95', 'request_id': 'req-463ecd59-ebff-466f-8911-988ab195ffb4'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:44.272178 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eaa983-c63e-4d96-9338-3fe2993d0b4c admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:44.281357 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-463ecd59-ebff-466f-8911-988ab195ffb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd846c1e629f44de4b93824a8e960ae95', 'request_id': 'req-463ecd59-ebff-466f-8911-988ab195ffb4'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:44.314709 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-463ecd59-ebff-466f-8911-988ab195ffb4 admin admin] The token cache is being invalidate because project d846c1e629f44de4b93824a8e960ae95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:20:44.315044 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-463ecd59-ebff-466f-8911-988ab195ffb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:44.316666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-463ecd59-ebff-466f-8911-988ab195ffb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:44.319172 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 862/1715] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:20:44 2022] DELETE /identity/v3/projects/d846c1e629f44de4b93824a8e960ae95 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:44.320080 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ecd59-ebff-466f-8911-988ab195ffb4 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:44.323841 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-463ecd59-ebff-466f-8911-988ab195ffb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:44.435702 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab9636-3c2f-47ee-97ce-39da0afe77cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:44.436390 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab9636-3c2f-47ee-97ce-39da0afe77cb admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:44.436672 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab9636-3c2f-47ee-97ce-39da0afe77cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:44.436949 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab9636-3c2f-47ee-97ce-39da0afe77cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:44.441808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab9636-3c2f-47ee-97ce-39da0afe77cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:44.445082 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab9636-3c2f-47ee-97ce-39da0afe77cb admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:44.455700 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ecd59-ebff-466f-8911-988ab195ffb4 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:44.467529 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f49478-b6f6-41ca-8a33-793d8c9cb74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:44.468207 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f49478-b6f6-41ca-8a33-793d8c9cb74e admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:44.468956 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f49478-b6f6-41ca-8a33-793d8c9cb74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:44.469232 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f49478-b6f6-41ca-8a33-793d8c9cb74e admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:44.470114 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f49478-b6f6-41ca-8a33-793d8c9cb74e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:44.484777 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 854/1716] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:44.485693 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab9636-3c2f-47ee-97ce-39da0afe77cb admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:44.487004 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f49478-b6f6-41ca-8a33-793d8c9cb74e admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:44.490106 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-8cab9636-3c2f-47ee-97ce-39da0afe77cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:44.528258 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab9636-3c2f-47ee-97ce-39da0afe77cb admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:44.536814 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bc102-0b93-4bee-9e14-6758fde0da00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:44.537702 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bc102-0b93-4bee-9e14-6758fde0da00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:44.537986 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bc102-0b93-4bee-9e14-6758fde0da00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:44.538263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bc102-0b93-4bee-9e14-6758fde0da00 admin admin] PATH_INFO: `/v3/users/7cf5f286571043c8a0f0dc174c04be84` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:44.541834 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3bc102-0b93-4bee-9e14-6758fde0da00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cf5f286571043c8a0f0dc174c04be84)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:44.550380 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3bc102-0b93-4bee-9e14-6758fde0da00 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:44.554287 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 863/1717] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:20:44 2022] POST /identity/v3/projects => generated 385 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:44.555297 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f49478-b6f6-41ca-8a33-793d8c9cb74e admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:44.558770 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-d0f49478-b6f6-41ca-8a33-793d8c9cb74e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:44.654340 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ff3bc102-0b93-4bee-9e14-6758fde0da00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cf5f286571043c8a0f0dc174c04be84'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:44.656815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ff3bc102-0b93-4bee-9e14-6758fde0da00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cf5f286571043c8a0f0dc174c04be84'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:44.673234 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:44.682532 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ff3bc102-0b93-4bee-9e14-6758fde0da00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cf5f286571043c8a0f0dc174c04be84'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:44.683307 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ff3bc102-0b93-4bee-9e14-6758fde0da00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cf5f286571043c8a0f0dc174c04be84'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:44.700730 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f49478-b6f6-41ca-8a33-793d8c9cb74e admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:44.705946 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ff3bc102-0b93-4bee-9e14-6758fde0da00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cf5f286571043c8a0f0dc174c04be84'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:44.719649 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e113c-b7d4-43b6-8ca9-f628d764dca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:44.739315 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e113c-b7d4-43b6-8ca9-f628d764dca9 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:44.739629 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e113c-b7d4-43b6-8ca9-f628d764dca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:44.740065 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e113c-b7d4-43b6-8ca9-f628d764dca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:44.742108 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e113c-b7d4-43b6-8ca9-f628d764dca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:44.744357 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e113c-b7d4-43b6-8ca9-f628d764dca9 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:44.745946 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 855/1718] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:20:44 2022] DELETE /identity/v3/users/7cf5f286571043c8a0f0dc174c04be84 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:44.747025 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bc102-0b93-4bee-9e14-6758fde0da00 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:44.749569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-ff3bc102-0b93-4bee-9e14-6758fde0da00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:44.777541 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 864/1719] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:44.783769 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e113c-b7d4-43b6-8ca9-f628d764dca9 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:44.784812 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-124e113c-b7d4-43b6-8ca9-f628d764dca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:44.828619 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e113c-b7d4-43b6-8ca9-f628d764dca9 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:44.950754 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:45.013310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bc102-0b93-4bee-9e14-6758fde0da00 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:45.030678 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd62c8-6f24-4a23-a540-1d01711c8455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:45.035050 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd62c8-6f24-4a23-a540-1d01711c8455 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:45.035351 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd62c8-6f24-4a23-a540-1d01711c8455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:45.035598 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd62c8-6f24-4a23-a540-1d01711c8455 admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:45.047988 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd62c8-6f24-4a23-a540-1d01711c8455 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:45.053567 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd62c8-6f24-4a23-a540-1d01711c8455 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:45.093887 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6e08d-5181-4d13-8d3f-69d183cf2384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:45.097747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6e08d-5181-4d13-8d3f-69d183cf2384 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:45.098030 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6e08d-5181-4d13-8d3f-69d183cf2384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:45.098328 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6e08d-5181-4d13-8d3f-69d183cf2384 admin admin] PATH_INFO: `/v3/projects/c08a6c43117f4feb9fdcb1cef9de47e7/users/4d997fe812fc4f789fd3a81fbe3689b6/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:45.131296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 856/1720] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:20:44 2022] POST /identity/v3/users => generated 293 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:45.134809 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd62c8-6f24-4a23-a540-1d01711c8455 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:45.189168 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6e08d-5181-4d13-8d3f-69d183cf2384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c08a6c43117f4feb9fdcb1cef9de47e7, user_id=4d997fe812fc4f789fd3a81fbe3689b6, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:45.195024 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6e08d-5181-4d13-8d3f-69d183cf2384 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:45.201305 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd62c8-6f24-4a23-a540-1d01711c8455 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:45.234348 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e28826-8ce6-4e92-a222-5397449559ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:45.237677 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e28826-8ce6-4e92-a222-5397449559ae admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:45.240128 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e28826-8ce6-4e92-a222-5397449559ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:45.246835 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e28826-8ce6-4e92-a222-5397449559ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:45.247570 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e28826-8ce6-4e92-a222-5397449559ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:45.250536 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e28826-8ce6-4e92-a222-5397449559ae admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:45.261863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 865/1721] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:20:44 2022] PUT /identity/v3/projects/c08a6c43117f4feb9fdcb1cef9de47e7/users/4d997fe812fc4f789fd3a81fbe3689b6/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:45.272531 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767d38a-05db-4391-bd01-375d1c8696c8 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:45.272809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767d38a-05db-4391-bd01-375d1c8696c8 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:45.273080 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767d38a-05db-4391-bd01-375d1c8696c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:45.305084 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 857/1722] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:45.310122 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e28826-8ce6-4e92-a222-5397449559ae admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:45.341734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-d767d38a-05db-4391-bd01-375d1c8696c8 None None] MFA Rules not processed for user `4d997fe812fc4f789fd3a81fbe3689b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:45.342995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-d767d38a-05db-4391-bd01-375d1c8696c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:45.347974 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e28826-8ce6-4e92-a222-5397449559ae admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:45.569715 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb4ad2-50f3-4ab7-8802-ab44a91d42c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:45.571753 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb4ad2-50f3-4ab7-8802-ab44a91d42c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:45.572036 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb4ad2-50f3-4ab7-8802-ab44a91d42c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:45.573689 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 866/1723] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:20:45.575191 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb4ad2-50f3-4ab7-8802-ab44a91d42c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:45.576124 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb4ad2-50f3-4ab7-8802-ab44a91d42c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:45.579110 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767d38a-05db-4391-bd01-375d1c8696c8 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:45.580980 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb4ad2-50f3-4ab7-8802-ab44a91d42c8 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:45.621184 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767d38a-05db-4391-bd01-375d1c8696c8 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:45.628291 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 858/1724] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:45.630782 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb4ad2-50f3-4ab7-8802-ab44a91d42c8 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:45.642584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23adedec-b6a4-4641-b27a-808b379f56b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:45.643302 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23adedec-b6a4-4641-b27a-808b379f56b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:45.643584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23adedec-b6a4-4641-b27a-808b379f56b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:45.643859 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23adedec-b6a4-4641-b27a-808b379f56b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:45.644675 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23adedec-b6a4-4641-b27a-808b379f56b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:45.652926 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23adedec-b6a4-4641-b27a-808b379f56b4 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:45.667603 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb4ad2-50f3-4ab7-8802-ab44a91d42c8 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:45.686522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c5442-adc3-4475-bf5b-0365d3b89451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:45.687610 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c5442-adc3-4475-bf5b-0365d3b89451 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:45.687905 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c5442-adc3-4475-bf5b-0365d3b89451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:45.688183 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c5442-adc3-4475-bf5b-0365d3b89451 admin admin] PATH_INFO: `/v3/projects/d2e93b078dc943908c3e79a9170fb46a/users/b1de10ca63a64264bbef44c0197e3cdd/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:45.749258 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 867/1725] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:20:45 2022] POST /identity/v3/projects => generated 405 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:45.750147 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c5442-adc3-4475-bf5b-0365d3b89451 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2e93b078dc943908c3e79a9170fb46a, user_id=b1de10ca63a64264bbef44c0197e3cdd, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:45.752891 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c5442-adc3-4475-bf5b-0365d3b89451 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:45.753727 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23adedec-b6a4-4641-b27a-808b379f56b4 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:45.803908 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 859/1726] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:20:45 2022] PUT /identity/v3/projects/d2e93b078dc943908c3e79a9170fb46a/users/b1de10ca63a64264bbef44c0197e3cdd/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:45.807771 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3330ead-da51-4d48-af92-539762f98a4c None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:45.808128 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3330ead-da51-4d48-af92-539762f98a4c None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:45.808475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3330ead-da51-4d48-af92-539762f98a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:45.888956 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:45.922519 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-e3330ead-da51-4d48-af92-539762f98a4c None None] MFA Rules not processed for user `b1de10ca63a64264bbef44c0197e3cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:45.934750 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-e3330ead-da51-4d48-af92-539762f98a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:46.025742 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23adedec-b6a4-4641-b27a-808b379f56b4 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:46.205613 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc93b5-92ea-48f8-ae53-cccf3965b0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:46.206567 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc93b5-92ea-48f8-ae53-cccf3965b0b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:46.207098 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc93b5-92ea-48f8-ae53-cccf3965b0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:46.207570 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc93b5-92ea-48f8-ae53-cccf3965b0b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:46.208465 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc93b5-92ea-48f8-ae53-cccf3965b0b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:46.210593 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc93b5-92ea-48f8-ae53-cccf3965b0b4 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:46.245298 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 860/1727] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:46.249958 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3330ead-da51-4d48-af92-539762f98a4c None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:46.253624 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-e3330ead-da51-4d48-af92-539762f98a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:46.264946 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 868/1728] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:20:45 2022] POST /identity/v3/users => generated 309 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:20:46.266410 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc93b5-92ea-48f8-ae53-cccf3965b0b4 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:46.291545 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3330ead-da51-4d48-af92-539762f98a4c None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:46.310097 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc93b5-92ea-48f8-ae53-cccf3965b0b4 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:46.315707 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d71ff-4b63-481c-a292-67fcf5e05859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:46.318542 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d71ff-4b63-481c-a292-67fcf5e05859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:46.318962 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d71ff-4b63-481c-a292-67fcf5e05859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:46.319261 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d71ff-4b63-481c-a292-67fcf5e05859 admin admin] PATH_INFO: `/v3/projects/af438cad8d294a6b89e7ed4228bbf185` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:46.327405 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d71ff-4b63-481c-a292-67fcf5e05859 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af438cad8d294a6b89e7ed4228bbf185)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:46.328259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63e062-5ce7-41bd-a1dd-09ad716af4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:46.329152 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63e062-5ce7-41bd-a1dd-09ad716af4d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:46.329633 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63e062-5ce7-41bd-a1dd-09ad716af4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:46.330084 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63e062-5ce7-41bd-a1dd-09ad716af4d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:46.330590 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d71ff-4b63-481c-a292-67fcf5e05859 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:46.331071 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63e062-5ce7-41bd-a1dd-09ad716af4d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:46.337204 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63e062-5ce7-41bd-a1dd-09ad716af4d3 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:46.419381 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 869/1729] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:20:46 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:46.419381 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63e062-5ce7-41bd-a1dd-09ad716af4d3 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:46.424426 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:46.506153 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-3a5d71ff-4b63-481c-a292-67fcf5e05859 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af438cad8d294a6b89e7ed4228bbf185', 'request_id': 'req-3a5d71ff-4b63-481c-a292-67fcf5e05859'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:46.532067 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-3a5d71ff-4b63-481c-a292-67fcf5e05859 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af438cad8d294a6b89e7ed4228bbf185', 'request_id': 'req-3a5d71ff-4b63-481c-a292-67fcf5e05859'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:46.576816 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-3a5d71ff-4b63-481c-a292-67fcf5e05859 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af438cad8d294a6b89e7ed4228bbf185', 'request_id': 'req-3a5d71ff-4b63-481c-a292-67fcf5e05859'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:46.627493 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-3a5d71ff-4b63-481c-a292-67fcf5e05859 admin admin] The token cache is being invalidate because project af438cad8d294a6b89e7ed4228bbf185 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:20:46.628260 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-3a5d71ff-4b63-481c-a292-67fcf5e05859 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:46.629739 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-3a5d71ff-4b63-481c-a292-67fcf5e05859 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:46.634147 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 861/1730] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:20:46 2022] DELETE /identity/v3/projects/af438cad8d294a6b89e7ed4228bbf185 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:46.640033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d71ff-4b63-481c-a292-67fcf5e05859 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:46.648051 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-3a5d71ff-4b63-481c-a292-67fcf5e05859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:46.693231 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63e062-5ce7-41bd-a1dd-09ad716af4d3 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:46.853549 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d71ff-4b63-481c-a292-67fcf5e05859 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:46.865214 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33f6d5-71a2-4a92-ae59-a20d40f67159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:46.866087 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33f6d5-71a2-4a92-ae59-a20d40f67159 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:46.867468 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33f6d5-71a2-4a92-ae59-a20d40f67159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:46.868093 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33f6d5-71a2-4a92-ae59-a20d40f67159 admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:46.871480 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33f6d5-71a2-4a92-ae59-a20d40f67159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:46.875912 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33f6d5-71a2-4a92-ae59-a20d40f67159 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:46.901168 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:46.924902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbabc17-79fb-400b-81cd-1e73048b8f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:46.925855 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 862/1731] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:20:46 2022] POST /identity/v3/users => generated 298 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:46.931399 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddfbaa-72f9-4321-b08d-fc2b530e9f03 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:46.932469 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddfbaa-72f9-4321-b08d-fc2b530e9f03 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:46.932751 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddfbaa-72f9-4321-b08d-fc2b530e9f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:46.933396 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbabc17-79fb-400b-81cd-1e73048b8f54 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:46.934415 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbabc17-79fb-400b-81cd-1e73048b8f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:46.934791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbabc17-79fb-400b-81cd-1e73048b8f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:46.937054 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbabc17-79fb-400b-81cd-1e73048b8f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:46.944248 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbabc17-79fb-400b-81cd-1e73048b8f54 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:46.997417 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 870/1732] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 580 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:47.010510 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbabc17-79fb-400b-81cd-1e73048b8f54 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:47.026727 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-acddfbaa-72f9-4321-b08d-fc2b530e9f03 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:47.028578 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-acddfbaa-72f9-4321-b08d-fc2b530e9f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:47.044997 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbabc17-79fb-400b-81cd-1e73048b8f54 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:47.052872 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 863/1733] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:47.056784 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a57d5-9081-4ff0-8119-6529d7f9a1e6 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:47.057856 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a57d5-9081-4ff0-8119-6529d7f9a1e6 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:47.058615 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d7c75-8358-489a-9210-18ac621b93d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:47.059364 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d7c75-8358-489a-9210-18ac621b93d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:47.059850 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a57d5-9081-4ff0-8119-6529d7f9a1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:47.060910 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d7c75-8358-489a-9210-18ac621b93d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:47.061084 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d7c75-8358-489a-9210-18ac621b93d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:47.062430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d7c75-8358-489a-9210-18ac621b93d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:47.073818 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d7c75-8358-489a-9210-18ac621b93d1 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:47.104430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 871/1734] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:47.107624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d7c75-8358-489a-9210-18ac621b93d1 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:47.110985 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-890d7c75-8358-489a-9210-18ac621b93d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:47.113817 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-fe4a57d5-9081-4ff0-8119-6529d7f9a1e6 None None] MFA Rules not processed for user `2891b5a315b64f228f665e024b641629`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:47.118748 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-fe4a57d5-9081-4ff0-8119-6529d7f9a1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:47.140814 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d7c75-8358-489a-9210-18ac621b93d1 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:47.157301 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c15280-2e07-403b-a23f-c1a750bb55ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:47.158501 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c15280-2e07-403b-a23f-c1a750bb55ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:47.159014 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c15280-2e07-403b-a23f-c1a750bb55ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:47.159463 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c15280-2e07-403b-a23f-c1a750bb55ff admin admin] PATH_INFO: `/v3/users/1b8578f2daae405a8116d042208dcdef` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:47.162761 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c15280-2e07-403b-a23f-c1a750bb55ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b8578f2daae405a8116d042208dcdef)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:47.165156 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c15280-2e07-403b-a23f-c1a750bb55ff admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:47.275236 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 864/1735] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Jun 29 12:20:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:47.276165 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a57d5-9081-4ff0-8119-6529d7f9a1e6 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:47.278118 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-fe4a57d5-9081-4ff0-8119-6529d7f9a1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:47.288184 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e0c15280-2e07-403b-a23f-c1a750bb55ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b8578f2daae405a8116d042208dcdef'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:47.291787 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e0c15280-2e07-403b-a23f-c1a750bb55ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b8578f2daae405a8116d042208dcdef'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:47.307700 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a57d5-9081-4ff0-8119-6529d7f9a1e6 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:47.322441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3cb5e9-584d-4698-8ebd-12c75e8533f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:47.323598 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cb5e9-584d-4698-8ebd-12c75e8533f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:47.324022 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cb5e9-584d-4698-8ebd-12c75e8533f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:47.324907 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cb5e9-584d-4698-8ebd-12c75e8533f3 admin admin] PATH_INFO: `/v3/projects/a6f5d9293d534ba69502d08ec9538916/users/b63204f2b5bc492a87ea2094b55b57d3/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:47.344897 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e0c15280-2e07-403b-a23f-c1a750bb55ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b8578f2daae405a8116d042208dcdef'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:47.357237 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3cb5e9-584d-4698-8ebd-12c75e8533f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6f5d9293d534ba69502d08ec9538916, user_id=b63204f2b5bc492a87ea2094b55b57d3, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:47.360102 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3cb5e9-584d-4698-8ebd-12c75e8533f3 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:47.372142 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e0c15280-2e07-403b-a23f-c1a750bb55ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b8578f2daae405a8116d042208dcdef'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:47.373077 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e0c15280-2e07-403b-a23f-c1a750bb55ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b8578f2daae405a8116d042208dcdef'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:47.390916 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 865/1736] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:20:47 2022] PUT /identity/v3/projects/a6f5d9293d534ba69502d08ec9538916/users/b63204f2b5bc492a87ea2094b55b57d3/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:47.395621 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311230b-a348-4918-a81e-5a87747e010b None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:47.396150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311230b-a348-4918-a81e-5a87747e010b None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:47.396761 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311230b-a348-4918-a81e-5a87747e010b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:47.428952 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 872/1737] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:20:47 2022] DELETE /identity/v3/users/1b8578f2daae405a8116d042208dcdef => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:47.429443 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c15280-2e07-403b-a23f-c1a750bb55ff admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:47.434129 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-8311230b-a348-4918-a81e-5a87747e010b None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:47.434367 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-e0c15280-2e07-403b-a23f-c1a750bb55ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:47.435777 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-8311230b-a348-4918-a81e-5a87747e010b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:47.467666 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:47.614571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 866/1738] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:47.614571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311230b-a348-4918-a81e-5a87747e010b None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:47.618157 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-8311230b-a348-4918-a81e-5a87747e010b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:47.646323 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311230b-a348-4918-a81e-5a87747e010b None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:47.662534 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4ec89-5391-48dc-8616-e1d1bd535c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:47.662976 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4ec89-5391-48dc-8616-e1d1bd535c60 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:47.663256 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4ec89-5391-48dc-8616-e1d1bd535c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:47.663533 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4ec89-5391-48dc-8616-e1d1bd535c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:47.664814 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4ec89-5391-48dc-8616-e1d1bd535c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:47.667443 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4ec89-5391-48dc-8616-e1d1bd535c60 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:47.688804 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 867/1739] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:47.689980 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c15280-2e07-403b-a23f-c1a750bb55ff admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:47.691682 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23525d-0ad4-4f5d-958a-37c4a5cfce92 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:47.692178 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23525d-0ad4-4f5d-958a-37c4a5cfce92 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:47.692305 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23525d-0ad4-4f5d-958a-37c4a5cfce92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:47.711737 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ca8d9-b822-4ed9-b343-782dc64443c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:47.712733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ca8d9-b822-4ed9-b343-782dc64443c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:47.713880 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ca8d9-b822-4ed9-b343-782dc64443c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:47.713880 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ca8d9-b822-4ed9-b343-782dc64443c5 admin admin] PATH_INFO: `/v3/projects/9221d923db6b489e82092548b510b018/users/d862ee522bfb453b88bd3161d8ed890a/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:47.754341 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ca8d9-b822-4ed9-b343-782dc64443c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9221d923db6b489e82092548b510b018, user_id=d862ee522bfb453b88bd3161d8ed890a, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:47.765342 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ca8d9-b822-4ed9-b343-782dc64443c5 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:47.804279 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-dc23525d-0ad4-4f5d-958a-37c4a5cfce92 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:47.804620 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 873/1740] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:20:47 2022] PUT /identity/v3/projects/9221d923db6b489e82092548b510b018/users/d862ee522bfb453b88bd3161d8ed890a/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:47.805710 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ca8d9-b822-4ed9-b343-782dc64443c5 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:47.809749 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-684ca8d9-b822-4ed9-b343-782dc64443c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:47.810257 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-dc23525d-0ad4-4f5d-958a-37c4a5cfce92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:47.871186 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:47.964879 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ca8d9-b822-4ed9-b343-782dc64443c5 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:47.969480 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 868/1741] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:47.970260 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23525d-0ad4-4f5d-958a-37c4a5cfce92 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:47.977051 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80239613-832c-4f37-8940-898e337cee2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11efdbeeaa5c428aa344f7f0f5b061ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:47.977832 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80239613-832c-4f37-8940-898e337cee2d service swift] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:47.978141 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80239613-832c-4f37-8940-898e337cee2d service swift] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:47.978374 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80239613-832c-4f37-8940-898e337cee2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:47.980403 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23525d-0ad4-4f5d-958a-37c4a5cfce92 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:47.985508 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-80239613-832c-4f37-8940-898e337cee2d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:47.985805 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857230fb-6d74-4283-9e0c-fd3a1f2251e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:47.986767 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857230fb-6d74-4283-9e0c-fd3a1f2251e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:47.987119 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857230fb-6d74-4283-9e0c-fd3a1f2251e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:47.987461 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857230fb-6d74-4283-9e0c-fd3a1f2251e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:47.988258 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857230fb-6d74-4283-9e0c-fd3a1f2251e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:20:47.988696 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857230fb-6d74-4283-9e0c-fd3a1f2251e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:47.991107 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857230fb-6d74-4283-9e0c-fd3a1f2251e3 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:48.014372 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 869/1742] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:20:48.018934 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857230fb-6d74-4283-9e0c-fd3a1f2251e3 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:48.033735 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857230fb-6d74-4283-9e0c-fd3a1f2251e3 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:48.043442 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b03d1a-d716-4bce-af60-bfc9e9b175fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:48.044234 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b03d1a-d716-4bce-af60-bfc9e9b175fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:48.044514 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b03d1a-d716-4bce-af60-bfc9e9b175fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:48.044795 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b03d1a-d716-4bce-af60-bfc9e9b175fa admin admin] PATH_INFO: `/v3/projects/a6f5d9293d534ba69502d08ec9538916/users/b63204f2b5bc492a87ea2094b55b57d3/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:48.046891 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b03d1a-d716-4bce-af60-bfc9e9b175fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6f5d9293d534ba69502d08ec9538916, user_id=b63204f2b5bc492a87ea2094b55b57d3, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:48.049770 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b03d1a-d716-4bce-af60-bfc9e9b175fa admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:48.073211 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 870/1743] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:20:48 2022] PUT /identity/v3/projects/a6f5d9293d534ba69502d08ec9538916/users/b63204f2b5bc492a87ea2094b55b57d3/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:48.073981 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b03d1a-d716-4bce-af60-bfc9e9b175fa admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:48.098868 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80239613-832c-4f37-8940-898e337cee2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:48.101098 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80239613-832c-4f37-8940-898e337cee2d service swift] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:48.123432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 874/1744] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Jun 29 12:20:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 12:20:48.125092 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80239613-832c-4f37-8940-898e337cee2d service swift] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:48.126749 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-80239613-832c-4f37-8940-898e337cee2d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:48.296421 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b03d1a-d716-4bce-af60-bfc9e9b175fa admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:48.312665 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f451bc7-4c20-45e3-a2e4-cf635c8f8d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:48.314525 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f451bc7-4c20-45e3-a2e4-cf635c8f8d73 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:48.314986 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f451bc7-4c20-45e3-a2e4-cf635c8f8d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:48.315434 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f451bc7-4c20-45e3-a2e4-cf635c8f8d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:48.317415 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f451bc7-4c20-45e3-a2e4-cf635c8f8d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:48.321454 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f451bc7-4c20-45e3-a2e4-cf635c8f8d73 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:48.338288 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80239613-832c-4f37-8940-898e337cee2d service swift] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:48.373209 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 871/1745] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:48.374957 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f451bc7-4c20-45e3-a2e4-cf635c8f8d73 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:48.413203 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f451bc7-4c20-45e3-a2e4-cf635c8f8d73 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:48.426815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666d762-3f8c-4ecd-94a1-d6e136165944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:48.427661 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666d762-3f8c-4ecd-94a1-d6e136165944 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:48.428194 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666d762-3f8c-4ecd-94a1-d6e136165944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:48.428587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666d762-3f8c-4ecd-94a1-d6e136165944 admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:48.429399 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666d762-3f8c-4ecd-94a1-d6e136165944 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:48.432474 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666d762-3f8c-4ecd-94a1-d6e136165944 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:48.486093 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640121fc-252d-4725-867f-50be22cf5196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:48.487048 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640121fc-252d-4725-867f-50be22cf5196 service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:48.487540 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640121fc-252d-4725-867f-50be22cf5196 service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:48.488267 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640121fc-252d-4725-867f-50be22cf5196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:48.506773 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:48.537550 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640121fc-252d-4725-867f-50be22cf5196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:48.539890 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640121fc-252d-4725-867f-50be22cf5196 service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:48.540062 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 872/1746] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:20:48 2022] POST /identity/v3/projects => generated 383 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:48.541764 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702007e-5e92-4ab9-90fa-1f4fe0e62f5a None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:48.542997 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702007e-5e92-4ab9-90fa-1f4fe0e62f5a None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:48.543373 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702007e-5e92-4ab9-90fa-1f4fe0e62f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:48.568413 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 875/1747] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:20:48.588958 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640121fc-252d-4725-867f-50be22cf5196 service neutron] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:48.633600 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-c702007e-5e92-4ab9-90fa-1f4fe0e62f5a None None] MFA Rules not processed for user `b63204f2b5bc492a87ea2094b55b57d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:48.634375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640121fc-252d-4725-867f-50be22cf5196 service neutron] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:48.635169 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-c702007e-5e92-4ab9-90fa-1f4fe0e62f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:48.741080 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:48.783193 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 873/1748] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:48 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:48.785074 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702007e-5e92-4ab9-90fa-1f4fe0e62f5a None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:48.825639 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb8f22-41df-4560-95fb-8f7393e629e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:48.828718 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb8f22-41df-4560-95fb-8f7393e629e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:48.828969 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb8f22-41df-4560-95fb-8f7393e629e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:48.829252 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb8f22-41df-4560-95fb-8f7393e629e7 admin admin] PATH_INFO: `/v3/projects/9221d923db6b489e82092548b510b018/users/d862ee522bfb453b88bd3161d8ed890a/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:48.833850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb8f22-41df-4560-95fb-8f7393e629e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9221d923db6b489e82092548b510b018, user_id=d862ee522bfb453b88bd3161d8ed890a, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:48.840057 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb8f22-41df-4560-95fb-8f7393e629e7 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:48.889852 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 876/1749] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:20:48 2022] PUT /identity/v3/projects/9221d923db6b489e82092548b510b018/users/d862ee522bfb453b88bd3161d8ed890a/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:48.892083 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702007e-5e92-4ab9-90fa-1f4fe0e62f5a None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:48.895780 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fafb8-5547-41f6-a55d-90bd90c2a3af None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:48.896185 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fafb8-5547-41f6-a55d-90bd90c2a3af None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:48.896431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fafb8-5547-41f6-a55d-90bd90c2a3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:48.968998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-4d1fafb8-5547-41f6-a55d-90bd90c2a3af None None] MFA Rules not processed for user `50f5cc247f6b445f81fc3715d7bce92d`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:48.975187 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-4d1fafb8-5547-41f6-a55d-90bd90c2a3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:49.128710 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853086f1-7fa2-432f-a31e-13dd13e88d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:49.129525 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853086f1-7fa2-432f-a31e-13dd13e88d34 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:49.129881 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853086f1-7fa2-432f-a31e-13dd13e88d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:49.130292 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853086f1-7fa2-432f-a31e-13dd13e88d34 admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:49.131112 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853086f1-7fa2-432f-a31e-13dd13e88d34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:49.133551 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853086f1-7fa2-432f-a31e-13dd13e88d34 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:49.150083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 877/1750] 10.222.0.16 () {58 vars in 1015 bytes} [Wed Jun 29 12:20:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:49.152760 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fafb8-5547-41f6-a55d-90bd90c2a3af None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:49.155644 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-4d1fafb8-5547-41f6-a55d-90bd90c2a3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:49.173858 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 874/1751] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:20:48 2022] POST /identity/v3/users => generated 292 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:49.179644 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4399255-fcba-4d69-a44e-4c53d85fb116 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:49.197186 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4399255-fcba-4d69-a44e-4c53d85fb116 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:49.197590 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4399255-fcba-4d69-a44e-4c53d85fb116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:49.298631 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-c4399255-fcba-4d69-a44e-4c53d85fb116 None None] MFA Rules not processed for user `d862ee522bfb453b88bd3161d8ed890a`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:49.304003 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-c4399255-fcba-4d69-a44e-4c53d85fb116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:49.325981 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:49.427933 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fafb8-5547-41f6-a55d-90bd90c2a3af None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:49.437727 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b3d88-37c7-45b6-b525-f28afa757f20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:49.438413 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b3d88-37c7-45b6-b525-f28afa757f20 service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:49.438736 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b3d88-37c7-45b6-b525-f28afa757f20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:49.439025 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b3d88-37c7-45b6-b525-f28afa757f20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:49.444501 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 875/1752] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:49.449386 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4399255-fcba-4d69-a44e-4c53d85fb116 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:49.491727 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4399255-fcba-4d69-a44e-4c53d85fb116 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:49.518669 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a924a-42b1-4334-b2c0-def8329cc195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:49.519514 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a924a-42b1-4334-b2c0-def8329cc195 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:49.519800 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a924a-42b1-4334-b2c0-def8329cc195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:49.520078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a924a-42b1-4334-b2c0-def8329cc195 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:49.520952 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a924a-42b1-4334-b2c0-def8329cc195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:49.523874 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a924a-42b1-4334-b2c0-def8329cc195 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:49.560179 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 876/1753] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:49.561118 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a924a-42b1-4334-b2c0-def8329cc195 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:49.566797 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-ec4a924a-42b1-4334-b2c0-def8329cc195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:49.616528 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a924a-42b1-4334-b2c0-def8329cc195 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:49.623567 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b3d88-37c7-45b6-b525-f28afa757f20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:49.627644 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b3d88-37c7-45b6-b525-f28afa757f20 service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:49.632702 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fdf19-7c81-4ed3-a39e-e58d4c97e9bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:49.633380 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fdf19-7c81-4ed3-a39e-e58d4c97e9bb service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:49.633662 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fdf19-7c81-4ed3-a39e-e58d4c97e9bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:49.634101 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fdf19-7c81-4ed3-a39e-e58d4c97e9bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:49.654188 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 878/1754] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:49 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:20:49.661285 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fdf19-7c81-4ed3-a39e-e58d4c97e9bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:49.666873 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fdf19-7c81-4ed3-a39e-e58d4c97e9bb service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:49.690304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b3d88-37c7-45b6-b525-f28afa757f20 service cinder] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:49.694784 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 877/1755] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:20:49.743691 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fdf19-7c81-4ed3-a39e-e58d4c97e9bb service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:49.750202 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b3d88-37c7-45b6-b525-f28afa757f20 service cinder] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:49.767986 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fdf19-7c81-4ed3-a39e-e58d4c97e9bb service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:49.772218 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42d16a-8824-4229-94da-9dd94b4c6b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:49.772954 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42d16a-8824-4229-94da-9dd94b4c6b02 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:49.773263 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42d16a-8824-4229-94da-9dd94b4c6b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:49.773550 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42d16a-8824-4229-94da-9dd94b4c6b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:49.774289 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42d16a-8824-4229-94da-9dd94b4c6b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:49.775957 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42d16a-8824-4229-94da-9dd94b4c6b02 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:49.777585 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df98f30-b94a-4071-8a0f-80d457707aee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:49.779448 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df98f30-b94a-4071-8a0f-80d457707aee service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:49.781175 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df98f30-b94a-4071-8a0f-80d457707aee service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:49.781465 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df98f30-b94a-4071-8a0f-80d457707aee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:49.794873 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 879/1756] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:49.799043 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42d16a-8824-4229-94da-9dd94b4c6b02 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:49.807888 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df98f30-b94a-4071-8a0f-80d457707aee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:49.809575 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df98f30-b94a-4071-8a0f-80d457707aee service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:49.824571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 878/1757] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:20:49.839779 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42d16a-8824-4229-94da-9dd94b4c6b02 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:49.869088 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ebb99-3513-4f48-a135-87f872d9110a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:49.873347 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ebb99-3513-4f48-a135-87f872d9110a admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:49.874918 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ebb99-3513-4f48-a135-87f872d9110a admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:49.875937 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ebb99-3513-4f48-a135-87f872d9110a admin admin] PATH_INFO: `/v3/projects/5cbe3a89ac354ec0a12aa230a44d3e11/users/b96bdd082c124b60a6ab5b5285c13ef9/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:49.930011 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ebb99-3513-4f48-a135-87f872d9110a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cbe3a89ac354ec0a12aa230a44d3e11, user_id=b96bdd082c124b60a6ab5b5285c13ef9, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:49.934232 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ebb99-3513-4f48-a135-87f872d9110a admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:49.949768 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:49.973419 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 880/1758] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:20:49 2022] PUT /identity/v3/projects/5cbe3a89ac354ec0a12aa230a44d3e11/users/b96bdd082c124b60a6ab5b5285c13ef9/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:20:49.986595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74f560-e946-4e01-97fc-2041787acf2f None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:49.986903 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74f560-e946-4e01-97fc-2041787acf2f None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:49.987307 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74f560-e946-4e01-97fc-2041787acf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:50.091105 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-ef74f560-e946-4e01-97fc-2041787acf2f None None] MFA Rules not processed for user `b96bdd082c124b60a6ab5b5285c13ef9`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:50.092828 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-ef74f560-e946-4e01-97fc-2041787acf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:50.360208 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 879/1759] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:20:50.364997 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ebb99-3513-4f48-a135-87f872d9110a admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:50.429143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74f560-e946-4e01-97fc-2041787acf2f None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:50.592150 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ebb99-3513-4f48-a135-87f872d9110a admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:50.608504 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd749574-9290-4a26-846a-d30a8e067203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:50.609350 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd749574-9290-4a26-846a-d30a8e067203 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:50.609653 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd749574-9290-4a26-846a-d30a8e067203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:50.609936 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd749574-9290-4a26-846a-d30a8e067203 admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:50.610677 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd749574-9290-4a26-846a-d30a8e067203 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:50.612781 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd749574-9290-4a26-846a-d30a8e067203 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:50.636624 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:50.676453 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74f560-e946-4e01-97fc-2041787acf2f None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:50.691055 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 881/1760] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:20:50 2022] POST /identity/v3/projects => generated 383 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:50.692272 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe335085-16ee-4e64-903a-1a25629120c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:50.693519 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe335085-16ee-4e64-903a-1a25629120c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:50.693847 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe335085-16ee-4e64-903a-1a25629120c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:50.693847 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe335085-16ee-4e64-903a-1a25629120c8 admin admin] PATH_INFO: `/v3/users/4d997fe812fc4f789fd3a81fbe3689b6` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:50.695873 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe335085-16ee-4e64-903a-1a25629120c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d997fe812fc4f789fd3a81fbe3689b6)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:50.697767 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd749574-9290-4a26-846a-d30a8e067203 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:50.703658 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe335085-16ee-4e64-903a-1a25629120c8 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:50.783928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-fe335085-16ee-4e64-903a-1a25629120c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d997fe812fc4f789fd3a81fbe3689b6'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:50.784808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-fe335085-16ee-4e64-903a-1a25629120c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d997fe812fc4f789fd3a81fbe3689b6'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:50.814906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-fe335085-16ee-4e64-903a-1a25629120c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d997fe812fc4f789fd3a81fbe3689b6'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:50.816695 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-fe335085-16ee-4e64-903a-1a25629120c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d997fe812fc4f789fd3a81fbe3689b6'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:50.857284 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-fe335085-16ee-4e64-903a-1a25629120c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d997fe812fc4f789fd3a81fbe3689b6'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:50.892086 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd749574-9290-4a26-846a-d30a8e067203 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:50.896146 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 880/1761] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:20:50 2022] DELETE /identity/v3/users/4d997fe812fc4f789fd3a81fbe3689b6 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:50.906734 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b18f0-6814-486b-a9de-9fdb10d7cb71 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:50.908126 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b18f0-6814-486b-a9de-9fdb10d7cb71 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:50.908679 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b18f0-6814-486b-a9de-9fdb10d7cb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:50.972149 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-6b6b18f0-6814-486b-a9de-9fdb10d7cb71 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:50.973518 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-6b6b18f0-6814-486b-a9de-9fdb10d7cb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:51.079981 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6cd50-6f8c-4997-9033-09417c0a0eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:51.080936 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6cd50-6f8c-4997-9033-09417c0a0eca admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:51.081267 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6cd50-6f8c-4997-9033-09417c0a0eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:51.081596 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6cd50-6f8c-4997-9033-09417c0a0eca admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:51.083085 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6cd50-6f8c-4997-9033-09417c0a0eca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:51.087989 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6cd50-6f8c-4997-9033-09417c0a0eca admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:51.143393 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 882/1762] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:20:50 2022] POST /identity/v3/users => generated 298 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:51.158088 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6cd50-6f8c-4997-9033-09417c0a0eca admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:51.161404 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-20e6cd50-6f8c-4997-9033-09417c0a0eca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:51.186357 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 881/1763] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:51.195768 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6cd50-6f8c-4997-9033-09417c0a0eca admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:51.206580 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b18f0-6814-486b-a9de-9fdb10d7cb71 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:51.210504 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-6b6b18f0-6814-486b-a9de-9fdb10d7cb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:51.238406 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d21607-a0d1-4a85-988e-d93c288c4b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:51.241664 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d21607-a0d1-4a85-988e-d93c288c4b6e admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:51.243186 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d21607-a0d1-4a85-988e-d93c288c4b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:51.243547 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d21607-a0d1-4a85-988e-d93c288c4b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:51.245938 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d21607-a0d1-4a85-988e-d93c288c4b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:51.249768 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d21607-a0d1-4a85-988e-d93c288c4b6e admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:51.312227 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 883/1764] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:20:51.313610 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d21607-a0d1-4a85-988e-d93c288c4b6e admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:51.316095 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-c7d21607-a0d1-4a85-988e-d93c288c4b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:51.329491 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:51.342878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d21607-a0d1-4a85-988e-d93c288c4b6e admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:51.361763 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b18f0-6814-486b-a9de-9fdb10d7cb71 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:51.368297 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f77d04-8081-4a09-bb92-ae5ede5408a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:51.369086 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399223e-b0e3-4635-a75c-48bff391c1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:51.370596 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f77d04-8081-4a09-bb92-ae5ede5408a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:51.371150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f77d04-8081-4a09-bb92-ae5ede5408a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:51.371827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f77d04-8081-4a09-bb92-ae5ede5408a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:51.373073 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399223e-b0e3-4635-a75c-48bff391c1bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:51.373363 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399223e-b0e3-4635-a75c-48bff391c1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:51.375211 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399223e-b0e3-4635-a75c-48bff391c1bd admin admin] PATH_INFO: `/v3/projects/f9c6158c6a7d496b9352cf5ed1c9eca9` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:51.377982 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399223e-b0e3-4635-a75c-48bff391c1bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9c6158c6a7d496b9352cf5ed1c9eca9)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:51.383518 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399223e-b0e3-4635-a75c-48bff391c1bd admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:51.385818 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f77d04-8081-4a09-bb92-ae5ede5408a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:51.388022 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f77d04-8081-4a09-bb92-ae5ede5408a6 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:51.427430 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 882/1765] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:20:51.429464 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f77d04-8081-4a09-bb92-ae5ede5408a6 service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:51.443370 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f77d04-8081-4a09-bb92-ae5ede5408a6 service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:51.458152 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f453f5-54bf-4c84-b683-b1b63477e33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:51.462040 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f453f5-54bf-4c84-b683-b1b63477e33c admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:51.462194 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f453f5-54bf-4c84-b683-b1b63477e33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:51.462738 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f453f5-54bf-4c84-b683-b1b63477e33c admin admin] PATH_INFO: `/v3/projects/a582f97d2ecd45639084ef3a77998de9/users/63e23ebf3fb844b5830dbeaa50864d9d/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:51.506242 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f453f5-54bf-4c84-b683-b1b63477e33c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a582f97d2ecd45639084ef3a77998de9, user_id=63e23ebf3fb844b5830dbeaa50864d9d, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:51.509070 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f453f5-54bf-4c84-b683-b1b63477e33c admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:51.518799 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:51.554241 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 883/1766] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:20:51 2022] PUT /identity/v3/projects/a582f97d2ecd45639084ef3a77998de9/users/63e23ebf3fb844b5830dbeaa50864d9d/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:51.556573 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f453f5-54bf-4c84-b683-b1b63477e33c admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:51.559845 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-04f453f5-54bf-4c84-b683-b1b63477e33c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:51.567735 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a399223e-b0e3-4635-a75c-48bff391c1bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9c6158c6a7d496b9352cf5ed1c9eca9', 'request_id': 'req-a399223e-b0e3-4635-a75c-48bff391c1bd'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:51.591225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a399223e-b0e3-4635-a75c-48bff391c1bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9c6158c6a7d496b9352cf5ed1c9eca9', 'request_id': 'req-a399223e-b0e3-4635-a75c-48bff391c1bd'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:51.610201 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a399223e-b0e3-4635-a75c-48bff391c1bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9c6158c6a7d496b9352cf5ed1c9eca9', 'request_id': 'req-a399223e-b0e3-4635-a75c-48bff391c1bd'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:51.644796 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a399223e-b0e3-4635-a75c-48bff391c1bd admin admin] The token cache is being invalidate because project f9c6158c6a7d496b9352cf5ed1c9eca9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:20:51.645250 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a399223e-b0e3-4635-a75c-48bff391c1bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:51.647026 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a399223e-b0e3-4635-a75c-48bff391c1bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:51.659677 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 884/1767] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:20:51 2022] DELETE /identity/v3/projects/f9c6158c6a7d496b9352cf5ed1c9eca9 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:51.664695 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399223e-b0e3-4635-a75c-48bff391c1bd admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:51.668673 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-a399223e-b0e3-4635-a75c-48bff391c1bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:51.792747 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f453f5-54bf-4c84-b683-b1b63477e33c admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:51.803335 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a6023-335d-4389-b518-a501ac69ba05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:51.807325 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a6023-335d-4389-b518-a501ac69ba05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:51.807651 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a6023-335d-4389-b518-a501ac69ba05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:51.807940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a6023-335d-4389-b518-a501ac69ba05 admin admin] PATH_INFO: `/v3/users/b1de10ca63a64264bbef44c0197e3cdd` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:51.810515 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a6023-335d-4389-b518-a501ac69ba05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1de10ca63a64264bbef44c0197e3cdd)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:51.812533 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a6023-335d-4389-b518-a501ac69ba05 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:51.849127 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399223e-b0e3-4635-a75c-48bff391c1bd admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:51.866714 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fdd01-a412-4da3-8b3a-2bec9e1775e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:51.867706 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fdd01-a412-4da3-8b3a-2bec9e1775e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:51.867920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fdd01-a412-4da3-8b3a-2bec9e1775e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:51.868240 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fdd01-a412-4da3-8b3a-2bec9e1775e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:51.869198 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fdd01-a412-4da3-8b3a-2bec9e1775e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:51.876873 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fdd01-a412-4da3-8b3a-2bec9e1775e0 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:51.916873 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 885/1768] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:51.917886 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fdd01-a412-4da3-8b3a-2bec9e1775e0 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:51.922223 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-324fdd01-a412-4da3-8b3a-2bec9e1775e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:51.922854 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-8f9a6023-335d-4389-b518-a501ac69ba05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1de10ca63a64264bbef44c0197e3cdd'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:51.925996 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-8f9a6023-335d-4389-b518-a501ac69ba05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1de10ca63a64264bbef44c0197e3cdd'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:51.947760 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fdd01-a412-4da3-8b3a-2bec9e1775e0 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:51.959916 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-8f9a6023-335d-4389-b518-a501ac69ba05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1de10ca63a64264bbef44c0197e3cdd'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:51.961707 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-8f9a6023-335d-4389-b518-a501ac69ba05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1de10ca63a64264bbef44c0197e3cdd'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:51.964755 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986258df-fc2c-40da-a21f-7f6d5cc1b51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:51.965800 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986258df-fc2c-40da-a21f-7f6d5cc1b51b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:51.966090 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986258df-fc2c-40da-a21f-7f6d5cc1b51b admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:51.966465 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986258df-fc2c-40da-a21f-7f6d5cc1b51b admin admin] PATH_INFO: `/v3/users/19cef9d8d2d9428198172d946dd73ec7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:51.969458 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986258df-fc2c-40da-a21f-7f6d5cc1b51b admin admin] RBAC: Authorizing `identity:delete_user(user_id=19cef9d8d2d9428198172d946dd73ec7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:51.973204 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986258df-fc2c-40da-a21f-7f6d5cc1b51b admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:51.987477 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-8f9a6023-335d-4389-b518-a501ac69ba05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1de10ca63a64264bbef44c0197e3cdd'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:52.033788 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 884/1769] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:20:51 2022] DELETE /identity/v3/users/b1de10ca63a64264bbef44c0197e3cdd => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:52.035271 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a6023-335d-4389-b518-a501ac69ba05 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:52.042102 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-8f9a6023-335d-4389-b518-a501ac69ba05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:52.177376 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-986258df-fc2c-40da-a21f-7f6d5cc1b51b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19cef9d8d2d9428198172d946dd73ec7'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:52.178853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-986258df-fc2c-40da-a21f-7f6d5cc1b51b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19cef9d8d2d9428198172d946dd73ec7'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:52.255561 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-986258df-fc2c-40da-a21f-7f6d5cc1b51b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19cef9d8d2d9428198172d946dd73ec7'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:52.282548 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-986258df-fc2c-40da-a21f-7f6d5cc1b51b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19cef9d8d2d9428198172d946dd73ec7'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:52.283576 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-986258df-fc2c-40da-a21f-7f6d5cc1b51b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19cef9d8d2d9428198172d946dd73ec7'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:52.306630 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:52.322295 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 886/1770] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:20:51 2022] DELETE /identity/v3/users/19cef9d8d2d9428198172d946dd73ec7 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:52.325713 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e9b93-d5e8-4fa2-8ffa-249a47074814 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:52.325713 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e9b93-d5e8-4fa2-8ffa-249a47074814 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:52.325713 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e9b93-d5e8-4fa2-8ffa-249a47074814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:52.360446 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a6023-335d-4389-b518-a501ac69ba05 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:52.363931 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-e22e9b93-d5e8-4fa2-8ffa-249a47074814 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:52.365440 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-e22e9b93-d5e8-4fa2-8ffa-249a47074814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:52.415088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:52.510501 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931eb4fc-f943-4865-921b-9cd1beae6b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:52.525690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931eb4fc-f943-4865-921b-9cd1beae6b4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:52.526952 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931eb4fc-f943-4865-921b-9cd1beae6b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:52.527555 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931eb4fc-f943-4865-921b-9cd1beae6b4f admin admin] PATH_INFO: `/v3/projects/a582f97d2ecd45639084ef3a77998de9/users/63e23ebf3fb844b5830dbeaa50864d9d/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:52.545914 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931eb4fc-f943-4865-921b-9cd1beae6b4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a582f97d2ecd45639084ef3a77998de9, user_id=63e23ebf3fb844b5830dbeaa50864d9d, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:52.551427 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931eb4fc-f943-4865-921b-9cd1beae6b4f admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:52.553187 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 887/1771] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:52.578454 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 885/1772] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:20:52 2022] PUT /identity/v3/projects/a582f97d2ecd45639084ef3a77998de9/users/63e23ebf3fb844b5830dbeaa50864d9d/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:52.581640 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e9b93-d5e8-4fa2-8ffa-249a47074814 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:52.583345 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-e22e9b93-d5e8-4fa2-8ffa-249a47074814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:52.588886 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f44f7-a737-4529-bd3f-5881c9fc0cc6 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:52.591219 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f44f7-a737-4529-bd3f-5881c9fc0cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:52.591219 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f44f7-a737-4529-bd3f-5881c9fc0cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:52.636075 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-fc6f44f7-a737-4529-bd3f-5881c9fc0cc6 None None] MFA Rules not processed for user `63e23ebf3fb844b5830dbeaa50864d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:52.637750 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-fc6f44f7-a737-4529-bd3f-5881c9fc0cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:52.709047 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e9b93-d5e8-4fa2-8ffa-249a47074814 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:52.773854 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 886/1773] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:20:52.786891 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f44f7-a737-4529-bd3f-5881c9fc0cc6 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:52.788422 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-fc6f44f7-a737-4529-bd3f-5881c9fc0cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:52.846034 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be4b48-3407-49b6-aa58-896077aa76f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:52.846747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be4b48-3407-49b6-aa58-896077aa76f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:52.847046 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be4b48-3407-49b6-aa58-896077aa76f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:52.847380 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be4b48-3407-49b6-aa58-896077aa76f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:52.928443 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f44f7-a737-4529-bd3f-5881c9fc0cc6 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:52.939869 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f255452-cefb-4fbe-bb6f-1d8a70b20a77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:52.941423 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f255452-cefb-4fbe-bb6f-1d8a70b20a77 service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:52.946813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f255452-cefb-4fbe-bb6f-1d8a70b20a77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:52.947133 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f255452-cefb-4fbe-bb6f-1d8a70b20a77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:52.977415 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f255452-cefb-4fbe-bb6f-1d8a70b20a77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:52.981957 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f255452-cefb-4fbe-bb6f-1d8a70b20a77 service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:53.017470 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 887/1774] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:52 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:20:53.024417 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be4b48-3407-49b6-aa58-896077aa76f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:53.025508 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be4b48-3407-49b6-aa58-896077aa76f9 service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:53.038429 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 888/1775] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:20:53.202615 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f255452-cefb-4fbe-bb6f-1d8a70b20a77 service cinder] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:53.218322 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f255452-cefb-4fbe-bb6f-1d8a70b20a77 service cinder] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:53.222459 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c50a2c-01e1-4711-855e-af666b018770 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:53.223170 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c50a2c-01e1-4711-855e-af666b018770 service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:53.223479 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c50a2c-01e1-4711-855e-af666b018770 service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:53.223825 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c50a2c-01e1-4711-855e-af666b018770 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:53.229070 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-56c50a2c-01e1-4711-855e-af666b018770 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:53.346732 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:53.403149 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c50a2c-01e1-4711-855e-af666b018770 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:53.404536 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c50a2c-01e1-4711-855e-af666b018770 service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:53.459152 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 888/1776] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:20:53.977840 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be4b48-3407-49b6-aa58-896077aa76f9 service neutron] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:53.978806 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-90be4b48-3407-49b6-aa58-896077aa76f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:53.989282 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:54.001537 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be4b48-3407-49b6-aa58-896077aa76f9 service neutron] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:54.011003 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b9c33-f8e0-4a6f-8d2a-c979520664b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:54.012032 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b9c33-f8e0-4a6f-8d2a-c979520664b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:54.012320 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b9c33-f8e0-4a6f-8d2a-c979520664b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:54.012630 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b9c33-f8e0-4a6f-8d2a-c979520664b8 admin admin] PATH_INFO: `/v3/projects/4c0d8d66ee5140b09be5e92976b85ecd` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:54.022274 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b9c33-f8e0-4a6f-8d2a-c979520664b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c0d8d66ee5140b09be5e92976b85ecd)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:54.030527 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b9c33-f8e0-4a6f-8d2a-c979520664b8 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:54.172195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2f736-b1ab-4e1c-8ce7-c1dbcc37407d None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:54.172521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2f736-b1ab-4e1c-8ce7-c1dbcc37407d None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:54.172874 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2f736-b1ab-4e1c-8ce7-c1dbcc37407d None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:54.174578 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 889/1777] 10.222.0.13 () {54 vars in 921 bytes} [Wed Jun 29 12:20:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:20:54.211959 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-016b9c33-f8e0-4a6f-8d2a-c979520664b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c0d8d66ee5140b09be5e92976b85ecd', 'request_id': 'req-016b9c33-f8e0-4a6f-8d2a-c979520664b8'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:54.227611 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-016b9c33-f8e0-4a6f-8d2a-c979520664b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c0d8d66ee5140b09be5e92976b85ecd', 'request_id': 'req-016b9c33-f8e0-4a6f-8d2a-c979520664b8'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:54.252808 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-016b9c33-f8e0-4a6f-8d2a-c979520664b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c0d8d66ee5140b09be5e92976b85ecd', 'request_id': 'req-016b9c33-f8e0-4a6f-8d2a-c979520664b8'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:54.284336 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-016b9c33-f8e0-4a6f-8d2a-c979520664b8 admin admin] The token cache is being invalidate because project 4c0d8d66ee5140b09be5e92976b85ecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:20:54.286080 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-016b9c33-f8e0-4a6f-8d2a-c979520664b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:54.289944 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-016b9c33-f8e0-4a6f-8d2a-c979520664b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:54.293139 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40412e9e-f7b5-43d5-9ae8-60a8c4ba6c2a None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:54.293432 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40412e9e-f7b5-43d5-9ae8-60a8c4ba6c2a None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:54.293720 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40412e9e-f7b5-43d5-9ae8-60a8c4ba6c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:54.309266 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 889/1778] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:20:53 2022] DELETE /identity/v3/projects/4c0d8d66ee5140b09be5e92976b85ecd => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:54.315558 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53393e7e-8ccd-4b65-bb1f-f324a39e080a None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:54.315842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53393e7e-8ccd-4b65-bb1f-f324a39e080a None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:54.316116 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53393e7e-8ccd-4b65-bb1f-f324a39e080a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:54.359647 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-40412e9e-f7b5-43d5-9ae8-60a8c4ba6c2a None None] MFA Rules not processed for user `3fbcf547421b42e4b520f9246326bff8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:54.362178 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-40412e9e-f7b5-43d5-9ae8-60a8c4ba6c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:54.372596 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-53393e7e-8ccd-4b65-bb1f-f324a39e080a None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:54.374187 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-53393e7e-8ccd-4b65-bb1f-f324a39e080a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:54.515162 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 890/1779] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:54.518007 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53393e7e-8ccd-4b65-bb1f-f324a39e080a None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:54.525823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-53393e7e-8ccd-4b65-bb1f-f324a39e080a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:54.546053 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53393e7e-8ccd-4b65-bb1f-f324a39e080a None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:54.561244 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a4862-37e9-400a-8fc3-029f0a7249c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:54.564119 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a4862-37e9-400a-8fc3-029f0a7249c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:54.564445 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a4862-37e9-400a-8fc3-029f0a7249c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:54.564677 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a4862-37e9-400a-8fc3-029f0a7249c2 admin admin] PATH_INFO: `/v3/projects/c08a6c43117f4feb9fdcb1cef9de47e7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:54.565713 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 890/1780] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Jun 29 12:20:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:54.568024 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a4862-37e9-400a-8fc3-029f0a7249c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c08a6c43117f4feb9fdcb1cef9de47e7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:54.570009 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a4862-37e9-400a-8fc3-029f0a7249c2 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:54.572299 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42890dd3-a53a-41ec-a5d6-95d220d81a80 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:54.572624 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42890dd3-a53a-41ec-a5d6-95d220d81a80 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:54.572955 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42890dd3-a53a-41ec-a5d6-95d220d81a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:54.607486 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-42890dd3-a53a-41ec-a5d6-95d220d81a80 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:54.609152 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-42890dd3-a53a-41ec-a5d6-95d220d81a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:54.630452 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 891/1781] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:54.635501 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42890dd3-a53a-41ec-a5d6-95d220d81a80 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:54.635501 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-42890dd3-a53a-41ec-a5d6-95d220d81a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:54.666599 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-778a4862-37e9-400a-8fc3-029f0a7249c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c08a6c43117f4feb9fdcb1cef9de47e7', 'request_id': 'req-778a4862-37e9-400a-8fc3-029f0a7249c2'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:54.674575 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-778a4862-37e9-400a-8fc3-029f0a7249c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c08a6c43117f4feb9fdcb1cef9de47e7', 'request_id': 'req-778a4862-37e9-400a-8fc3-029f0a7249c2'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:54.682733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-778a4862-37e9-400a-8fc3-029f0a7249c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c08a6c43117f4feb9fdcb1cef9de47e7', 'request_id': 'req-778a4862-37e9-400a-8fc3-029f0a7249c2'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:54.683697 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42890dd3-a53a-41ec-a5d6-95d220d81a80 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:54.711609 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-778a4862-37e9-400a-8fc3-029f0a7249c2 admin admin] The token cache is being invalidate because project c08a6c43117f4feb9fdcb1cef9de47e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:20:54.711824 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-778a4862-37e9-400a-8fc3-029f0a7249c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:54.712570 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-778a4862-37e9-400a-8fc3-029f0a7249c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:54.714807 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 891/1782] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:20:54 2022] DELETE /identity/v3/projects/c08a6c43117f4feb9fdcb1cef9de47e7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:54.715578 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a4862-37e9-400a-8fc3-029f0a7249c2 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:54.717803 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-778a4862-37e9-400a-8fc3-029f0a7249c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:54.745265 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:54.831929 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0670af-b029-4d4f-8231-5bbee39feb2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:54.833442 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0670af-b029-4d4f-8231-5bbee39feb2b service nova] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:54.834069 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0670af-b029-4d4f-8231-5bbee39feb2b service nova] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:54.834612 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0670af-b029-4d4f-8231-5bbee39feb2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:54.839078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-0d0670af-b029-4d4f-8231-5bbee39feb2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:54.865600 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0670af-b029-4d4f-8231-5bbee39feb2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:54.866458 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a4862-37e9-400a-8fc3-029f0a7249c2 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:54.869101 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0670af-b029-4d4f-8231-5bbee39feb2b service nova] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:54.883262 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7e25c-d7f3-43a5-ab6f-aaaa96acf4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:54.884906 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7e25c-d7f3-43a5-ab6f-aaaa96acf4c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:54.886962 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7e25c-d7f3-43a5-ab6f-aaaa96acf4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:54.887534 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7e25c-d7f3-43a5-ab6f-aaaa96acf4c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:54.889923 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7e25c-d7f3-43a5-ab6f-aaaa96acf4c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:20:54.889923 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7e25c-d7f3-43a5-ab6f-aaaa96acf4c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:54.894960 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7e25c-d7f3-43a5-ab6f-aaaa96acf4c5 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:54.926179 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 892/1783] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:20:54.931269 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0670af-b029-4d4f-8231-5bbee39feb2b service nova] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:54.938534 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-0d0670af-b029-4d4f-8231-5bbee39feb2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:54.951783 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 892/1784] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:20:54.951783 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7e25c-d7f3-43a5-ab6f-aaaa96acf4c5 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:54.957621 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-6ab7e25c-d7f3-43a5-ab6f-aaaa96acf4c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:54.981882 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7e25c-d7f3-43a5-ab6f-aaaa96acf4c5 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:55.002134 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd3396-b5e7-4f6a-af7c-940492bf7aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:55.003061 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd3396-b5e7-4f6a-af7c-940492bf7aac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:55.003344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd3396-b5e7-4f6a-af7c-940492bf7aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:55.003625 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd3396-b5e7-4f6a-af7c-940492bf7aac admin admin] PATH_INFO: `/v3/projects/d2e93b078dc943908c3e79a9170fb46a` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:55.005275 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd3396-b5e7-4f6a-af7c-940492bf7aac admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2e93b078dc943908c3e79a9170fb46a)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:55.007257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd3396-b5e7-4f6a-af7c-940492bf7aac admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:55.014902 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0670af-b029-4d4f-8231-5bbee39feb2b service nova] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:55.032473 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ab8a5-032c-48e1-96d4-058aa8f69d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:55.033592 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ab8a5-032c-48e1-96d4-058aa8f69d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:55.034586 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ab8a5-032c-48e1-96d4-058aa8f69d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:55.034876 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ab8a5-032c-48e1-96d4-058aa8f69d57 admin admin] PATH_INFO: `/v3/users/b63204f2b5bc492a87ea2094b55b57d3` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:55.036728 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ab8a5-032c-48e1-96d4-058aa8f69d57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b63204f2b5bc492a87ea2094b55b57d3)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:55.042073 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ab8a5-032c-48e1-96d4-058aa8f69d57 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:55.170401 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a7bd3396-b5e7-4f6a-af7c-940492bf7aac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2e93b078dc943908c3e79a9170fb46a', 'request_id': 'req-a7bd3396-b5e7-4f6a-af7c-940492bf7aac'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:55.188567 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a7bd3396-b5e7-4f6a-af7c-940492bf7aac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2e93b078dc943908c3e79a9170fb46a', 'request_id': 'req-a7bd3396-b5e7-4f6a-af7c-940492bf7aac'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:55.195920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d06ab8a5-032c-48e1-96d4-058aa8f69d57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b63204f2b5bc492a87ea2094b55b57d3'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:55.196749 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d06ab8a5-032c-48e1-96d4-058aa8f69d57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b63204f2b5bc492a87ea2094b55b57d3'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:55.204287 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:55.213731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a7bd3396-b5e7-4f6a-af7c-940492bf7aac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2e93b078dc943908c3e79a9170fb46a', 'request_id': 'req-a7bd3396-b5e7-4f6a-af7c-940492bf7aac'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:55.240764 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d06ab8a5-032c-48e1-96d4-058aa8f69d57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b63204f2b5bc492a87ea2094b55b57d3'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:55.241558 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a7bd3396-b5e7-4f6a-af7c-940492bf7aac admin admin] The token cache is being invalidate because project d2e93b078dc943908c3e79a9170fb46a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:20:55.242445 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a7bd3396-b5e7-4f6a-af7c-940492bf7aac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:55.242814 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d06ab8a5-032c-48e1-96d4-058aa8f69d57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b63204f2b5bc492a87ea2094b55b57d3'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:55.246782 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a7bd3396-b5e7-4f6a-af7c-940492bf7aac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:55.248726 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 893/1785] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:20:54 2022] DELETE /identity/v3/projects/d2e93b078dc943908c3e79a9170fb46a => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:55.249536 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd3396-b5e7-4f6a-af7c-940492bf7aac admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:55.252220 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-a7bd3396-b5e7-4f6a-af7c-940492bf7aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:55.268414 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d06ab8a5-032c-48e1-96d4-058aa8f69d57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b63204f2b5bc492a87ea2094b55b57d3'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:55.342670 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 893/1786] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:20:54 2022] DELETE /identity/v3/users/b63204f2b5bc492a87ea2094b55b57d3 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:55.342670 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ab8a5-032c-48e1-96d4-058aa8f69d57 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:55.343773 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-d06ab8a5-032c-48e1-96d4-058aa8f69d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:55.393144 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd3396-b5e7-4f6a-af7c-940492bf7aac admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:55.465733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:55.521393 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ab8a5-032c-48e1-96d4-058aa8f69d57 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:55.544183 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ae109-af2b-4e20-bc18-a58e8a4a3828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:55.546172 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ae109-af2b-4e20-bc18-a58e8a4a3828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:55.548213 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ae109-af2b-4e20-bc18-a58e8a4a3828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:55.549522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ae109-af2b-4e20-bc18-a58e8a4a3828 admin admin] PATH_INFO: `/v3/users/d862ee522bfb453b88bd3161d8ed890a` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:55.559545 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ae109-af2b-4e20-bc18-a58e8a4a3828 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d862ee522bfb453b88bd3161d8ed890a)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:55.567353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ae109-af2b-4e20-bc18-a58e8a4a3828 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:55.569364 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea060899-a1c1-437c-aaa0-04b5c6a5d49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:55.576287 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea060899-a1c1-437c-aaa0-04b5c6a5d49f admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:55.576719 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea060899-a1c1-437c-aaa0-04b5c6a5d49f admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:55.577105 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea060899-a1c1-437c-aaa0-04b5c6a5d49f admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:55.578066 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea060899-a1c1-437c-aaa0-04b5c6a5d49f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:55.580416 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea060899-a1c1-437c-aaa0-04b5c6a5d49f admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:55.674954 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 894/1787] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:20:55 2022] POST /identity/v3/projects => generated 371 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:55.674954 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea060899-a1c1-437c-aaa0-04b5c6a5d49f admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:55.699648 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d76ae109-af2b-4e20-bc18-a58e8a4a3828 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd862ee522bfb453b88bd3161d8ed890a'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:55.701406 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d76ae109-af2b-4e20-bc18-a58e8a4a3828 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd862ee522bfb453b88bd3161d8ed890a'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:55.755276 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d76ae109-af2b-4e20-bc18-a58e8a4a3828 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd862ee522bfb453b88bd3161d8ed890a'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:55.756128 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d76ae109-af2b-4e20-bc18-a58e8a4a3828 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd862ee522bfb453b88bd3161d8ed890a'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:55.772980 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d76ae109-af2b-4e20-bc18-a58e8a4a3828 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd862ee522bfb453b88bd3161d8ed890a'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:55.811042 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 894/1788] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:20:55 2022] DELETE /identity/v3/users/d862ee522bfb453b88bd3161d8ed890a => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:55.949238 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea060899-a1c1-437c-aaa0-04b5c6a5d49f admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:56.099080 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08664f-d3b4-4a9a-bd65-84d12c218868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:56.102124 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08664f-d3b4-4a9a-bd65-84d12c218868 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:56.102388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08664f-d3b4-4a9a-bd65-84d12c218868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:56.102734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08664f-d3b4-4a9a-bd65-84d12c218868 admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:56.106705 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08664f-d3b4-4a9a-bd65-84d12c218868 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:56.109464 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08664f-d3b4-4a9a-bd65-84d12c218868 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:56.178169 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 895/1789] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:20:55 2022] POST /identity/v3/users => generated 286 bytes in 505 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:56.183159 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ae109-af2b-4e20-bc18-a58e8a4a3828 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:56.185408 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-d76ae109-af2b-4e20-bc18-a58e8a4a3828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:56.210230 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ae109-af2b-4e20-bc18-a58e8a4a3828 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:56.224288 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546fce2-657e-4d9c-a341-0b4c6ac1c18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:56.225357 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546fce2-657e-4d9c-a341-0b4c6ac1c18e admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:56.227241 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546fce2-657e-4d9c-a341-0b4c6ac1c18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:56.227840 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546fce2-657e-4d9c-a341-0b4c6ac1c18e admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:56.229482 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546fce2-657e-4d9c-a341-0b4c6ac1c18e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:56.234387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546fce2-657e-4d9c-a341-0b4c6ac1c18e admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:56.260172 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 895/1790] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:56.263261 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08664f-d3b4-4a9a-bd65-84d12c218868 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:56.286373 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08664f-d3b4-4a9a-bd65-84d12c218868 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:56.303721 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446165ad-3e1a-40d6-baca-5fb6c1ac8a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:56.306230 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446165ad-3e1a-40d6-baca-5fb6c1ac8a72 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:56.307325 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446165ad-3e1a-40d6-baca-5fb6c1ac8a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:56.307850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446165ad-3e1a-40d6-baca-5fb6c1ac8a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:56.309993 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446165ad-3e1a-40d6-baca-5fb6c1ac8a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:56.315388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446165ad-3e1a-40d6-baca-5fb6c1ac8a72 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:56.362197 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546fce2-657e-4d9c-a341-0b4c6ac1c18e admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:56.373653 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546fce2-657e-4d9c-a341-0b4c6ac1c18e admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:56.382085 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 896/1791] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:56.393213 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a9c44-de81-4770-8078-3d5f25af6e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:56.394564 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a9c44-de81-4770-8078-3d5f25af6e7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:56.394913 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a9c44-de81-4770-8078-3d5f25af6e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:56.395198 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a9c44-de81-4770-8078-3d5f25af6e7b admin admin] PATH_INFO: `/v3/projects/c1f7eb1c717a495ab62cad694aea910e/users/936341a7e8704a89b9e6129fd38394ba/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:56.423949 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a9c44-de81-4770-8078-3d5f25af6e7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1f7eb1c717a495ab62cad694aea910e, user_id=936341a7e8704a89b9e6129fd38394ba, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:56.426888 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a9c44-de81-4770-8078-3d5f25af6e7b admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:56.458257 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 896/1792] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:20:56 2022] PUT /identity/v3/projects/c1f7eb1c717a495ab62cad694aea910e/users/936341a7e8704a89b9e6129fd38394ba/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:56.467842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae41d79-cdac-4673-9b23-3d8f022600ab None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:56.468270 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae41d79-cdac-4673-9b23-3d8f022600ab None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:56.468695 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae41d79-cdac-4673-9b23-3d8f022600ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:56.556924 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-eae41d79-cdac-4673-9b23-3d8f022600ab None None] MFA Rules not processed for user `936341a7e8704a89b9e6129fd38394ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:56.558900 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-eae41d79-cdac-4673-9b23-3d8f022600ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:56.637268 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:56.698100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a9c44-de81-4770-8078-3d5f25af6e7b admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:56.726033 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 897/1793] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:56.736455 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:56.826457 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a9c44-de81-4770-8078-3d5f25af6e7b admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:56.832818 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9e9e7-2556-4edb-b6bb-a9dc619bce39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:56.833913 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9e9e7-2556-4edb-b6bb-a9dc619bce39 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:56.834314 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9e9e7-2556-4edb-b6bb-a9dc619bce39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:56.834842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9e9e7-2556-4edb-b6bb-a9dc619bce39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:56.836694 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9e9e7-2556-4edb-b6bb-a9dc619bce39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:56.839407 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9e9e7-2556-4edb-b6bb-a9dc619bce39 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:56.947358 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae41d79-cdac-4673-9b23-3d8f022600ab None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:56.948348 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 897/1794] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:20:56 2022] POST /identity/v3/projects => generated 373 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:20:56.957745 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9e9e7-2556-4edb-b6bb-a9dc619bce39 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:56.959981 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-a8e9e9e7-2556-4edb-b6bb-a9dc619bce39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:56.966991 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae41d79-cdac-4673-9b23-3d8f022600ab None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:57.123552 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9e9e7-2556-4edb-b6bb-a9dc619bce39 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:57.129562 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db5cde-feb0-4a8f-ad38-3277af621213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:57.130878 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db5cde-feb0-4a8f-ad38-3277af621213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:57.132084 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db5cde-feb0-4a8f-ad38-3277af621213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:57.132709 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db5cde-feb0-4a8f-ad38-3277af621213 admin admin] PATH_INFO: `/v3/users/b96bdd082c124b60a6ab5b5285c13ef9` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:57.135290 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db5cde-feb0-4a8f-ad38-3277af621213 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b96bdd082c124b60a6ab5b5285c13ef9)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:57.137786 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db5cde-feb0-4a8f-ad38-3277af621213 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:57.195840 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a0a50-84f2-420d-be82-7461803bb6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:57.196976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a0a50-84f2-420d-be82-7461803bb6d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:57.197330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a0a50-84f2-420d-be82-7461803bb6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:57.198118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a0a50-84f2-420d-be82-7461803bb6d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:57.200799 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a0a50-84f2-420d-be82-7461803bb6d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:57.205014 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a0a50-84f2-420d-be82-7461803bb6d6 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:57.291296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-99db5cde-feb0-4a8f-ad38-3277af621213 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b96bdd082c124b60a6ab5b5285c13ef9'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:57.298821 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-99db5cde-feb0-4a8f-ad38-3277af621213 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b96bdd082c124b60a6ab5b5285c13ef9'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:57.300616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 898/1795] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:20:56 2022] POST /identity/v3/users => generated 293 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:57.306800 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a0a50-84f2-420d-be82-7461803bb6d6 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:57.309922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-750a0a50-84f2-420d-be82-7461803bb6d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:57.331650 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-99db5cde-feb0-4a8f-ad38-3277af621213 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b96bdd082c124b60a6ab5b5285c13ef9'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:57.332474 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-99db5cde-feb0-4a8f-ad38-3277af621213 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b96bdd082c124b60a6ab5b5285c13ef9'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:57.339126 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a0a50-84f2-420d-be82-7461803bb6d6 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:57.353953 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-99db5cde-feb0-4a8f-ad38-3277af621213 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b96bdd082c124b60a6ab5b5285c13ef9'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:57.362228 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61e53a-8a25-4a7d-9558-67c6e2e1263a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:57.365586 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61e53a-8a25-4a7d-9558-67c6e2e1263a admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:57.367235 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61e53a-8a25-4a7d-9558-67c6e2e1263a admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:57.367533 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61e53a-8a25-4a7d-9558-67c6e2e1263a admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:57.370521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61e53a-8a25-4a7d-9558-67c6e2e1263a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:57.377799 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61e53a-8a25-4a7d-9558-67c6e2e1263a admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:57.397585 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 898/1796] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:20:56 2022] DELETE /identity/v3/users/b96bdd082c124b60a6ab5b5285c13ef9 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:57.404727 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e967e86-e7f6-4466-b1f7-44dd21eab01e None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:57.405282 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e967e86-e7f6-4466-b1f7-44dd21eab01e None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:57.405575 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e967e86-e7f6-4466-b1f7-44dd21eab01e None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:57.430063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 899/1798] 10.222.0.13 () {54 vars in 921 bytes} [Wed Jun 29 12:20:57 2022] GET /identity => generated 270 bytes in 27 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:20:57.431676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a2e68-f814-4aec-b049-b93722bad28d None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:57.431968 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a2e68-f814-4aec-b049-b93722bad28d None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:57.432251 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a2e68-f814-4aec-b049-b93722bad28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:57.434431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 899/1798] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:20:57.438611 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61e53a-8a25-4a7d-9558-67c6e2e1263a admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:57.464287 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61e53a-8a25-4a7d-9558-67c6e2e1263a admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:57.503897 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-821a2e68-f814-4aec-b049-b93722bad28d None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:57.505148 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-821a2e68-f814-4aec-b049-b93722bad28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:57.559670 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:57.634766 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1c76b-9b77-4791-8b35-e7f0981e9bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:57.636864 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1c76b-9b77-4791-8b35-e7f0981e9bef admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:57.637372 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1c76b-9b77-4791-8b35-e7f0981e9bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:57.638502 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1c76b-9b77-4791-8b35-e7f0981e9bef admin admin] PATH_INFO: `/v3/projects/2a110561bfd34b838dd5393350889da3/users/f1964eb87ecf4d6a898426b8e422d72a/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:57.686078 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1c76b-9b77-4791-8b35-e7f0981e9bef admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a110561bfd34b838dd5393350889da3, user_id=f1964eb87ecf4d6a898426b8e422d72a, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:57.691233 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1c76b-9b77-4791-8b35-e7f0981e9bef admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:57.720704 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 900/1799] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:20:57 2022] PUT /identity/v3/projects/2a110561bfd34b838dd5393350889da3/users/f1964eb87ecf4d6a898426b8e422d72a/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:57.735713 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b582d1-ade0-4de1-9172-d6757758caa5 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:57.736009 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b582d1-ade0-4de1-9172-d6757758caa5 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:57.736289 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b582d1-ade0-4de1-9172-d6757758caa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:57.777147 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-45b582d1-ade0-4de1-9172-d6757758caa5 None None] MFA Rules not processed for user `3fbcf547421b42e4b520f9246326bff8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:57.778376 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-45b582d1-ade0-4de1-9172-d6757758caa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:57.779745 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 900/1800] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:57.789257 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a2e68-f814-4aec-b049-b93722bad28d None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:57.802825 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-821a2e68-f814-4aec-b049-b93722bad28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:57.840478 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a2e68-f814-4aec-b049-b93722bad28d None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:57.870298 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:57.990283 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 901/1801] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Jun 29 12:20:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:57.990283 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b582d1-ade0-4de1-9172-d6757758caa5 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:57.998360 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ae0fa-b67c-4b00-8f98-288174d1a71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:57.999571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ae0fa-b67c-4b00-8f98-288174d1a71e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:57.999904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ae0fa-b67c-4b00-8f98-288174d1a71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:58.000138 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ae0fa-b67c-4b00-8f98-288174d1a71e admin admin] PATH_INFO: `/v3/projects/a6f5d9293d534ba69502d08ec9538916` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:58.003583 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ae0fa-b67c-4b00-8f98-288174d1a71e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6f5d9293d534ba69502d08ec9538916)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:58.006772 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ae0fa-b67c-4b00-8f98-288174d1a71e admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:58.140452 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b582d1-ade0-4de1-9172-d6757758caa5 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:58.143194 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ef7ae0fa-b67c-4b00-8f98-288174d1a71e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6f5d9293d534ba69502d08ec9538916', 'request_id': 'req-ef7ae0fa-b67c-4b00-8f98-288174d1a71e'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:58.160078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ef7ae0fa-b67c-4b00-8f98-288174d1a71e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6f5d9293d534ba69502d08ec9538916', 'request_id': 'req-ef7ae0fa-b67c-4b00-8f98-288174d1a71e'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:58.179113 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ef7ae0fa-b67c-4b00-8f98-288174d1a71e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6f5d9293d534ba69502d08ec9538916', 'request_id': 'req-ef7ae0fa-b67c-4b00-8f98-288174d1a71e'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:58.208352 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ef7ae0fa-b67c-4b00-8f98-288174d1a71e admin admin] The token cache is being invalidate because project a6f5d9293d534ba69502d08ec9538916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:20:58.208662 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ef7ae0fa-b67c-4b00-8f98-288174d1a71e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:58.211521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ef7ae0fa-b67c-4b00-8f98-288174d1a71e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:58.217787 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 901/1802] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:20:57 2022] DELETE /identity/v3/projects/a6f5d9293d534ba69502d08ec9538916 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:58.217787 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ae0fa-b67c-4b00-8f98-288174d1a71e admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:58.221072 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-ef7ae0fa-b67c-4b00-8f98-288174d1a71e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:58.278205 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48668f-200b-4f3f-9e69-2772ef1553a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:58.278973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48668f-200b-4f3f-9e69-2772ef1553a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:58.279283 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48668f-200b-4f3f-9e69-2772ef1553a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:58.279596 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48668f-200b-4f3f-9e69-2772ef1553a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:58.281374 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48668f-200b-4f3f-9e69-2772ef1553a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:58.283625 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48668f-200b-4f3f-9e69-2772ef1553a2 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:58.304981 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 902/1803] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:58.306489 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91b9ff-f4f3-4c6f-b83a-897e6e9679e7 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:58.306985 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91b9ff-f4f3-4c6f-b83a-897e6e9679e7 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:58.307287 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91b9ff-f4f3-4c6f-b83a-897e6e9679e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:58.345054 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-9f91b9ff-f4f3-4c6f-b83a-897e6e9679e7 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:58.346202 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:58.346536 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-9f91b9ff-f4f3-4c6f-b83a-897e6e9679e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:58.365851 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ae0fa-b67c-4b00-8f98-288174d1a71e admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:58.377653 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 903/1804] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:58.377843 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ecba4-6956-4f42-b231-960cef7ab71e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:58.378671 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ecba4-6956-4f42-b231-960cef7ab71e service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:58.378774 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91b9ff-f4f3-4c6f-b83a-897e6e9679e7 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:58.378875 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ecba4-6956-4f42-b231-960cef7ab71e service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:58.379383 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ecba4-6956-4f42-b231-960cef7ab71e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:58.381077 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-272ecba4-6956-4f42-b231-960cef7ab71e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:58.384943 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-9f91b9ff-f4f3-4c6f-b83a-897e6e9679e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:58.408412 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91b9ff-f4f3-4c6f-b83a-897e6e9679e7 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:58.425261 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ecba4-6956-4f42-b231-960cef7ab71e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:58.425261 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ecba4-6956-4f42-b231-960cef7ab71e service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:58.429077 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d898418-243d-4b60-b217-975d79ae9428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:58.430609 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d898418-243d-4b60-b217-975d79ae9428 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:58.430931 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d898418-243d-4b60-b217-975d79ae9428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:58.431464 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d898418-243d-4b60-b217-975d79ae9428 admin admin] PATH_INFO: `/v3/projects/2a110561bfd34b838dd5393350889da3/users/f1964eb87ecf4d6a898426b8e422d72a/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:58.433778 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d898418-243d-4b60-b217-975d79ae9428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a110561bfd34b838dd5393350889da3, user_id=f1964eb87ecf4d6a898426b8e422d72a, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:58.437155 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d898418-243d-4b60-b217-975d79ae9428 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:58.440631 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 902/1805] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:20:58.442216 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6643674-94cd-4fe9-8ffa-86bd2214c9af None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:58.442746 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6643674-94cd-4fe9-8ffa-86bd2214c9af None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:58.443040 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6643674-94cd-4fe9-8ffa-86bd2214c9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:58.476917 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 904/1806] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:20:58 2022] PUT /identity/v3/projects/2a110561bfd34b838dd5393350889da3/users/f1964eb87ecf4d6a898426b8e422d72a/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:58.478092 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d898418-243d-4b60-b217-975d79ae9428 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:58.484694 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-8d898418-243d-4b60-b217-975d79ae9428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:58.488220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-c6643674-94cd-4fe9-8ffa-86bd2214c9af None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:58.491321 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-c6643674-94cd-4fe9-8ffa-86bd2214c9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:58.639313 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 903/1807] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:58.643267 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff1936-1aaa-4ece-bbdc-e573e492ddb4 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:58.643564 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff1936-1aaa-4ece-bbdc-e573e492ddb4 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:58.643849 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff1936-1aaa-4ece-bbdc-e573e492ddb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:58.646023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:58.692153 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d898418-243d-4b60-b217-975d79ae9428 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:58.702401 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf437ca1-44ee-4823-b53f-94c3f8ec05ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:58.703606 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf437ca1-44ee-4823-b53f-94c3f8ec05ea service nova] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:58.704031 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf437ca1-44ee-4823-b53f-94c3f8ec05ea service nova] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:58.705621 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf437ca1-44ee-4823-b53f-94c3f8ec05ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:58.707040 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-ccff1936-1aaa-4ece-bbdc-e573e492ddb4 None None] MFA Rules not processed for user `f1964eb87ecf4d6a898426b8e422d72a`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:58.707937 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-cf437ca1-44ee-4823-b53f-94c3f8ec05ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:58.710390 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-ccff1936-1aaa-4ece-bbdc-e573e492ddb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:58.726917 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf437ca1-44ee-4823-b53f-94c3f8ec05ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:58.728596 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf437ca1-44ee-4823-b53f-94c3f8ec05ea service nova] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:58.752474 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 905/1808] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:20:58.753542 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf437ca1-44ee-4823-b53f-94c3f8ec05ea service nova] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:58.772993 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf437ca1-44ee-4823-b53f-94c3f8ec05ea service nova] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:58.780719 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de498f5-3248-44c3-b95e-0499a4c6f822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:58.781465 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de498f5-3248-44c3-b95e-0499a4c6f822 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:58.781756 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de498f5-3248-44c3-b95e-0499a4c6f822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:58.782037 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de498f5-3248-44c3-b95e-0499a4c6f822 admin admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:58.785072 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de498f5-3248-44c3-b95e-0499a4c6f822 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:20:58.785403 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de498f5-3248-44c3-b95e-0499a4c6f822 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:58.790336 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de498f5-3248-44c3-b95e-0499a4c6f822 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:58.827296 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 906/1809] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:20:58.831388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de498f5-3248-44c3-b95e-0499a4c6f822 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:58.844979 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de498f5-3248-44c3-b95e-0499a4c6f822 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:58.852431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31760b-ab86-4d87-bb39-dc7c92d519aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:58.853382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31760b-ab86-4d87-bb39-dc7c92d519aa admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:58.853804 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31760b-ab86-4d87-bb39-dc7c92d519aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:58.854154 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31760b-ab86-4d87-bb39-dc7c92d519aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:58.854970 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b31760b-ab86-4d87-bb39-dc7c92d519aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:58.857224 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b31760b-ab86-4d87-bb39-dc7c92d519aa admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:58.903019 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 904/1810] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:58.909594 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff1936-1aaa-4ece-bbdc-e573e492ddb4 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:58.916968 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-ccff1936-1aaa-4ece-bbdc-e573e492ddb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:58.921571 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 907/1811] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:20:58 2022] POST /identity/v3/projects => generated 365 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:20:58.926066 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31760b-ab86-4d87-bb39-dc7c92d519aa admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:59.021977 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff1936-1aaa-4ece-bbdc-e573e492ddb4 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:59.106619 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:59.109916 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31760b-ab86-4d87-bb39-dc7c92d519aa admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:59.126260 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ecf71-b9f6-449d-bef8-34777d6d8dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:59.126669 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ecf71-b9f6-449d-bef8-34777d6d8dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:59.126669 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ecf71-b9f6-449d-bef8-34777d6d8dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:59.129649 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ecf71-b9f6-449d-bef8-34777d6d8dd6 admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:59.130472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ecf71-b9f6-449d-bef8-34777d6d8dd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:59.141853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ecf71-b9f6-449d-bef8-34777d6d8dd6 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:59.174311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ffe55-9f93-4409-8eac-68dc04339712 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:59.175100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ffe55-9f93-4409-8eac-68dc04339712 service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:59.175371 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ffe55-9f93-4409-8eac-68dc04339712 service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:59.175655 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ffe55-9f93-4409-8eac-68dc04339712 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:59.192077 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 908/1812] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:20:58 2022] POST /identity/v3/users => generated 283 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:20:59.192968 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ecf71-b9f6-449d-bef8-34777d6d8dd6 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:59.199280 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-bf6ecf71-b9f6-449d-bef8-34777d6d8dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:59.243850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ecf71-b9f6-449d-bef8-34777d6d8dd6 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:59.270424 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3a1d7-1cdd-4733-9748-40e68347ef27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:59.271579 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3a1d7-1cdd-4733-9748-40e68347ef27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:59.272053 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3a1d7-1cdd-4733-9748-40e68347ef27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:59.272542 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3a1d7-1cdd-4733-9748-40e68347ef27 admin admin] PATH_INFO: `/v3/projects/9221d923db6b489e82092548b510b018` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:59.275079 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3a1d7-1cdd-4733-9748-40e68347ef27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9221d923db6b489e82092548b510b018)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:59.277392 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3a1d7-1cdd-4733-9748-40e68347ef27 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:59.376284 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ffe55-9f93-4409-8eac-68dc04339712 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:59.378728 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ffe55-9f93-4409-8eac-68dc04339712 service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:59.416500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 905/1813] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:20:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:20:59.419821 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ffe55-9f93-4409-8eac-68dc04339712 service cinder] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:59.433948 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-30a3a1d7-1cdd-4733-9748-40e68347ef27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9221d923db6b489e82092548b510b018', 'request_id': 'req-30a3a1d7-1cdd-4733-9748-40e68347ef27'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:59.447569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ffe55-9f93-4409-8eac-68dc04339712 service cinder] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:59.449244 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-30a3a1d7-1cdd-4733-9748-40e68347ef27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9221d923db6b489e82092548b510b018', 'request_id': 'req-30a3a1d7-1cdd-4733-9748-40e68347ef27'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:59.480316 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-30a3a1d7-1cdd-4733-9748-40e68347ef27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9221d923db6b489e82092548b510b018', 'request_id': 'req-30a3a1d7-1cdd-4733-9748-40e68347ef27'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:59.516486 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-30a3a1d7-1cdd-4733-9748-40e68347ef27 admin admin] The token cache is being invalidate because project 9221d923db6b489e82092548b510b018 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:20:59.516860 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-30a3a1d7-1cdd-4733-9748-40e68347ef27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:59.519451 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-30a3a1d7-1cdd-4733-9748-40e68347ef27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:59.524189 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 909/1814] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:20:59 2022] DELETE /identity/v3/projects/9221d923db6b489e82092548b510b018 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:59.525184 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3a1d7-1cdd-4733-9748-40e68347ef27 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:59.530112 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-30a3a1d7-1cdd-4733-9748-40e68347ef27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:59.572964 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:20:59.643034 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86f0f5-f2f5-43f4-a308-14ab2148eff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:59.645271 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86f0f5-f2f5-43f4-a308-14ab2148eff4 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:59.645660 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86f0f5-f2f5-43f4-a308-14ab2148eff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:59.646323 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86f0f5-f2f5-43f4-a308-14ab2148eff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:59.647392 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf86f0f5-f2f5-43f4-a308-14ab2148eff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:59.653534 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf86f0f5-f2f5-43f4-a308-14ab2148eff4 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:59.680396 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 906/1815] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:59.682347 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80bc88-3b42-453d-a3d9-9daadf1d591e None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:59.682816 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80bc88-3b42-453d-a3d9-9daadf1d591e None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:59.683104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80bc88-3b42-453d-a3d9-9daadf1d591e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:59.728160 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3a1d7-1cdd-4733-9748-40e68347ef27 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:59.735049 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de54ef6-3085-428c-9f31-da858a762682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:59.737122 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de54ef6-3085-428c-9f31-da858a762682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:59.737690 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de54ef6-3085-428c-9f31-da858a762682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:59.738053 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de54ef6-3085-428c-9f31-da858a762682 admin admin] PATH_INFO: `/v3/projects/5cbe3a89ac354ec0a12aa230a44d3e11` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:59.740131 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de54ef6-3085-428c-9f31-da858a762682 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cbe3a89ac354ec0a12aa230a44d3e11)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:59.743288 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de54ef6-3085-428c-9f31-da858a762682 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:59.749511 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-7e80bc88-3b42-453d-a3d9-9daadf1d591e None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:59.753640 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-7e80bc88-3b42-453d-a3d9-9daadf1d591e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:59.772231 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 907/1816] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:20:59.774294 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80bc88-3b42-453d-a3d9-9daadf1d591e None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:59.795943 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-7e80bc88-3b42-453d-a3d9-9daadf1d591e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:59.833905 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80bc88-3b42-453d-a3d9-9daadf1d591e None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:20:59.846395 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c9332-05bd-4557-9101-ea30cccb6d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:20:59.847535 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c9332-05bd-4557-9101-ea30cccb6d7f admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:59.848113 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c9332-05bd-4557-9101-ea30cccb6d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:59.849518 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c9332-05bd-4557-9101-ea30cccb6d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:59.850547 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c9332-05bd-4557-9101-ea30cccb6d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:20:59.857373 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c9332-05bd-4557-9101-ea30cccb6d7f admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:20:59.877018 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 908/1817] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:20:59.878361 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55847734-19ae-4b38-8b96-89e46c7d99c6 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:20:59.878738 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55847734-19ae-4b38-8b96-89e46c7d99c6 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:20:59.879503 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55847734-19ae-4b38-8b96-89e46c7d99c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:20:59.899909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-3de54ef6-3085-428c-9f31-da858a762682 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cbe3a89ac354ec0a12aa230a44d3e11', 'request_id': 'req-3de54ef6-3085-428c-9f31-da858a762682'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:59.909242 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-55847734-19ae-4b38-8b96-89e46c7d99c6 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:20:59.911941 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-55847734-19ae-4b38-8b96-89e46c7d99c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:20:59.924877 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-3de54ef6-3085-428c-9f31-da858a762682 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cbe3a89ac354ec0a12aa230a44d3e11', 'request_id': 'req-3de54ef6-3085-428c-9f31-da858a762682'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:59.953962 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-3de54ef6-3085-428c-9f31-da858a762682 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cbe3a89ac354ec0a12aa230a44d3e11', 'request_id': 'req-3de54ef6-3085-428c-9f31-da858a762682'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:59.972820 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-3de54ef6-3085-428c-9f31-da858a762682 admin admin] The token cache is being invalidate because project 5cbe3a89ac354ec0a12aa230a44d3e11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:20:59.973103 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-3de54ef6-3085-428c-9f31-da858a762682 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:59.973934 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-3de54ef6-3085-428c-9f31-da858a762682 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:20:59.975789 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 910/1818] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:20:59 2022] DELETE /identity/v3/projects/5cbe3a89ac354ec0a12aa230a44d3e11 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:20:59.976568 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de54ef6-3085-428c-9f31-da858a762682 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:20:59.977944 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-3de54ef6-3085-428c-9f31-da858a762682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:00.019090 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:00.032335 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 909/1819] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:00.035857 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55847734-19ae-4b38-8b96-89e46c7d99c6 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:00.035857 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-55847734-19ae-4b38-8b96-89e46c7d99c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:00.057894 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55847734-19ae-4b38-8b96-89e46c7d99c6 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:00.065370 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847c407-e091-4288-8a2c-ff74d3626420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:00.066263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847c407-e091-4288-8a2c-ff74d3626420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:00.066549 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847c407-e091-4288-8a2c-ff74d3626420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:00.066922 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847c407-e091-4288-8a2c-ff74d3626420 admin admin] PATH_INFO: `/v3/users/63e23ebf3fb844b5830dbeaa50864d9d` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:00.068485 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847c407-e091-4288-8a2c-ff74d3626420 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63e23ebf3fb844b5830dbeaa50864d9d)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:00.071215 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847c407-e091-4288-8a2c-ff74d3626420 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:00.087701 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de54ef6-3085-428c-9f31-da858a762682 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:00.093726 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53458633-c4ad-4cce-adc3-4083319ae3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:00.094710 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53458633-c4ad-4cce-adc3-4083319ae3b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:00.095484 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53458633-c4ad-4cce-adc3-4083319ae3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:00.096522 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53458633-c4ad-4cce-adc3-4083319ae3b1 admin admin] PATH_INFO: `/v3/projects/1b2b40e489194cc3982aba965a9f1988/users/6d33b26a4dfa40269878ec167ad60f1c/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:00.117332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53458633-c4ad-4cce-adc3-4083319ae3b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b2b40e489194cc3982aba965a9f1988, user_id=6d33b26a4dfa40269878ec167ad60f1c, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:00.120600 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53458633-c4ad-4cce-adc3-4083319ae3b1 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:00.148363 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-a847c407-e091-4288-8a2c-ff74d3626420 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63e23ebf3fb844b5830dbeaa50864d9d'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:00.149068 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-a847c407-e091-4288-8a2c-ff74d3626420 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63e23ebf3fb844b5830dbeaa50864d9d'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:00.153748 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 911/1820] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:20:59 2022] PUT /identity/v3/projects/1b2b40e489194cc3982aba965a9f1988/users/6d33b26a4dfa40269878ec167ad60f1c/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:00.155267 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53458633-c4ad-4cce-adc3-4083319ae3b1 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:00.161784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-53458633-c4ad-4cce-adc3-4083319ae3b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:00.182451 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-a847c407-e091-4288-8a2c-ff74d3626420 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63e23ebf3fb844b5830dbeaa50864d9d'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:00.183274 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-a847c407-e091-4288-8a2c-ff74d3626420 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63e23ebf3fb844b5830dbeaa50864d9d'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:00.197073 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-a847c407-e091-4288-8a2c-ff74d3626420 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63e23ebf3fb844b5830dbeaa50864d9d'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:00.209301 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:00.221228 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 910/1821] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:00 2022] DELETE /identity/v3/users/63e23ebf3fb844b5830dbeaa50864d9d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:00.222767 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf33fe6-bdf3-4479-9048-605aa9f34137 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:00.223119 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf33fe6-bdf3-4479-9048-605aa9f34137 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:00.223472 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf33fe6-bdf3-4479-9048-605aa9f34137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:00.269721 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-2cf33fe6-bdf3-4479-9048-605aa9f34137 None None] MFA Rules not processed for user `6d33b26a4dfa40269878ec167ad60f1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:00.271302 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-2cf33fe6-bdf3-4479-9048-605aa9f34137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:00.273708 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53458633-c4ad-4cce-adc3-4083319ae3b1 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:00.387999 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 911/1822] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:00 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:00.388449 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce9fbe-05ad-4777-80f3-f63b02c61da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:00.389164 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce9fbe-05ad-4777-80f3-f63b02c61da1 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:00.389453 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce9fbe-05ad-4777-80f3-f63b02c61da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:00.389740 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce9fbe-05ad-4777-80f3-f63b02c61da1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:00.390494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce9fbe-05ad-4777-80f3-f63b02c61da1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:21:00.390690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf33fe6-bdf3-4479-9048-605aa9f34137 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:00.392066 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-2cf33fe6-bdf3-4479-9048-605aa9f34137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:00.392974 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce9fbe-05ad-4777-80f3-f63b02c61da1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:00.394683 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce9fbe-05ad-4777-80f3-f63b02c61da1 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:00.410021 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf33fe6-bdf3-4479-9048-605aa9f34137 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:00.410277 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 912/1823] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:21:00.411207 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce9fbe-05ad-4777-80f3-f63b02c61da1 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:00.414166 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-31ce9fbe-05ad-4777-80f3-f63b02c61da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:00.415957 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735da4d-76ae-44c3-a9a7-1cd4f37fadd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:00.416526 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735da4d-76ae-44c3-a9a7-1cd4f37fadd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:00.416806 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735da4d-76ae-44c3-a9a7-1cd4f37fadd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:00.417076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735da4d-76ae-44c3-a9a7-1cd4f37fadd9 admin admin] PATH_INFO: `/v3/users/936341a7e8704a89b9e6129fd38394ba` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:00.418275 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735da4d-76ae-44c3-a9a7-1cd4f37fadd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=936341a7e8704a89b9e6129fd38394ba)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:00.420605 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735da4d-76ae-44c3-a9a7-1cd4f37fadd9 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:00.432870 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce9fbe-05ad-4777-80f3-f63b02c61da1 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:00.441516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d22c1-5469-4e86-872e-164830842cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:00.443158 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d22c1-5469-4e86-872e-164830842cbe admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:00.444185 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d22c1-5469-4e86-872e-164830842cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:00.445708 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d22c1-5469-4e86-872e-164830842cbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:00.448361 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d22c1-5469-4e86-872e-164830842cbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:00.450895 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d22c1-5469-4e86-872e-164830842cbe admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:00.493441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-6735da4d-76ae-44c3-a9a7-1cd4f37fadd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '936341a7e8704a89b9e6129fd38394ba'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:00.494452 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-6735da4d-76ae-44c3-a9a7-1cd4f37fadd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '936341a7e8704a89b9e6129fd38394ba'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:00.501143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:00.505049 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 913/1824] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:00 2022] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:00.509748 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d22c1-5469-4e86-872e-164830842cbe admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:00.509748 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-4b0d22c1-5469-4e86-872e-164830842cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:00.515603 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-6735da4d-76ae-44c3-a9a7-1cd4f37fadd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '936341a7e8704a89b9e6129fd38394ba'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:00.516712 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-6735da4d-76ae-44c3-a9a7-1cd4f37fadd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '936341a7e8704a89b9e6129fd38394ba'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:00.528917 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-6735da4d-76ae-44c3-a9a7-1cd4f37fadd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '936341a7e8704a89b9e6129fd38394ba'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:00.545038 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 912/1825] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:00 2022] DELETE /identity/v3/users/936341a7e8704a89b9e6129fd38394ba => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:00.546114 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735da4d-76ae-44c3-a9a7-1cd4f37fadd9 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:00.547741 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-6735da4d-76ae-44c3-a9a7-1cd4f37fadd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:00.599505 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d22c1-5469-4e86-872e-164830842cbe admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:00.641100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735da4d-76ae-44c3-a9a7-1cd4f37fadd9 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:00.646413 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed457a74-a2f8-4359-b082-f7e62e3112d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:00.647288 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed457a74-a2f8-4359-b082-f7e62e3112d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:00.647577 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed457a74-a2f8-4359-b082-f7e62e3112d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:00.647935 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed457a74-a2f8-4359-b082-f7e62e3112d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:00.648641 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed457a74-a2f8-4359-b082-f7e62e3112d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:00.651386 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed457a74-a2f8-4359-b082-f7e62e3112d8 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:00.677061 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 913/1826] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:00 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:00.678434 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dcb2b-89e0-43fb-b104-0dbbf5839140 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:00.678756 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dcb2b-89e0-43fb-b104-0dbbf5839140 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:00.679611 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dcb2b-89e0-43fb-b104-0dbbf5839140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:00.679713 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:00.691641 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e2dfe-7cce-47fd-adeb-46690b2dfc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:00.692756 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e2dfe-7cce-47fd-adeb-46690b2dfc6b admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:00.693044 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e2dfe-7cce-47fd-adeb-46690b2dfc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:00.693319 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e2dfe-7cce-47fd-adeb-46690b2dfc6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:00.694142 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e2dfe-7cce-47fd-adeb-46690b2dfc6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:00.696890 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e2dfe-7cce-47fd-adeb-46690b2dfc6b admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:00.702609 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-251dcb2b-89e0-43fb-b104-0dbbf5839140 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:00.704265 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-251dcb2b-89e0-43fb-b104-0dbbf5839140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:00.714795 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 914/1827] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:00.715727 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251dcb2b-89e0-43fb-b104-0dbbf5839140 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:00.717190 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-251dcb2b-89e0-43fb-b104-0dbbf5839140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:00.731564 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251dcb2b-89e0-43fb-b104-0dbbf5839140 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:00.740781 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d84e3-fe59-4633-891e-47b922e6b3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:00.742503 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d84e3-fe59-4633-891e-47b922e6b3b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:00.742822 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d84e3-fe59-4633-891e-47b922e6b3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:00.746124 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d84e3-fe59-4633-891e-47b922e6b3b7 admin admin] PATH_INFO: `/v3/projects/a582f97d2ecd45639084ef3a77998de9` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:00.746253 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 914/1828] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:00 2022] POST /identity/v3/projects => generated 371 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:00.746253 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e2dfe-7cce-47fd-adeb-46690b2dfc6b admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:00.746792 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d84e3-fe59-4633-891e-47b922e6b3b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a582f97d2ecd45639084ef3a77998de9)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:00.748888 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d84e3-fe59-4633-891e-47b922e6b3b7 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:00.803416 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-493d84e3-fe59-4633-891e-47b922e6b3b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a582f97d2ecd45639084ef3a77998de9', 'request_id': 'req-493d84e3-fe59-4633-891e-47b922e6b3b7'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:00.814580 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-493d84e3-fe59-4633-891e-47b922e6b3b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a582f97d2ecd45639084ef3a77998de9', 'request_id': 'req-493d84e3-fe59-4633-891e-47b922e6b3b7'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:00.816089 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e2dfe-7cce-47fd-adeb-46690b2dfc6b admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:00.821351 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-493d84e3-fe59-4633-891e-47b922e6b3b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a582f97d2ecd45639084ef3a77998de9', 'request_id': 'req-493d84e3-fe59-4633-891e-47b922e6b3b7'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:00.831752 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-493d84e3-fe59-4633-891e-47b922e6b3b7 admin admin] The token cache is being invalidate because project a582f97d2ecd45639084ef3a77998de9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:00.832039 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-493d84e3-fe59-4633-891e-47b922e6b3b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:00.832682 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-493d84e3-fe59-4633-891e-47b922e6b3b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:00.834244 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 915/1829] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:00 2022] DELETE /identity/v3/projects/a582f97d2ecd45639084ef3a77998de9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:00.835108 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d84e3-fe59-4633-891e-47b922e6b3b7 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:00.836454 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-493d84e3-fe59-4633-891e-47b922e6b3b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:00.879138 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61b870-08b5-440c-8a8d-219bddbdf7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:00.880135 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61b870-08b5-440c-8a8d-219bddbdf7e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:00.880914 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61b870-08b5-440c-8a8d-219bddbdf7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:00.881347 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61b870-08b5-440c-8a8d-219bddbdf7e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:00.882391 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61b870-08b5-440c-8a8d-219bddbdf7e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:00.884033 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61b870-08b5-440c-8a8d-219bddbdf7e9 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:00.898136 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=86,keystone:DELETE=9,keystone:INSERT=5 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:00.901911 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 915/1830] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:00.901911 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61b870-08b5-440c-8a8d-219bddbdf7e9 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:00.902655 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-2e61b870-08b5-440c-8a8d-219bddbdf7e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:00.916829 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61b870-08b5-440c-8a8d-219bddbdf7e9 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:00.917988 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d84e3-fe59-4633-891e-47b922e6b3b7 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:00.921863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa8b7a-4792-4a96-85f7-0e7974771e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:00.922536 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa8b7a-4792-4a96-85f7-0e7974771e60 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:00.922846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa8b7a-4792-4a96-85f7-0e7974771e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:00.923101 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227a5a2-3429-4eea-a33a-d56d7336a116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:00.923233 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa8b7a-4792-4a96-85f7-0e7974771e60 admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:00.923802 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa8b7a-4792-4a96-85f7-0e7974771e60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:00.923899 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227a5a2-3429-4eea-a33a-d56d7336a116 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:00.924198 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227a5a2-3429-4eea-a33a-d56d7336a116 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:00.924551 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227a5a2-3429-4eea-a33a-d56d7336a116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:00.925744 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa8b7a-4792-4a96-85f7-0e7974771e60 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:00.926514 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-6227a5a2-3429-4eea-a33a-d56d7336a116 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:00.941152 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227a5a2-3429-4eea-a33a-d56d7336a116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:00.943545 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227a5a2-3429-4eea-a33a-d56d7336a116 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:00.949283 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 916/1831] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:00 2022] POST /identity/v3/users => generated 286 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:00.950767 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555ce0d-3e74-476a-bfd2-c78458db94e2 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:00.951057 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555ce0d-3e74-476a-bfd2-c78458db94e2 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:00.951334 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555ce0d-3e74-476a-bfd2-c78458db94e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:00.955479 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 916/1832] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:00.956309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227a5a2-3429-4eea-a33a-d56d7336a116 service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:00.960940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-6227a5a2-3429-4eea-a33a-d56d7336a116 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:00.973867 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227a5a2-3429-4eea-a33a-d56d7336a116 service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:00.976769 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-a555ce0d-3e74-476a-bfd2-c78458db94e2 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:00.978552 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-a555ce0d-3e74-476a-bfd2-c78458db94e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:00.980866 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35151a33-f40f-4ad7-b2ea-4edb3c86d111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:00.981776 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35151a33-f40f-4ad7-b2ea-4edb3c86d111 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:00.982092 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35151a33-f40f-4ad7-b2ea-4edb3c86d111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:00.982338 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35151a33-f40f-4ad7-b2ea-4edb3c86d111 admin admin] PATH_INFO: `/v3/projects/c143650744f54283bb8f94d5de38bea5/users/db840e43fac24bca8cbf0dfb43cebf9a/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:00.986716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 917/1833] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:00.987382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555ce0d-3e74-476a-bfd2-c78458db94e2 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:00.998411 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555ce0d-3e74-476a-bfd2-c78458db94e2 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.005876 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ec260-8f34-4f8e-b307-42fcba63e340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.006727 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ec260-8f34-4f8e-b307-42fcba63e340 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.007103 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ec260-8f34-4f8e-b307-42fcba63e340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.007444 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ec260-8f34-4f8e-b307-42fcba63e340 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.008250 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ec260-8f34-4f8e-b307-42fcba63e340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.008656 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35151a33-f40f-4ad7-b2ea-4edb3c86d111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c143650744f54283bb8f94d5de38bea5, user_id=db840e43fac24bca8cbf0dfb43cebf9a, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.010008 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ec260-8f34-4f8e-b307-42fcba63e340 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.012396 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35151a33-f40f-4ad7-b2ea-4edb3c86d111 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.025034 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 918/1834] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:01.026690 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d674b3-b7f7-4f33-a2e7-a43c0e7dfbae None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.026993 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d674b3-b7f7-4f33-a2e7-a43c0e7dfbae None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.027277 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d674b3-b7f7-4f33-a2e7-a43c0e7dfbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.038083 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 917/1835] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:00 2022] PUT /identity/v3/projects/c143650744f54283bb8f94d5de38bea5/users/db840e43fac24bca8cbf0dfb43cebf9a/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:01.039826 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35151a33-f40f-4ad7-b2ea-4edb3c86d111 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.051717 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-80d674b3-b7f7-4f33-a2e7-a43c0e7dfbae None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:01.053185 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-80d674b3-b7f7-4f33-a2e7-a43c0e7dfbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:01.110564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:01.113532 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35151a33-f40f-4ad7-b2ea-4edb3c86d111 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.120135 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb0056-331a-40b8-83b5-5ff568273621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.121206 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb0056-331a-40b8-83b5-5ff568273621 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.121502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb0056-331a-40b8-83b5-5ff568273621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.121786 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb0056-331a-40b8-83b5-5ff568273621 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.122556 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb0056-331a-40b8-83b5-5ff568273621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.124274 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb0056-331a-40b8-83b5-5ff568273621 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.136662 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 919/1836] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:01.136662 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d674b3-b7f7-4f33-a2e7-a43c0e7dfbae None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.144554 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d674b3-b7f7-4f33-a2e7-a43c0e7dfbae None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.151385 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 918/1837] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:01.152613 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb0056-331a-40b8-83b5-5ff568273621 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.154356 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147859b2-7ffb-476d-a723-e4b9d0db7046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.155743 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147859b2-7ffb-476d-a723-e4b9d0db7046 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.156147 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147859b2-7ffb-476d-a723-e4b9d0db7046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.156638 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147859b2-7ffb-476d-a723-e4b9d0db7046 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.157502 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147859b2-7ffb-476d-a723-e4b9d0db7046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.159303 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147859b2-7ffb-476d-a723-e4b9d0db7046 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.171720 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb0056-331a-40b8-83b5-5ff568273621 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.171865 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 920/1838] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:01.175961 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147859b2-7ffb-476d-a723-e4b9d0db7046 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.179546 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940ffa8-ff3f-47f5-89b1-189e3dd8a6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.180533 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940ffa8-ff3f-47f5-89b1-189e3dd8a6db admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.180830 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940ffa8-ff3f-47f5-89b1-189e3dd8a6db admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.181259 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940ffa8-ff3f-47f5-89b1-189e3dd8a6db admin admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.182549 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940ffa8-ff3f-47f5-89b1-189e3dd8a6db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:21:01.182908 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940ffa8-ff3f-47f5-89b1-189e3dd8a6db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.184914 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940ffa8-ff3f-47f5-89b1-189e3dd8a6db admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.188843 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147859b2-7ffb-476d-a723-e4b9d0db7046 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.206728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5d311-c0ff-4933-9ceb-d21770014a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.207978 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5d311-c0ff-4933-9ceb-d21770014a7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.208440 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5d311-c0ff-4933-9ceb-d21770014a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.208730 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5d311-c0ff-4933-9ceb-d21770014a7a admin admin] PATH_INFO: `/v3/projects/3ae915f7bf074af08401ff84769821e9/users/72f28b848687488698db23b7a1253a37/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.210021 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 919/1839] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:21:01.211641 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940ffa8-ff3f-47f5-89b1-189e3dd8a6db admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.228409 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940ffa8-ff3f-47f5-89b1-189e3dd8a6db admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.230925 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc5d311-c0ff-4933-9ceb-d21770014a7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ae915f7bf074af08401ff84769821e9, user_id=72f28b848687488698db23b7a1253a37, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.235233 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc5d311-c0ff-4933-9ceb-d21770014a7a admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.237376 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2224c2-16f0-4f61-a53c-2c3ae03c2d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.239317 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2224c2-16f0-4f61-a53c-2c3ae03c2d44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.239449 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2224c2-16f0-4f61-a53c-2c3ae03c2d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.239914 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2224c2-16f0-4f61-a53c-2c3ae03c2d44 admin admin] PATH_INFO: `/v3/projects/c143650744f54283bb8f94d5de38bea5/users/db840e43fac24bca8cbf0dfb43cebf9a/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.242191 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2224c2-16f0-4f61-a53c-2c3ae03c2d44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c143650744f54283bb8f94d5de38bea5, user_id=db840e43fac24bca8cbf0dfb43cebf9a, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.245166 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2224c2-16f0-4f61-a53c-2c3ae03c2d44 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.251400 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 921/1840] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:01 2022] PUT /identity/v3/projects/3ae915f7bf074af08401ff84769821e9/users/72f28b848687488698db23b7a1253a37/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:01.252050 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5d311-c0ff-4933-9ceb-d21770014a7a admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.260505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 920/1841] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:01 2022] PUT /identity/v3/projects/c143650744f54283bb8f94d5de38bea5/users/db840e43fac24bca8cbf0dfb43cebf9a/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:01.264838 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abac71-1f42-484a-b0c1-70109c794915 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.265717 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abac71-1f42-484a-b0c1-70109c794915 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.266206 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abac71-1f42-484a-b0c1-70109c794915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.286752 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-56abac71-1f42-484a-b0c1-70109c794915 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:01.287984 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-56abac71-1f42-484a-b0c1-70109c794915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:01.322267 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5d311-c0ff-4933-9ceb-d21770014a7a admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.361445 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 921/1842] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:01.362869 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77694cc1-0628-4222-8d42-6e45c1c70971 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.363158 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77694cc1-0628-4222-8d42-6e45c1c70971 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.363579 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77694cc1-0628-4222-8d42-6e45c1c70971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.387861 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a30a2-67af-4c20-8bd2-bf2c120caba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.388533 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a30a2-67af-4c20-8bd2-bf2c120caba3 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.388880 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a30a2-67af-4c20-8bd2-bf2c120caba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.389632 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a30a2-67af-4c20-8bd2-bf2c120caba3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.390390 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a30a2-67af-4c20-8bd2-bf2c120caba3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.392169 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-77694cc1-0628-4222-8d42-6e45c1c70971 None None] MFA Rules not processed for user `db840e43fac24bca8cbf0dfb43cebf9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:01.392650 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a30a2-67af-4c20-8bd2-bf2c120caba3 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.393366 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-77694cc1-0628-4222-8d42-6e45c1c70971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:01.408671 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:01.420393 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 922/1843] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:01 2022] POST /identity/v3/projects => generated 409 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:01.421443 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a30a2-67af-4c20-8bd2-bf2c120caba3 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.423168 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-d44a30a2-67af-4c20-8bd2-bf2c120caba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:01.472375 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 922/1844] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:01 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:01.473294 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77694cc1-0628-4222-8d42-6e45c1c70971 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.474594 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-77694cc1-0628-4222-8d42-6e45c1c70971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:01.483543 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:01.494080 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a30a2-67af-4c20-8bd2-bf2c120caba3 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.499156 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd3677-f7db-4aba-b9ef-4ac2947a336d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.500047 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd3677-f7db-4aba-b9ef-4ac2947a336d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.500330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd3677-f7db-4aba-b9ef-4ac2947a336d admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.500606 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd3677-f7db-4aba-b9ef-4ac2947a336d admin admin] PATH_INFO: `/v3/projects/c1f7eb1c717a495ab62cad694aea910e` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.501790 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd3677-f7db-4aba-b9ef-4ac2947a336d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1f7eb1c717a495ab62cad694aea910e)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.503985 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd3677-f7db-4aba-b9ef-4ac2947a336d admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.533540 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77694cc1-0628-4222-8d42-6e45c1c70971 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.552952 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-aabd3677-f7db-4aba-b9ef-4ac2947a336d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1f7eb1c717a495ab62cad694aea910e', 'request_id': 'req-aabd3677-f7db-4aba-b9ef-4ac2947a336d'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:01.559562 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-aabd3677-f7db-4aba-b9ef-4ac2947a336d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1f7eb1c717a495ab62cad694aea910e', 'request_id': 'req-aabd3677-f7db-4aba-b9ef-4ac2947a336d'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:01.565305 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-aabd3677-f7db-4aba-b9ef-4ac2947a336d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1f7eb1c717a495ab62cad694aea910e', 'request_id': 'req-aabd3677-f7db-4aba-b9ef-4ac2947a336d'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:01.578122 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-aabd3677-f7db-4aba-b9ef-4ac2947a336d admin admin] The token cache is being invalidate because project c1f7eb1c717a495ab62cad694aea910e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:01.578407 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-aabd3677-f7db-4aba-b9ef-4ac2947a336d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:01.579045 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-aabd3677-f7db-4aba-b9ef-4ac2947a336d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:01.580831 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 923/1845] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:01 2022] DELETE /identity/v3/projects/c1f7eb1c717a495ab62cad694aea910e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:01.581570 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd3677-f7db-4aba-b9ef-4ac2947a336d admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.582994 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-aabd3677-f7db-4aba-b9ef-4ac2947a336d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:01.583187 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eaee10-d27d-4569-8777-674c4e32458e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.583937 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eaee10-d27d-4569-8777-674c4e32458e service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.584170 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eaee10-d27d-4569-8777-674c4e32458e service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.584449 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eaee10-d27d-4569-8777-674c4e32458e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.586934 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-73eaee10-d27d-4569-8777-674c4e32458e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:01.600710 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eaee10-d27d-4569-8777-674c4e32458e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.602222 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eaee10-d27d-4569-8777-674c4e32458e service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.611751 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 923/1846] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:01.612538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eaee10-d27d-4569-8777-674c4e32458e service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.613817 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-73eaee10-d27d-4569-8777-674c4e32458e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:01.648495 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd3677-f7db-4aba-b9ef-4ac2947a336d admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.654215 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c781e0-11f7-4aae-989c-620c086d2878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.655187 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c781e0-11f7-4aae-989c-620c086d2878 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.655598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c781e0-11f7-4aae-989c-620c086d2878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.655877 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c781e0-11f7-4aae-989c-620c086d2878 admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.656602 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c781e0-11f7-4aae-989c-620c086d2878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.658548 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c781e0-11f7-4aae-989c-620c086d2878 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.681844 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eaee10-d27d-4569-8777-674c4e32458e service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.682617 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 924/1847] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:01 2022] POST /identity/v3/users => generated 305 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:01.683564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c781e0-11f7-4aae-989c-620c086d2878 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.685188 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-65c781e0-11f7-4aae-989c-620c086d2878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:01.697968 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c781e0-11f7-4aae-989c-620c086d2878 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.704643 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87649504-031b-4844-b327-7eeb516bea2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.705843 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87649504-031b-4844-b327-7eeb516bea2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.706130 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87649504-031b-4844-b327-7eeb516bea2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.706687 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87649504-031b-4844-b327-7eeb516bea2e admin admin] PATH_INFO: `/v3/users/f1964eb87ecf4d6a898426b8e422d72a` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.708122 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87649504-031b-4844-b327-7eeb516bea2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1964eb87ecf4d6a898426b8e422d72a)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.710834 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87649504-031b-4844-b327-7eeb516bea2e admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.715358 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:01.754204 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a8266-b106-48d8-bfc0-4c44e3ea74bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.754911 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a8266-b106-48d8-bfc0-4c44e3ea74bb service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.755287 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a8266-b106-48d8-bfc0-4c44e3ea74bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.755567 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a8266-b106-48d8-bfc0-4c44e3ea74bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.757521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-e45a8266-b106-48d8-bfc0-4c44e3ea74bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:01.763131 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-87649504-031b-4844-b327-7eeb516bea2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1964eb87ecf4d6a898426b8e422d72a'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:01.763816 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-87649504-031b-4844-b327-7eeb516bea2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1964eb87ecf4d6a898426b8e422d72a'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:01.774264 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=81,keystone:DELETE=15,keystone:INSERT=4 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:01.780848 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-87649504-031b-4844-b327-7eeb516bea2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1964eb87ecf4d6a898426b8e422d72a'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:01.791463 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-87649504-031b-4844-b327-7eeb516bea2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1964eb87ecf4d6a898426b8e422d72a'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:01.795824 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-87649504-031b-4844-b327-7eeb516bea2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1964eb87ecf4d6a898426b8e422d72a'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:01.811978 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 925/1848] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:01 2022] DELETE /identity/v3/users/f1964eb87ecf4d6a898426b8e422d72a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:01.812829 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87649504-031b-4844-b327-7eeb516bea2e admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.814334 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-87649504-031b-4844-b327-7eeb516bea2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:01.853567 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a8266-b106-48d8-bfc0-4c44e3ea74bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.855069 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a8266-b106-48d8-bfc0-4c44e3ea74bb service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.871795 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 924/1849] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:01 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:01.969275 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87649504-031b-4844-b327-7eeb516bea2e admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.975553 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643083f-a0ca-4709-8d9c-fbee0ce8e334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.976796 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643083f-a0ca-4709-8d9c-fbee0ce8e334 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.977159 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643083f-a0ca-4709-8d9c-fbee0ce8e334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.977488 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643083f-a0ca-4709-8d9c-fbee0ce8e334 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.979176 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643083f-a0ca-4709-8d9c-fbee0ce8e334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.982540 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a8266-b106-48d8-bfc0-4c44e3ea74bb service cinder] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.984077 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-e45a8266-b106-48d8-bfc0-4c44e3ea74bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:01.986575 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643083f-a0ca-4709-8d9c-fbee0ce8e334 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.999530 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a8266-b106-48d8-bfc0-4c44e3ea74bb service cinder] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:02.004418 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 926/1850] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:02.009601 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643083f-a0ca-4709-8d9c-fbee0ce8e334 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:02.024688 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643083f-a0ca-4709-8d9c-fbee0ce8e334 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:02.032807 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1510ea-c648-45ee-8920-95daceb020c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:02.033514 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1510ea-c648-45ee-8920-95daceb020c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.033853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1510ea-c648-45ee-8920-95daceb020c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.034141 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1510ea-c648-45ee-8920-95daceb020c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.034917 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1510ea-c648-45ee-8920-95daceb020c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:02.039435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1510ea-c648-45ee-8920-95daceb020c3 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:02.053925 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 927/1851] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:02.058101 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1510ea-c648-45ee-8920-95daceb020c3 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:02.069277 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1510ea-c648-45ee-8920-95daceb020c3 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:02.075499 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0092c05-ca1e-4679-adb4-120dc67871ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:02.076568 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0092c05-ca1e-4679-adb4-120dc67871ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.076866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0092c05-ca1e-4679-adb4-120dc67871ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.077132 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0092c05-ca1e-4679-adb4-120dc67871ed admin admin] PATH_INFO: `/v3/projects/5ee0a099b9724b438c6c222bf0ee1998/users/661c70073e51429bb3f9719c8bf7408b/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.083395 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc703b42-5a6b-4ef1-9c34-bf0a4186f093 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:02.084177 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc703b42-5a6b-4ef1-9c34-bf0a4186f093 service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.084463 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc703b42-5a6b-4ef1-9c34-bf0a4186f093 service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.084737 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc703b42-5a6b-4ef1-9c34-bf0a4186f093 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.088388 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-bc703b42-5a6b-4ef1-9c34-bf0a4186f093 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:02.096837 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0092c05-ca1e-4679-adb4-120dc67871ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ee0a099b9724b438c6c222bf0ee1998, user_id=661c70073e51429bb3f9719c8bf7408b, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:02.100696 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0092c05-ca1e-4679-adb4-120dc67871ed admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:02.136787 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 928/1852] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:02 2022] PUT /identity/v3/projects/5ee0a099b9724b438c6c222bf0ee1998/users/661c70073e51429bb3f9719c8bf7408b/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:02.160131 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e3865-270f-4230-9385-8e8d0de729b3 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.160514 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e3865-270f-4230-9385-8e8d0de729b3 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.160852 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e3865-270f-4230-9385-8e8d0de729b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.190574 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc703b42-5a6b-4ef1-9c34-bf0a4186f093 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:02.192217 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc703b42-5a6b-4ef1-9c34-bf0a4186f093 service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:02.209977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-b56e3865-270f-4230-9385-8e8d0de729b3 None None] MFA Rules not processed for user `661c70073e51429bb3f9719c8bf7408b`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:02.211238 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-b56e3865-270f-4230-9385-8e8d0de729b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:02.214350 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 925/1853] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:01 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:21:02.337899 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 929/1854] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:02 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:21:02.343811 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc703b42-5a6b-4ef1-9c34-bf0a4186f093 service cinder] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:02.356909 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc703b42-5a6b-4ef1-9c34-bf0a4186f093 service cinder] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:02.431286 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:02.456550 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e3865-270f-4230-9385-8e8d0de729b3 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:02.459330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-b56e3865-270f-4230-9385-8e8d0de729b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:02.486047 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec4e62-4ed1-4ce4-994b-e44fc03067c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:02.486769 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec4e62-4ed1-4ce4-994b-e44fc03067c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.487058 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec4e62-4ed1-4ce4-994b-e44fc03067c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.487384 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec4e62-4ed1-4ce4-994b-e44fc03067c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.488086 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec4e62-4ed1-4ce4-994b-e44fc03067c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:02.490585 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec4e62-4ed1-4ce4-994b-e44fc03067c4 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:02.506573 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:02.529445 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 926/1855] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:02 2022] POST /identity/v3/projects => generated 407 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:02.548142 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec4e62-4ed1-4ce4-994b-e44fc03067c4 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:02.590977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e3865-270f-4230-9385-8e8d0de729b3 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:02.637985 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec4e62-4ed1-4ce4-994b-e44fc03067c4 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:02.643376 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba83ea-0d56-42a1-a543-19f7f8c21974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:02.643954 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba83ea-0d56-42a1-a543-19f7f8c21974 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.644237 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba83ea-0d56-42a1-a543-19f7f8c21974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.644511 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba83ea-0d56-42a1-a543-19f7f8c21974 admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.645452 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba83ea-0d56-42a1-a543-19f7f8c21974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:02.648364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba83ea-0d56-42a1-a543-19f7f8c21974 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:02.660150 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689eca7-b064-4f42-8957-a321e3c18e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:02.661191 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689eca7-b064-4f42-8957-a321e3c18e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.661680 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689eca7-b064-4f42-8957-a321e3c18e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.662036 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689eca7-b064-4f42-8957-a321e3c18e24 admin admin] PATH_INFO: `/v3/projects/2a110561bfd34b838dd5393350889da3` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.663923 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689eca7-b064-4f42-8957-a321e3c18e24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a110561bfd34b838dd5393350889da3)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:02.666180 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689eca7-b064-4f42-8957-a321e3c18e24 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:02.673104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 927/1856] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:02 2022] POST /identity/v3/users => generated 310 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:02.677029 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba83ea-0d56-42a1-a543-19f7f8c21974 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:02.687273 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba83ea-0d56-42a1-a543-19f7f8c21974 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:02.692754 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3af9b1-8736-4674-aeb5-647cc0fc634b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:02.693615 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3af9b1-8736-4674-aeb5-647cc0fc634b admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.693963 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3af9b1-8736-4674-aeb5-647cc0fc634b admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.694313 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3af9b1-8736-4674-aeb5-647cc0fc634b admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.695247 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3af9b1-8736-4674-aeb5-647cc0fc634b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:02.697044 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3af9b1-8736-4674-aeb5-647cc0fc634b admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:02.710927 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 928/1857] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:02.715278 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3af9b1-8736-4674-aeb5-647cc0fc634b admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:02.727094 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3af9b1-8736-4674-aeb5-647cc0fc634b admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:02.734597 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-2689eca7-b064-4f42-8957-a321e3c18e24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a110561bfd34b838dd5393350889da3', 'request_id': 'req-2689eca7-b064-4f42-8957-a321e3c18e24'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:02.742555 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-2689eca7-b064-4f42-8957-a321e3c18e24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a110561bfd34b838dd5393350889da3', 'request_id': 'req-2689eca7-b064-4f42-8957-a321e3c18e24'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:02.760731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-2689eca7-b064-4f42-8957-a321e3c18e24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a110561bfd34b838dd5393350889da3', 'request_id': 'req-2689eca7-b064-4f42-8957-a321e3c18e24'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:02.776389 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-2689eca7-b064-4f42-8957-a321e3c18e24 admin admin] The token cache is being invalidate because project 2a110561bfd34b838dd5393350889da3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:02.776751 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-2689eca7-b064-4f42-8957-a321e3c18e24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:02.777505 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-2689eca7-b064-4f42-8957-a321e3c18e24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:02.779537 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 930/1858] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:02 2022] DELETE /identity/v3/projects/2a110561bfd34b838dd5393350889da3 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:02.784134 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33793df7-9096-466c-a1d2-d6cbff4cdb37 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.784427 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33793df7-9096-466c-a1d2-d6cbff4cdb37 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.784707 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33793df7-9096-466c-a1d2-d6cbff4cdb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.805699 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2f373-9ee7-4001-8abe-21eb06e3962e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:02.806601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2f373-9ee7-4001-8abe-21eb06e3962e admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.806923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2f373-9ee7-4001-8abe-21eb06e3962e admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.807460 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2f373-9ee7-4001-8abe-21eb06e3962e admin admin] PATH_INFO: `/v3/projects/3ca3c6c1fbbb483ebd6b5584eb6b1d5f/users/7317b67c08084c0ba2c93edc53dffe9b/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.811760 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-33793df7-9096-466c-a1d2-d6cbff4cdb37 None None] MFA Rules not processed for user `72f28b848687488698db23b7a1253a37`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:02.812975 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-33793df7-9096-466c-a1d2-d6cbff4cdb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:02.827868 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2f373-9ee7-4001-8abe-21eb06e3962e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ca3c6c1fbbb483ebd6b5584eb6b1d5f, user_id=7317b67c08084c0ba2c93edc53dffe9b, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:02.830553 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2f373-9ee7-4001-8abe-21eb06e3962e admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:02.847890 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 929/1859] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:02 2022] PUT /identity/v3/projects/3ca3c6c1fbbb483ebd6b5584eb6b1d5f/users/7317b67c08084c0ba2c93edc53dffe9b/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:21:02.852821 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4459f-0303-48b4-bdd6-7de52e324dc5 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.853106 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4459f-0303-48b4-bdd6-7de52e324dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.853381 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4459f-0303-48b4-bdd6-7de52e324dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.872241 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-7df4459f-0303-48b4-bdd6-7de52e324dc5 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:02.873460 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-7df4459f-0303-48b4-bdd6-7de52e324dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:02.876908 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:02.888298 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:02.895417 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 931/1860] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:02.898835 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33793df7-9096-466c-a1d2-d6cbff4cdb37 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:02.901653 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-33793df7-9096-466c-a1d2-d6cbff4cdb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:02.916953 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33793df7-9096-466c-a1d2-d6cbff4cdb37 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:02.954976 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 930/1861] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:02.955974 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4459f-0303-48b4-bdd6-7de52e324dc5 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:02.957628 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-7df4459f-0303-48b4-bdd6-7de52e324dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:02.971021 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4459f-0303-48b4-bdd6-7de52e324dc5 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:02.980298 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7313761-a17e-47db-9417-39340e6f1314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:02.981179 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7313761-a17e-47db-9417-39340e6f1314 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.981609 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7313761-a17e-47db-9417-39340e6f1314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.981893 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7313761-a17e-47db-9417-39340e6f1314 admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.982816 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7313761-a17e-47db-9417-39340e6f1314 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:02.984611 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7313761-a17e-47db-9417-39340e6f1314 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:03.003339 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451f2f4-53bf-4250-8a8d-7c358c6e0233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:03.004024 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451f2f4-53bf-4250-8a8d-7c358c6e0233 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.004475 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451f2f4-53bf-4250-8a8d-7c358c6e0233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.004758 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451f2f4-53bf-4250-8a8d-7c358c6e0233 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.005526 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451f2f4-53bf-4250-8a8d-7c358c6e0233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:03.007385 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451f2f4-53bf-4250-8a8d-7c358c6e0233 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:03.021147 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 932/1862] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:03.021147 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c79df-e0da-4608-ac06-0a98f585b1f0 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.021147 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c79df-e0da-4608-ac06-0a98f585b1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.021147 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c79df-e0da-4608-ac06-0a98f585b1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.026956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 931/1863] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:02 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:03.026956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7313761-a17e-47db-9417-39340e6f1314 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:03.044134 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-6a3c79df-e0da-4608-ac06-0a98f585b1f0 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:03.045340 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-6a3c79df-e0da-4608-ac06-0a98f585b1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:03.102433 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7313761-a17e-47db-9417-39340e6f1314 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:03.109484 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 933/1864] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:03.111547 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c79df-e0da-4608-ac06-0a98f585b1f0 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:03.115807 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc3fc1-6811-4b5b-a454-4c52f0b4fa56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:03.117477 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc3fc1-6811-4b5b-a454-4c52f0b4fa56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.117763 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc3fc1-6811-4b5b-a454-4c52f0b4fa56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.118092 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc3fc1-6811-4b5b-a454-4c52f0b4fa56 admin admin] PATH_INFO: `/v3/projects/3ca3c6c1fbbb483ebd6b5584eb6b1d5f/users/7317b67c08084c0ba2c93edc53dffe9b/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.120246 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc3fc1-6811-4b5b-a454-4c52f0b4fa56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ca3c6c1fbbb483ebd6b5584eb6b1d5f, user_id=7317b67c08084c0ba2c93edc53dffe9b, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:03.123085 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc3fc1-6811-4b5b-a454-4c52f0b4fa56 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:03.123631 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c79df-e0da-4608-ac06-0a98f585b1f0 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:03.129666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a032ad-0f3d-4c4c-a10b-0bac1b9b3866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:03.129666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a032ad-0f3d-4c4c-a10b-0bac1b9b3866 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.129666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a032ad-0f3d-4c4c-a10b-0bac1b9b3866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.129666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a032ad-0f3d-4c4c-a10b-0bac1b9b3866 admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.130210 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a032ad-0f3d-4c4c-a10b-0bac1b9b3866 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:03.132401 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a032ad-0f3d-4c4c-a10b-0bac1b9b3866 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:03.134973 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 932/1865] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:03 2022] PUT /identity/v3/projects/3ca3c6c1fbbb483ebd6b5584eb6b1d5f/users/7317b67c08084c0ba2c93edc53dffe9b/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:03.135794 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc3fc1-6811-4b5b-a454-4c52f0b4fa56 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:03.154300 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 934/1866] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:03 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:03.156270 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f8e7d-c98f-4a22-9dc5-57b5c4ee91b9 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.156562 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f8e7d-c98f-4a22-9dc5-57b5c4ee91b9 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.156857 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f8e7d-c98f-4a22-9dc5-57b5c4ee91b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.184305 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-f81f8e7d-c98f-4a22-9dc5-57b5c4ee91b9 None None] MFA Rules not processed for user `7317b67c08084c0ba2c93edc53dffe9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:03.185690 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-f81f8e7d-c98f-4a22-9dc5-57b5c4ee91b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:03.222205 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc3fc1-6811-4b5b-a454-4c52f0b4fa56 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:03.228244 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b898c-3d95-49cc-a9fe-3895d1e580d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:03.229030 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b898c-3d95-49cc-a9fe-3895d1e580d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.229615 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b898c-3d95-49cc-a9fe-3895d1e580d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.229958 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b898c-3d95-49cc-a9fe-3895d1e580d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.230799 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b898c-3d95-49cc-a9fe-3895d1e580d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:21:03.231175 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b898c-3d95-49cc-a9fe-3895d1e580d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:03.232882 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b898c-3d95-49cc-a9fe-3895d1e580d7 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:03.247675 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 933/1867] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:21:03.248634 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b898c-3d95-49cc-a9fe-3895d1e580d7 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:03.262174 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:03.265208 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b898c-3d95-49cc-a9fe-3895d1e580d7 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:03.271367 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 935/1868] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:03 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:03.272698 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f8e7d-c98f-4a22-9dc5-57b5c4ee91b9 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:03.278539 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5bb7c-98a2-4d67-a2aa-211208de2c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:03.279255 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5bb7c-98a2-4d67-a2aa-211208de2c7e admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.279541 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5bb7c-98a2-4d67-a2aa-211208de2c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.280079 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5bb7c-98a2-4d67-a2aa-211208de2c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.280818 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5bb7c-98a2-4d67-a2aa-211208de2c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:03.286591 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f8e7d-c98f-4a22-9dc5-57b5c4ee91b9 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:03.289757 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5bb7c-98a2-4d67-a2aa-211208de2c7e admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:03.292985 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2aa9c-ddb7-453f-a9bd-058441211746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:03.293652 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2aa9c-ddb7-453f-a9bd-058441211746 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.294047 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2aa9c-ddb7-453f-a9bd-058441211746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.294330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2aa9c-ddb7-453f-a9bd-058441211746 admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.295042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2aa9c-ddb7-453f-a9bd-058441211746 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:03.297802 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2aa9c-ddb7-453f-a9bd-058441211746 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:03.301116 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 934/1869] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:03.301970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5bb7c-98a2-4d67-a2aa-211208de2c7e admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:03.303722 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-dbb5bb7c-98a2-4d67-a2aa-211208de2c7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:03.327839 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:03.331881 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 936/1870] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:03 2022] POST /identity/v3/projects => generated 355 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:03.331881 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2aa9c-ddb7-453f-a9bd-058441211746 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:03.381297 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5bb7c-98a2-4d67-a2aa-211208de2c7e admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:03.408974 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2aa9c-ddb7-453f-a9bd-058441211746 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:03.415411 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbbca0-be4f-4a5f-8aa2-22f2120ecbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:03.416305 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbbca0-be4f-4a5f-8aa2-22f2120ecbc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.416583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbbca0-be4f-4a5f-8aa2-22f2120ecbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.416881 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbbca0-be4f-4a5f-8aa2-22f2120ecbc6 admin admin] PATH_INFO: `/v3/projects/22291033461d41a5a68f5f013a879e2c/users/2af2cd17d5654cabbf7e042d3c6224b8/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.434828 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cbbca0-be4f-4a5f-8aa2-22f2120ecbc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22291033461d41a5a68f5f013a879e2c, user_id=2af2cd17d5654cabbf7e042d3c6224b8, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:03.435241 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6afa78-5de5-4070-a0de-5a1d6691b217 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:03.435896 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6afa78-5de5-4070-a0de-5a1d6691b217 service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.436176 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6afa78-5de5-4070-a0de-5a1d6691b217 service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.436448 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6afa78-5de5-4070-a0de-5a1d6691b217 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.437578 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cbbca0-be4f-4a5f-8aa2-22f2120ecbc6 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:03.458353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 937/1871] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:03 2022] PUT /identity/v3/projects/22291033461d41a5a68f5f013a879e2c/users/2af2cd17d5654cabbf7e042d3c6224b8/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:03.458353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbbca0-be4f-4a5f-8aa2-22f2120ecbc6 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:03.513365 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6afa78-5de5-4070-a0de-5a1d6691b217 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:03.514701 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6afa78-5de5-4070-a0de-5a1d6691b217 service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:03.525161 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbbca0-be4f-4a5f-8aa2-22f2120ecbc6 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:03.527044 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 935/1872] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:03 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:03.528530 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6afa78-5de5-4070-a0de-5a1d6691b217 service cinder] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:03.530116 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f458c0c-ccad-48e5-8866-5f00dd7a927b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:03.530819 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f458c0c-ccad-48e5-8866-5f00dd7a927b admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.531101 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f458c0c-ccad-48e5-8866-5f00dd7a927b admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.531375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f458c0c-ccad-48e5-8866-5f00dd7a927b admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.532058 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f458c0c-ccad-48e5-8866-5f00dd7a927b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:03.534010 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f458c0c-ccad-48e5-8866-5f00dd7a927b admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:03.541081 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6afa78-5de5-4070-a0de-5a1d6691b217 service cinder] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:03.548197 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0573e5-01e9-4cb2-ac63-b47096c0dddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:03.548594 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0573e5-01e9-4cb2-ac63-b47096c0dddc admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.548914 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0573e5-01e9-4cb2-ac63-b47096c0dddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.549250 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0573e5-01e9-4cb2-ac63-b47096c0dddc admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.549896 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0573e5-01e9-4cb2-ac63-b47096c0dddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:03.552951 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0573e5-01e9-4cb2-ac63-b47096c0dddc admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:03.571605 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 936/1873] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:03.575683 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0573e5-01e9-4cb2-ac63-b47096c0dddc admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:03.578807 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 938/1874] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:03 2022] POST /identity/v3/users => generated 278 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:03.581111 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f458c0c-ccad-48e5-8866-5f00dd7a927b admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:03.592965 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0573e5-01e9-4cb2-ac63-b47096c0dddc admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:03.600300 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f458c0c-ccad-48e5-8866-5f00dd7a927b admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:03.605796 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690328e-aede-4cde-bdff-ce8ac20d2140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:03.606740 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690328e-aede-4cde-bdff-ce8ac20d2140 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.607029 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690328e-aede-4cde-bdff-ce8ac20d2140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.607320 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690328e-aede-4cde-bdff-ce8ac20d2140 admin admin] PATH_INFO: `/v3/projects/22291033461d41a5a68f5f013a879e2c/users/2af2cd17d5654cabbf7e042d3c6224b8/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.611722 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690328e-aede-4cde-bdff-ce8ac20d2140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22291033461d41a5a68f5f013a879e2c, user_id=2af2cd17d5654cabbf7e042d3c6224b8, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:03.614285 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef538e3-e727-4fca-b357-fa4b9cadd8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:03.617603 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef538e3-e727-4fca-b357-fa4b9cadd8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.617929 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef538e3-e727-4fca-b357-fa4b9cadd8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.618211 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef538e3-e727-4fca-b357-fa4b9cadd8c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.619592 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef538e3-e727-4fca-b357-fa4b9cadd8c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:03.623169 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef538e3-e727-4fca-b357-fa4b9cadd8c8 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:03.624697 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690328e-aede-4cde-bdff-ce8ac20d2140 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:03.649500 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 939/1875] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:21:03.657131 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 937/1876] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:03 2022] PUT /identity/v3/projects/22291033461d41a5a68f5f013a879e2c/users/2af2cd17d5654cabbf7e042d3c6224b8/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:03.657293 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef538e3-e727-4fca-b357-fa4b9cadd8c8 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:03.673785 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef538e3-e727-4fca-b357-fa4b9cadd8c8 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:03.742276 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:03.801646 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e674f62-4227-4790-a1fc-3ebd422dad06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:03.802989 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e674f62-4227-4790-a1fc-3ebd422dad06 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.803564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e674f62-4227-4790-a1fc-3ebd422dad06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.804969 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e674f62-4227-4790-a1fc-3ebd422dad06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.806919 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e674f62-4227-4790-a1fc-3ebd422dad06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:03.810003 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e674f62-4227-4790-a1fc-3ebd422dad06 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:03.833744 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 940/1877] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:03.838272 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690328e-aede-4cde-bdff-ce8ac20d2140 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:03.855926 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e674f62-4227-4790-a1fc-3ebd422dad06 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:03.857682 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690328e-aede-4cde-bdff-ce8ac20d2140 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:03.864052 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eee9d3-eb5c-458f-b9d1-e52ffc12a983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:03.865155 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eee9d3-eb5c-458f-b9d1-e52ffc12a983 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.865439 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eee9d3-eb5c-458f-b9d1-e52ffc12a983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.865716 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eee9d3-eb5c-458f-b9d1-e52ffc12a983 admin admin] PATH_INFO: `/v3/projects/fa2b6ae3d1bc413f94dda358c4da784c/users/e12b7df75e0c4695a29bf7d7b49f5bd6/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.906625 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eee9d3-eb5c-458f-b9d1-e52ffc12a983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa2b6ae3d1bc413f94dda358c4da784c, user_id=e12b7df75e0c4695a29bf7d7b49f5bd6, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:03.914721 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eee9d3-eb5c-458f-b9d1-e52ffc12a983 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:03.948195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 938/1878] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:03 2022] PUT /identity/v3/projects/fa2b6ae3d1bc413f94dda358c4da784c/users/e12b7df75e0c4695a29bf7d7b49f5bd6/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:03.959645 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a2c87-b1b2-48a1-b800-7104d5d51844 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.960110 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a2c87-b1b2-48a1-b800-7104d5d51844 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.961096 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a2c87-b1b2-48a1-b800-7104d5d51844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.985392 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e674f62-4227-4790-a1fc-3ebd422dad06 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:04.040615 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-147a2c87-b1b2-48a1-b800-7104d5d51844 None None] MFA Rules not processed for user `e12b7df75e0c4695a29bf7d7b49f5bd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:04.044464 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-147a2c87-b1b2-48a1-b800-7104d5d51844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:04.087699 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:04.095327 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7291373-af24-4093-843e-0834709e76f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:04.095953 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7291373-af24-4093-843e-0834709e76f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:04.096234 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7291373-af24-4093-843e-0834709e76f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:04.096819 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7291373-af24-4093-843e-0834709e76f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:04.103393 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-b7291373-af24-4093-843e-0834709e76f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:04.156970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 939/1879] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:03 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:04.164813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a2c87-b1b2-48a1-b800-7104d5d51844 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:04.181974 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7291373-af24-4093-843e-0834709e76f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:04.183460 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7291373-af24-4093-843e-0834709e76f8 service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:04.193992 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 941/1880] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:03 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:04.239839 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a2c87-b1b2-48a1-b800-7104d5d51844 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:04.246588 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccba083-c523-4401-bca2-3acf85499ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:04.248538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccba083-c523-4401-bca2-3acf85499ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:04.248833 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccba083-c523-4401-bca2-3acf85499ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:04.249114 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccba083-c523-4401-bca2-3acf85499ea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:04.249823 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccba083-c523-4401-bca2-3acf85499ea0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:04.251802 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccba083-c523-4401-bca2-3acf85499ea0 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:04.286491 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 940/1881] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:04 2022] POST /identity/v3/projects => generated 357 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:04.292177 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7291373-af24-4093-843e-0834709e76f8 service cinder] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:04.308153 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7291373-af24-4093-843e-0834709e76f8 service cinder] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:04.369150 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:04.394792 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08adf11-974e-45ca-9e14-34dc47a2a84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:04.395567 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08adf11-974e-45ca-9e14-34dc47a2a84b admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:04.395804 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08adf11-974e-45ca-9e14-34dc47a2a84b admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:04.396590 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08adf11-974e-45ca-9e14-34dc47a2a84b admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:04.396944 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08adf11-974e-45ca-9e14-34dc47a2a84b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:04.400248 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08adf11-974e-45ca-9e14-34dc47a2a84b admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:04.426723 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 942/1882] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:04 2022] POST /identity/v3/users => generated 285 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:04.431088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccba083-c523-4401-bca2-3acf85499ea0 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:04.446684 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccba083-c523-4401-bca2-3acf85499ea0 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:04.457643 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e7cad-ebf6-48d4-b3e1-9cdb893142ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:04.458438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e7cad-ebf6-48d4-b3e1-9cdb893142ef admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:04.459331 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e7cad-ebf6-48d4-b3e1-9cdb893142ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:04.460135 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e7cad-ebf6-48d4-b3e1-9cdb893142ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:04.461686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e7cad-ebf6-48d4-b3e1-9cdb893142ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:04.464369 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e7cad-ebf6-48d4-b3e1-9cdb893142ef admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:04.483083 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 941/1883] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:04.487213 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08adf11-974e-45ca-9e14-34dc47a2a84b admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:04.499417 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08adf11-974e-45ca-9e14-34dc47a2a84b admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:04.507519 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca0acd-5872-483a-8199-ef854ba2999d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:04.508907 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca0acd-5872-483a-8199-ef854ba2999d admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:04.509470 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca0acd-5872-483a-8199-ef854ba2999d admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:04.509954 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca0acd-5872-483a-8199-ef854ba2999d admin admin] PATH_INFO: `/v3/projects/29739a9103a34b668740a58b25371036/users/b12c96f77c444b7289f3a3d07b37aaa2/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:04.541598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ca0acd-5872-483a-8199-ef854ba2999d admin admin] RBAC: Authorizing `identity:create_grant(project_id=29739a9103a34b668740a58b25371036, user_id=b12c96f77c444b7289f3a3d07b37aaa2, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:04.545306 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ca0acd-5872-483a-8199-ef854ba2999d admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:04.566685 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 943/1884] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:04 2022] PUT /identity/v3/projects/29739a9103a34b668740a58b25371036/users/b12c96f77c444b7289f3a3d07b37aaa2/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:21:04.570470 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e7cad-ebf6-48d4-b3e1-9cdb893142ef admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:04.582727 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e7cad-ebf6-48d4-b3e1-9cdb893142ef admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:04.652564 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e495bb-e516-42c1-b321-7d9aa080afee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:04.653251 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e495bb-e516-42c1-b321-7d9aa080afee admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:04.653534 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e495bb-e516-42c1-b321-7d9aa080afee admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:04.654058 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e495bb-e516-42c1-b321-7d9aa080afee admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:04.655222 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e495bb-e516-42c1-b321-7d9aa080afee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:04.656831 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e495bb-e516-42c1-b321-7d9aa080afee admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:04.670669 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 942/1885] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:04.672742 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca0acd-5872-483a-8199-ef854ba2999d admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:04.686561 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca0acd-5872-483a-8199-ef854ba2999d admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:04.691539 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1257ab-4b09-41d1-b48b-90d938eaf36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:04.692434 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1257ab-4b09-41d1-b48b-90d938eaf36b admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:04.692717 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1257ab-4b09-41d1-b48b-90d938eaf36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:04.692987 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1257ab-4b09-41d1-b48b-90d938eaf36b admin admin] PATH_INFO: `/v3/projects/29739a9103a34b668740a58b25371036/users/b12c96f77c444b7289f3a3d07b37aaa2/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:04.695351 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1257ab-4b09-41d1-b48b-90d938eaf36b admin admin] RBAC: Authorizing `identity:create_grant(project_id=29739a9103a34b668740a58b25371036, user_id=b12c96f77c444b7289f3a3d07b37aaa2, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:04.704775 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1257ab-4b09-41d1-b48b-90d938eaf36b admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:04.706742 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bff5e6-392c-40f5-b77f-131df07385d4 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:04.707052 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bff5e6-392c-40f5-b77f-131df07385d4 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:04.707330 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bff5e6-392c-40f5-b77f-131df07385d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:04.711213 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 944/1886] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:04 2022] PUT /identity/v3/projects/29739a9103a34b668740a58b25371036/users/b12c96f77c444b7289f3a3d07b37aaa2/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:04.722439 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09b841-b03c-412f-aad4-063286c17ef6 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:04.722439 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09b841-b03c-412f-aad4-063286c17ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:04.722752 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09b841-b03c-412f-aad4-063286c17ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:04.746042 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-97bff5e6-392c-40f5-b77f-131df07385d4 None None] MFA Rules not processed for user `2af2cd17d5654cabbf7e042d3c6224b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:04.747309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-97bff5e6-392c-40f5-b77f-131df07385d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:04.753940 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-6c09b841-b03c-412f-aad4-063286c17ef6 None None] MFA Rules not processed for user `b12c96f77c444b7289f3a3d07b37aaa2`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:04.755424 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-6c09b841-b03c-412f-aad4-063286c17ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:04.767841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:04.830713 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 943/1887] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:04.847487 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bff5e6-392c-40f5-b77f-131df07385d4 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:04.848801 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 945/1888] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:04 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:21:04.859653 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09b841-b03c-412f-aad4-063286c17ef6 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:04.864174 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-6c09b841-b03c-412f-aad4-063286c17ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:04.921920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bff5e6-392c-40f5-b77f-131df07385d4 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:04.926271 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b248ca-a01d-40d7-89eb-c64799817c3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:04.927037 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b248ca-a01d-40d7-89eb-c64799817c3d service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:04.927266 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b248ca-a01d-40d7-89eb-c64799817c3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:04.927547 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b248ca-a01d-40d7-89eb-c64799817c3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:04.941460 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09b841-b03c-412f-aad4-063286c17ef6 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:04.946081 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c516f-ae5d-4c99-a7aa-0446be821c0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:04.946905 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c516f-ae5d-4c99-a7aa-0446be821c0b service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:04.947256 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c516f-ae5d-4c99-a7aa-0446be821c0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:04.947538 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c516f-ae5d-4c99-a7aa-0446be821c0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:04.957670 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c516f-ae5d-4c99-a7aa-0446be821c0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:04.959157 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c516f-ae5d-4c99-a7aa-0446be821c0b service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:04.969635 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 946/1889] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:04 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:05.020723 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b248ca-a01d-40d7-89eb-c64799817c3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:05.022183 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b248ca-a01d-40d7-89eb-c64799817c3d service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:05.032835 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 944/1890] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:05.078467 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c516f-ae5d-4c99-a7aa-0446be821c0b service cinder] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:05.088098 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c516f-ae5d-4c99-a7aa-0446be821c0b service cinder] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:05.092019 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9a974-30e2-41ee-a274-a95f0d38b303 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:05.092670 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9a974-30e2-41ee-a274-a95f0d38b303 service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:05.092958 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9a974-30e2-41ee-a274-a95f0d38b303 service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:05.093238 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9a974-30e2-41ee-a274-a95f0d38b303 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:05.117319 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:05.158235 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9a974-30e2-41ee-a274-a95f0d38b303 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:05.160017 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9a974-30e2-41ee-a274-a95f0d38b303 service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:05.169651 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 947/1891] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:05 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:07.768779 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b248ca-a01d-40d7-89eb-c64799817c3d service cinder] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:07.778993 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b248ca-a01d-40d7-89eb-c64799817c3d service cinder] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:07.783771 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e1c53-97fb-48ae-937c-70d1ad5bab55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:07.784452 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e1c53-97fb-48ae-937c-70d1ad5bab55 service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:07.784740 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e1c53-97fb-48ae-937c-70d1ad5bab55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:07.785017 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e1c53-97fb-48ae-937c-70d1ad5bab55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:07.795078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e1c53-97fb-48ae-937c-70d1ad5bab55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:07.796518 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e1c53-97fb-48ae-937c-70d1ad5bab55 service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:07.806493 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 945/1892] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:15.165036 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=17 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:16.293823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a773a57-81e0-4f50-b5c4-735a191cc727 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:16.293823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a773a57-81e0-4f50-b5c4-735a191cc727 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:16.293823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a773a57-81e0-4f50-b5c4-735a191cc727 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:16.295173 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 948/1893] 10.222.0.13 () {54 vars in 921 bytes} [Wed Jun 29 12:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:21:16.309023 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b29cbc-6bea-4114-a16c-a9003682ade7 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:16.309547 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b29cbc-6bea-4114-a16c-a9003682ade7 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:16.309740 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b29cbc-6bea-4114-a16c-a9003682ade7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:16.338101 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-35b29cbc-6bea-4114-a16c-a9003682ade7 None None] MFA Rules not processed for user `3fbcf547421b42e4b520f9246326bff8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:16.339519 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-35b29cbc-6bea-4114-a16c-a9003682ade7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:16.428889 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:16.476720 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 946/1894] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Jun 29 12:21:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:16.490618 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a773a57-81e0-4f50-b5c4-735a191cc727 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:16.493144 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-9a773a57-81e0-4f50-b5c4-735a191cc727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:16.539199 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a773a57-81e0-4f50-b5c4-735a191cc727 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:16.548284 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660af64f-9914-4bcf-b130-25c92e3568bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:16.548956 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660af64f-9914-4bcf-b130-25c92e3568bd service nova] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:16.549247 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660af64f-9914-4bcf-b130-25c92e3568bd service nova] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:16.549522 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660af64f-9914-4bcf-b130-25c92e3568bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:16.560222 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660af64f-9914-4bcf-b130-25c92e3568bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:16.561865 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660af64f-9914-4bcf-b130-25c92e3568bd service nova] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:16.576784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 949/1895] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:17.739647 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b29cbc-6bea-4114-a16c-a9003682ade7 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:17.802041 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b29cbc-6bea-4114-a16c-a9003682ade7 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:17.807093 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df44bf-81ea-41c7-89c8-deb087a80d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:17.807964 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df44bf-81ea-41c7-89c8-deb087a80d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:17.808245 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df44bf-81ea-41c7-89c8-deb087a80d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:17.808646 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df44bf-81ea-41c7-89c8-deb087a80d24 admin admin] PATH_INFO: `/v3/users/661c70073e51429bb3f9719c8bf7408b` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:17.809820 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df44bf-81ea-41c7-89c8-deb087a80d24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=661c70073e51429bb3f9719c8bf7408b)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:17.811758 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df44bf-81ea-41c7-89c8-deb087a80d24 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:17.857214 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-10df44bf-81ea-41c7-89c8-deb087a80d24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '661c70073e51429bb3f9719c8bf7408b'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:17.857950 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-10df44bf-81ea-41c7-89c8-deb087a80d24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '661c70073e51429bb3f9719c8bf7408b'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:17.870941 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-10df44bf-81ea-41c7-89c8-deb087a80d24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '661c70073e51429bb3f9719c8bf7408b'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:17.871584 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-10df44bf-81ea-41c7-89c8-deb087a80d24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '661c70073e51429bb3f9719c8bf7408b'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:17.878489 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-10df44bf-81ea-41c7-89c8-deb087a80d24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '661c70073e51429bb3f9719c8bf7408b'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:17.891447 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 947/1896] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:17 2022] DELETE /identity/v3/users/661c70073e51429bb3f9719c8bf7408b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:17.896082 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cbf49-5f17-44de-99f3-fd7df6f3813e None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:17.896602 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cbf49-5f17-44de-99f3-fd7df6f3813e None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:17.896706 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cbf49-5f17-44de-99f3-fd7df6f3813e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:17.915035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-a59cbf49-5f17-44de-99f3-fd7df6f3813e None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:17.916734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-a59cbf49-5f17-44de-99f3-fd7df6f3813e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:17.999735 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 950/1897] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:21:18.010804 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df44bf-81ea-41c7-89c8-deb087a80d24 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:18.012620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-10df44bf-81ea-41c7-89c8-deb087a80d24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:18.132894 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df44bf-81ea-41c7-89c8-deb087a80d24 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:18.144063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed3445-9d88-4f8a-9bc2-56532420734d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:18.145103 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed3445-9d88-4f8a-9bc2-56532420734d service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:18.145743 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed3445-9d88-4f8a-9bc2-56532420734d service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:18.146326 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed3445-9d88-4f8a-9bc2-56532420734d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:18.176166 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed3445-9d88-4f8a-9bc2-56532420734d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:18.177440 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed3445-9d88-4f8a-9bc2-56532420734d service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:18.183338 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cbf49-5f17-44de-99f3-fd7df6f3813e None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:18.184996 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-a59cbf49-5f17-44de-99f3-fd7df6f3813e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:18.208008 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cbf49-5f17-44de-99f3-fd7df6f3813e None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:18.214399 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 948/1898] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:18.218837 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1d42e-726e-4ba1-b461-0627a92a22f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:18.221831 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1d42e-726e-4ba1-b461-0627a92a22f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:18.223701 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1d42e-726e-4ba1-b461-0627a92a22f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:18.225518 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1d42e-726e-4ba1-b461-0627a92a22f4 admin admin] PATH_INFO: `/v3/users/6d33b26a4dfa40269878ec167ad60f1c` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:18.229289 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc1d42e-726e-4ba1-b461-0627a92a22f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d33b26a4dfa40269878ec167ad60f1c)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:18.232717 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc1d42e-726e-4ba1-b461-0627a92a22f4 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:18.362765 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-ddc1d42e-726e-4ba1-b461-0627a92a22f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d33b26a4dfa40269878ec167ad60f1c'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:18.363118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-ddc1d42e-726e-4ba1-b461-0627a92a22f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d33b26a4dfa40269878ec167ad60f1c'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:18.389618 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-ddc1d42e-726e-4ba1-b461-0627a92a22f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d33b26a4dfa40269878ec167ad60f1c'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:18.418804 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-ddc1d42e-726e-4ba1-b461-0627a92a22f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d33b26a4dfa40269878ec167ad60f1c'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:18.421861 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-ddc1d42e-726e-4ba1-b461-0627a92a22f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d33b26a4dfa40269878ec167ad60f1c'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:18.443346 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 951/1899] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:18 2022] DELETE /identity/v3/users/6d33b26a4dfa40269878ec167ad60f1c => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:18.449056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0614c-6dab-4c3b-b457-c6df3ef7ed06 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:18.449454 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0614c-6dab-4c3b-b457-c6df3ef7ed06 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:18.449850 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0614c-6dab-4c3b-b457-c6df3ef7ed06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:18.476753 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-dab0614c-6dab-4c3b-b457-c6df3ef7ed06 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:18.478054 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-dab0614c-6dab-4c3b-b457-c6df3ef7ed06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:18.486329 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:18.619874 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 949/1900] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:18.638624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1d42e-726e-4ba1-b461-0627a92a22f4 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:18.643434 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-ddc1d42e-726e-4ba1-b461-0627a92a22f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:18.800374 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1d42e-726e-4ba1-b461-0627a92a22f4 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:18.805799 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e4fe0-d933-4df0-a06e-16d8f807fe4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:18.806358 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e4fe0-d933-4df0-a06e-16d8f807fe4e service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:18.806723 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e4fe0-d933-4df0-a06e-16d8f807fe4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:18.807059 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e4fe0-d933-4df0-a06e-16d8f807fe4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:18.820076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e4fe0-d933-4df0-a06e-16d8f807fe4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:18.821528 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e4fe0-d933-4df0-a06e-16d8f807fe4e service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:18.842186 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 952/1901] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:18.888332 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0614c-6dab-4c3b-b457-c6df3ef7ed06 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:18.889891 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-dab0614c-6dab-4c3b-b457-c6df3ef7ed06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:18.911215 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0614c-6dab-4c3b-b457-c6df3ef7ed06 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:18.923038 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb541da1-9be3-490e-a26f-4ed8bf57560f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:18.923958 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb541da1-9be3-490e-a26f-4ed8bf57560f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:18.924226 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb541da1-9be3-490e-a26f-4ed8bf57560f admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:18.924509 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb541da1-9be3-490e-a26f-4ed8bf57560f admin admin] PATH_INFO: `/v3/projects/5ee0a099b9724b438c6c222bf0ee1998` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:18.925877 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb541da1-9be3-490e-a26f-4ed8bf57560f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ee0a099b9724b438c6c222bf0ee1998)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:18.929471 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb541da1-9be3-490e-a26f-4ed8bf57560f admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:19.005803 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-bb541da1-9be3-490e-a26f-4ed8bf57560f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ee0a099b9724b438c6c222bf0ee1998', 'request_id': 'req-bb541da1-9be3-490e-a26f-4ed8bf57560f'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:19.016752 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-bb541da1-9be3-490e-a26f-4ed8bf57560f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ee0a099b9724b438c6c222bf0ee1998', 'request_id': 'req-bb541da1-9be3-490e-a26f-4ed8bf57560f'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:19.024525 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-bb541da1-9be3-490e-a26f-4ed8bf57560f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ee0a099b9724b438c6c222bf0ee1998', 'request_id': 'req-bb541da1-9be3-490e-a26f-4ed8bf57560f'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:19.036341 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-bb541da1-9be3-490e-a26f-4ed8bf57560f admin admin] The token cache is being invalidate because project 5ee0a099b9724b438c6c222bf0ee1998 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:19.036710 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-bb541da1-9be3-490e-a26f-4ed8bf57560f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:19.038142 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-bb541da1-9be3-490e-a26f-4ed8bf57560f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:19.039880 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 950/1902] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:18 2022] DELETE /identity/v3/projects/5ee0a099b9724b438c6c222bf0ee1998 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:19.043878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e4fe0-d933-4df0-a06e-16d8f807fe4e service neutron] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:19.049479 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:19.057272 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e4fe0-d933-4df0-a06e-16d8f807fe4e service neutron] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:19.133727 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c1b61-825b-4d97-bc35-dc1856cbe47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:19.134708 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c1b61-825b-4d97-bc35-dc1856cbe47c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:19.135064 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c1b61-825b-4d97-bc35-dc1856cbe47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:19.135367 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c1b61-825b-4d97-bc35-dc1856cbe47c admin admin] PATH_INFO: `/v3/users/7317b67c08084c0ba2c93edc53dffe9b` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:19.136711 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c1b61-825b-4d97-bc35-dc1856cbe47c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7317b67c08084c0ba2c93edc53dffe9b)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:19.138811 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c1b61-825b-4d97-bc35-dc1856cbe47c admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:19.191694 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-290c1b61-825b-4d97-bc35-dc1856cbe47c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7317b67c08084c0ba2c93edc53dffe9b'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:19.192386 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-290c1b61-825b-4d97-bc35-dc1856cbe47c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7317b67c08084c0ba2c93edc53dffe9b'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:19.207011 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-290c1b61-825b-4d97-bc35-dc1856cbe47c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7317b67c08084c0ba2c93edc53dffe9b'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:19.217213 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-290c1b61-825b-4d97-bc35-dc1856cbe47c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7317b67c08084c0ba2c93edc53dffe9b'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:19.217858 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-290c1b61-825b-4d97-bc35-dc1856cbe47c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7317b67c08084c0ba2c93edc53dffe9b'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:19.231175 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 953/1903] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:19 2022] DELETE /identity/v3/users/7317b67c08084c0ba2c93edc53dffe9b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:19.332906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb541da1-9be3-490e-a26f-4ed8bf57560f admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:19.334937 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-bb541da1-9be3-490e-a26f-4ed8bf57560f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:19.370082 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb541da1-9be3-490e-a26f-4ed8bf57560f admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:19.462073 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789ea35-1734-4f2b-9797-cafee1d185b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:19.463778 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789ea35-1734-4f2b-9797-cafee1d185b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:19.464131 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789ea35-1734-4f2b-9797-cafee1d185b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:19.464620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789ea35-1734-4f2b-9797-cafee1d185b1 admin admin] PATH_INFO: `/v3/projects/1b2b40e489194cc3982aba965a9f1988` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:19.467081 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789ea35-1734-4f2b-9797-cafee1d185b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b2b40e489194cc3982aba965a9f1988)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:19.469647 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789ea35-1734-4f2b-9797-cafee1d185b1 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:19.523902 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:19.555900 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-2789ea35-1734-4f2b-9797-cafee1d185b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b2b40e489194cc3982aba965a9f1988', 'request_id': 'req-2789ea35-1734-4f2b-9797-cafee1d185b1'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:19.570204 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-2789ea35-1734-4f2b-9797-cafee1d185b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b2b40e489194cc3982aba965a9f1988', 'request_id': 'req-2789ea35-1734-4f2b-9797-cafee1d185b1'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:19.583378 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-2789ea35-1734-4f2b-9797-cafee1d185b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b2b40e489194cc3982aba965a9f1988', 'request_id': 'req-2789ea35-1734-4f2b-9797-cafee1d185b1'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:19.597706 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-2789ea35-1734-4f2b-9797-cafee1d185b1 admin admin] The token cache is being invalidate because project 1b2b40e489194cc3982aba965a9f1988 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:19.598347 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-2789ea35-1734-4f2b-9797-cafee1d185b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:19.599354 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-2789ea35-1734-4f2b-9797-cafee1d185b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:19.605144 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 951/1904] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:19 2022] DELETE /identity/v3/projects/1b2b40e489194cc3982aba965a9f1988 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:19.606024 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c1b61-825b-4d97-bc35-dc1856cbe47c admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:19.607532 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-290c1b61-825b-4d97-bc35-dc1856cbe47c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:19.627866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c1b61-825b-4d97-bc35-dc1856cbe47c admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:19.715987 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789ea35-1734-4f2b-9797-cafee1d185b1 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:19.718600 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-2789ea35-1734-4f2b-9797-cafee1d185b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:19.751624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf906d20-6052-4948-bbb8-4b6439b4301a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:19.752692 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf906d20-6052-4948-bbb8-4b6439b4301a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:19.752991 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf906d20-6052-4948-bbb8-4b6439b4301a admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:19.753277 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf906d20-6052-4948-bbb8-4b6439b4301a admin admin] PATH_INFO: `/v3/users/db840e43fac24bca8cbf0dfb43cebf9a` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:19.765611 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf906d20-6052-4948-bbb8-4b6439b4301a admin admin] RBAC: Authorizing `identity:delete_user(user_id=db840e43fac24bca8cbf0dfb43cebf9a)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:19.770166 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf906d20-6052-4948-bbb8-4b6439b4301a admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:19.805982 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:19.821373 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789ea35-1734-4f2b-9797-cafee1d185b1 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:19.827550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1358ee5-24d4-44c9-928b-0ca969cd5b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:19.828800 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1358ee5-24d4-44c9-928b-0ca969cd5b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:19.829552 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1358ee5-24d4-44c9-928b-0ca969cd5b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:19.830014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1358ee5-24d4-44c9-928b-0ca969cd5b42 admin admin] PATH_INFO: `/v3/projects/3ca3c6c1fbbb483ebd6b5584eb6b1d5f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:19.831371 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1358ee5-24d4-44c9-928b-0ca969cd5b42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ca3c6c1fbbb483ebd6b5584eb6b1d5f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:19.834088 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-bf906d20-6052-4948-bbb8-4b6439b4301a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db840e43fac24bca8cbf0dfb43cebf9a'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:19.834218 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1358ee5-24d4-44c9-928b-0ca969cd5b42 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:19.835515 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-bf906d20-6052-4948-bbb8-4b6439b4301a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db840e43fac24bca8cbf0dfb43cebf9a'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:19.854666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-bf906d20-6052-4948-bbb8-4b6439b4301a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db840e43fac24bca8cbf0dfb43cebf9a'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:19.864702 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-bf906d20-6052-4948-bbb8-4b6439b4301a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db840e43fac24bca8cbf0dfb43cebf9a'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:19.865376 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-bf906d20-6052-4948-bbb8-4b6439b4301a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db840e43fac24bca8cbf0dfb43cebf9a'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:19.885718 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-e1358ee5-24d4-44c9-928b-0ca969cd5b42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ca3c6c1fbbb483ebd6b5584eb6b1d5f', 'request_id': 'req-e1358ee5-24d4-44c9-928b-0ca969cd5b42'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:19.888001 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 954/1905] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:19 2022] DELETE /identity/v3/users/db840e43fac24bca8cbf0dfb43cebf9a => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:19.895550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-e1358ee5-24d4-44c9-928b-0ca969cd5b42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ca3c6c1fbbb483ebd6b5584eb6b1d5f', 'request_id': 'req-e1358ee5-24d4-44c9-928b-0ca969cd5b42'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:19.904911 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-e1358ee5-24d4-44c9-928b-0ca969cd5b42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ca3c6c1fbbb483ebd6b5584eb6b1d5f', 'request_id': 'req-e1358ee5-24d4-44c9-928b-0ca969cd5b42'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:19.920418 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-e1358ee5-24d4-44c9-928b-0ca969cd5b42 admin admin] The token cache is being invalidate because project 3ca3c6c1fbbb483ebd6b5584eb6b1d5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:19.921222 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-e1358ee5-24d4-44c9-928b-0ca969cd5b42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:19.922166 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-e1358ee5-24d4-44c9-928b-0ca969cd5b42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:19.924858 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 952/1906] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:19 2022] DELETE /identity/v3/projects/3ca3c6c1fbbb483ebd6b5584eb6b1d5f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:19.931257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa8da7-7510-4a9b-a7c2-5ec3551d70ea None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:19.931594 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa8da7-7510-4a9b-a7c2-5ec3551d70ea None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:19.931873 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa8da7-7510-4a9b-a7c2-5ec3551d70ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:19.956406 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-e1fa8da7-7510-4a9b-a7c2-5ec3551d70ea None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:19.957858 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-e1fa8da7-7510-4a9b-a7c2-5ec3551d70ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:20.063333 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b78e2-5e38-48f6-afd5-0315e90c5322 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:20.063928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b78e2-5e38-48f6-afd5-0315e90c5322 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:20.064407 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b78e2-5e38-48f6-afd5-0315e90c5322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:20.076965 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 955/1907] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:20.115359 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-566b78e2-5e38-48f6-afd5-0315e90c5322 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:20.117299 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-566b78e2-5e38-48f6-afd5-0315e90c5322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:20.130614 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 953/1908] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:20.132592 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa8da7-7510-4a9b-a7c2-5ec3551d70ea None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:20.153549 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa8da7-7510-4a9b-a7c2-5ec3551d70ea None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:20.159533 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711088e2-eca7-41ad-b969-61b8402c3b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:20.160405 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711088e2-eca7-41ad-b969-61b8402c3b78 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:20.160899 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711088e2-eca7-41ad-b969-61b8402c3b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:20.161176 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711088e2-eca7-41ad-b969-61b8402c3b78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:20.161908 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711088e2-eca7-41ad-b969-61b8402c3b78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:21:20.162217 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711088e2-eca7-41ad-b969-61b8402c3b78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:20.163923 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711088e2-eca7-41ad-b969-61b8402c3b78 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:20.177028 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 956/1909] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:21:20.182247 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b78e2-5e38-48f6-afd5-0315e90c5322 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:20.201516 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b78e2-5e38-48f6-afd5-0315e90c5322 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:20.217650 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e0dbc-6d2d-4221-b05e-74b0cb67f213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:20.218832 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e0dbc-6d2d-4221-b05e-74b0cb67f213 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:20.219161 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e0dbc-6d2d-4221-b05e-74b0cb67f213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:20.219614 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e0dbc-6d2d-4221-b05e-74b0cb67f213 admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:20.220623 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e0dbc-6d2d-4221-b05e-74b0cb67f213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:20.224373 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e0dbc-6d2d-4221-b05e-74b0cb67f213 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:20.291171 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 954/1910] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:20 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:21:20.291553 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711088e2-eca7-41ad-b969-61b8402c3b78 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:20.293222 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-711088e2-eca7-41ad-b969-61b8402c3b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:20.295526 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e0dbc-6d2d-4221-b05e-74b0cb67f213 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:20.322145 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711088e2-eca7-41ad-b969-61b8402c3b78 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:20.368305 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:20.418765 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35f729-eb87-4fc6-b926-d805b0850b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:20.419869 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35f729-eb87-4fc6-b926-d805b0850b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:20.420153 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35f729-eb87-4fc6-b926-d805b0850b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:20.420429 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35f729-eb87-4fc6-b926-d805b0850b1b admin admin] PATH_INFO: `/v3/projects/c143650744f54283bb8f94d5de38bea5` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:20.421248 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e0dbc-6d2d-4221-b05e-74b0cb67f213 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:20.421764 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35f729-eb87-4fc6-b926-d805b0850b1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c143650744f54283bb8f94d5de38bea5)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:20.423737 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35f729-eb87-4fc6-b926-d805b0850b1b admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:20.427383 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457e7ab-7391-4557-acdf-5b327b33fbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:20.429924 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457e7ab-7391-4557-acdf-5b327b33fbb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:20.430315 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457e7ab-7391-4557-acdf-5b327b33fbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:20.430773 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457e7ab-7391-4557-acdf-5b327b33fbb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:20.432034 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457e7ab-7391-4557-acdf-5b327b33fbb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:20.434429 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457e7ab-7391-4557-acdf-5b327b33fbb3 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:20.471481 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 955/1911] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:20 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:20.476077 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457e7ab-7391-4557-acdf-5b327b33fbb3 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:20.482745 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:20.487217 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457e7ab-7391-4557-acdf-5b327b33fbb3 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:20.506552 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-af35f729-eb87-4fc6-b926-d805b0850b1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c143650744f54283bb8f94d5de38bea5', 'request_id': 'req-af35f729-eb87-4fc6-b926-d805b0850b1b'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:20.513446 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-af35f729-eb87-4fc6-b926-d805b0850b1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c143650744f54283bb8f94d5de38bea5', 'request_id': 'req-af35f729-eb87-4fc6-b926-d805b0850b1b'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:20.519669 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-af35f729-eb87-4fc6-b926-d805b0850b1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c143650744f54283bb8f94d5de38bea5', 'request_id': 'req-af35f729-eb87-4fc6-b926-d805b0850b1b'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:20.535660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-af35f729-eb87-4fc6-b926-d805b0850b1b admin admin] The token cache is being invalidate because project c143650744f54283bb8f94d5de38bea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:20.536316 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-af35f729-eb87-4fc6-b926-d805b0850b1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:20.537025 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-af35f729-eb87-4fc6-b926-d805b0850b1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:20.543861 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 957/1912] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:20 2022] DELETE /identity/v3/projects/c143650744f54283bb8f94d5de38bea5 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:20.548466 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7e933-64cf-45f7-a6a0-a1514aa2d0de None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:20.548757 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7e933-64cf-45f7-a6a0-a1514aa2d0de None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:20.549033 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7e933-64cf-45f7-a6a0-a1514aa2d0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:20.560140 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c505d3c-e892-4e2b-b5f3-f90c35008d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:20.560969 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c505d3c-e892-4e2b-b5f3-f90c35008d1d admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:20.561260 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c505d3c-e892-4e2b-b5f3-f90c35008d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:20.561532 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c505d3c-e892-4e2b-b5f3-f90c35008d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:20.562253 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c505d3c-e892-4e2b-b5f3-f90c35008d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:20.564340 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c505d3c-e892-4e2b-b5f3-f90c35008d1d admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:20.567668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-c3b7e933-64cf-45f7-a6a0-a1514aa2d0de None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:20.568980 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-c3b7e933-64cf-45f7-a6a0-a1514aa2d0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:20.574995 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 956/1913] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:21:20.577628 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 958/1914] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:20.578880 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c505d3c-e892-4e2b-b5f3-f90c35008d1d admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:20.581766 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-0c505d3c-e892-4e2b-b5f3-f90c35008d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:20.585735 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22607ecc-548d-4b3e-b6c3-8d86b8a60c12 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:20.586106 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22607ecc-548d-4b3e-b6c3-8d86b8a60c12 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:20.586299 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22607ecc-548d-4b3e-b6c3-8d86b8a60c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:20.595468 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c505d3c-e892-4e2b-b5f3-f90c35008d1d admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:20.600851 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28747a3-3ea1-47d7-9c05-048defd599f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:20.601590 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28747a3-3ea1-47d7-9c05-048defd599f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:20.601958 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28747a3-3ea1-47d7-9c05-048defd599f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:20.602302 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28747a3-3ea1-47d7-9c05-048defd599f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:20.603130 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28747a3-3ea1-47d7-9c05-048defd599f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:20.604844 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28747a3-3ea1-47d7-9c05-048defd599f0 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:20.606047 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-22607ecc-548d-4b3e-b6c3-8d86b8a60c12 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:20.607854 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-22607ecc-548d-4b3e-b6c3-8d86b8a60c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:20.616340 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 957/1915] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:21:20.617046 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 959/1916] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:20.623188 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28747a3-3ea1-47d7-9c05-048defd599f0 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:20.623330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22607ecc-548d-4b3e-b6c3-8d86b8a60c12 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:20.633822 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28747a3-3ea1-47d7-9c05-048defd599f0 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:20.634794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22607ecc-548d-4b3e-b6c3-8d86b8a60c12 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:20.638691 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987683e8-7420-4594-b86f-7886bbe0cac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:20.639511 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6abab-4ae9-47d6-afb6-7cd6c5470269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:20.639627 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987683e8-7420-4594-b86f-7886bbe0cac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:20.639868 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987683e8-7420-4594-b86f-7886bbe0cac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:20.640145 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987683e8-7420-4594-b86f-7886bbe0cac6 admin admin] PATH_INFO: `/v3/projects/6a8a41d196a242ef9f560309991afc1d/users/de733b96d2a545dbbe2ad500d525e148/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:20.640246 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6abab-4ae9-47d6-afb6-7cd6c5470269 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:20.640437 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6abab-4ae9-47d6-afb6-7cd6c5470269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:20.640709 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6abab-4ae9-47d6-afb6-7cd6c5470269 admin admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:20.641432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6abab-4ae9-47d6-afb6-7cd6c5470269 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:21:20.641739 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6abab-4ae9-47d6-afb6-7cd6c5470269 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:20.643659 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6abab-4ae9-47d6-afb6-7cd6c5470269 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:20.657994 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987683e8-7420-4594-b86f-7886bbe0cac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a8a41d196a242ef9f560309991afc1d, user_id=de733b96d2a545dbbe2ad500d525e148, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:20.662748 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987683e8-7420-4594-b86f-7886bbe0cac6 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:20.664093 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 960/1917] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:21:20.668700 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6abab-4ae9-47d6-afb6-7cd6c5470269 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:20.682718 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6abab-4ae9-47d6-afb6-7cd6c5470269 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:20.697640 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 958/1918] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:20 2022] PUT /identity/v3/projects/6a8a41d196a242ef9f560309991afc1d/users/de733b96d2a545dbbe2ad500d525e148/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:20.707477 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221ff46-1785-4dbc-b478-6e4b617e83a8 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:20.707994 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221ff46-1785-4dbc-b478-6e4b617e83a8 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:20.708524 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221ff46-1785-4dbc-b478-6e4b617e83a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:20.753277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-6221ff46-1785-4dbc-b478-6e4b617e83a8 None None] MFA Rules not processed for user `de733b96d2a545dbbe2ad500d525e148`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:20.754528 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-6221ff46-1785-4dbc-b478-6e4b617e83a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:20.780671 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12f9e9-c0d7-4613-8edd-675e24c8c324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:20.781342 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12f9e9-c0d7-4613-8edd-675e24c8c324 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:20.782002 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12f9e9-c0d7-4613-8edd-675e24c8c324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:20.782283 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12f9e9-c0d7-4613-8edd-675e24c8c324 admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:20.782997 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12f9e9-c0d7-4613-8edd-675e24c8c324 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:20.785383 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12f9e9-c0d7-4613-8edd-675e24c8c324 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:20.831061 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 961/1919] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:20 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:20.835043 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12f9e9-c0d7-4613-8edd-675e24c8c324 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:20.841108 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 959/1920] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:20.853378 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221ff46-1785-4dbc-b478-6e4b617e83a8 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:20.857704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-6221ff46-1785-4dbc-b478-6e4b617e83a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:20.879157 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:20.949781 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221ff46-1785-4dbc-b478-6e4b617e83a8 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:20.953013 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12f9e9-c0d7-4613-8edd-675e24c8c324 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:20.958729 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb9f12-a104-4cd2-a0b0-390892dd2e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:20.959476 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb9f12-a104-4cd2-a0b0-390892dd2e25 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:20.959828 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb9f12-a104-4cd2-a0b0-390892dd2e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:20.960177 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb9f12-a104-4cd2-a0b0-390892dd2e25 admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:20.960960 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb9f12-a104-4cd2-a0b0-390892dd2e25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:20.963065 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb9f12-a104-4cd2-a0b0-390892dd2e25 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:20.992471 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 962/1921] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:20 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:20.994700 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb9f12-a104-4cd2-a0b0-390892dd2e25 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:21.009514 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb9f12-a104-4cd2-a0b0-390892dd2e25 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:21.015627 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb9d70-0803-4e32-a898-4cafe8023d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:21.016610 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb9d70-0803-4e32-a898-4cafe8023d29 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:21.016902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb9d70-0803-4e32-a898-4cafe8023d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:21.017177 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb9d70-0803-4e32-a898-4cafe8023d29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:21.018354 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb9d70-0803-4e32-a898-4cafe8023d29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:21.020790 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb9d70-0803-4e32-a898-4cafe8023d29 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:21.023127 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:21.036366 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 963/1922] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:21.041117 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb9d70-0803-4e32-a898-4cafe8023d29 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:21.055317 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62378b55-17f7-4052-aab3-cca27cb018b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:21.058700 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62378b55-17f7-4052-aab3-cca27cb018b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:21.059255 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62378b55-17f7-4052-aab3-cca27cb018b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:21.059720 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62378b55-17f7-4052-aab3-cca27cb018b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:21.067780 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb9d70-0803-4e32-a898-4cafe8023d29 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:21.073679 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8d4f9-ea07-4f95-b773-e83fabb0888e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:21.074354 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8d4f9-ea07-4f95-b773-e83fabb0888e admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:21.074651 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8d4f9-ea07-4f95-b773-e83fabb0888e admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:21.075432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8d4f9-ea07-4f95-b773-e83fabb0888e admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:21.076351 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8d4f9-ea07-4f95-b773-e83fabb0888e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:21.078035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8d4f9-ea07-4f95-b773-e83fabb0888e admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:21.089697 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 964/1923] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:21:21.094016 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8d4f9-ea07-4f95-b773-e83fabb0888e admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:21.112341 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8d4f9-ea07-4f95-b773-e83fabb0888e admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:21.121024 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a90de8-c966-46c3-b964-5cb4390c5a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:21.122027 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a90de8-c966-46c3-b964-5cb4390c5a26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:21.122461 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a90de8-c966-46c3-b964-5cb4390c5a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:21.122931 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a90de8-c966-46c3-b964-5cb4390c5a26 admin admin] PATH_INFO: `/v3/projects/1a3e7499caae49c2ac9fb10018d6f6be/users/bdf645979892496ebdeb1398b302807a/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:21.137751 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62378b55-17f7-4052-aab3-cca27cb018b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:21.139811 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62378b55-17f7-4052-aab3-cca27cb018b6 service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:21.141960 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a90de8-c966-46c3-b964-5cb4390c5a26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a3e7499caae49c2ac9fb10018d6f6be, user_id=bdf645979892496ebdeb1398b302807a, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:21.145224 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a90de8-c966-46c3-b964-5cb4390c5a26 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:21.151034 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 960/1924] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:21:21.164655 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 965/1925] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:21 2022] PUT /identity/v3/projects/1a3e7499caae49c2ac9fb10018d6f6be/users/bdf645979892496ebdeb1398b302807a/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:21.178764 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7e8a4-d9bc-416f-9129-1a78ca7759ca None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:21.179090 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7e8a4-d9bc-416f-9129-1a78ca7759ca None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:21.179399 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7e8a4-d9bc-416f-9129-1a78ca7759ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:21.183841 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a90de8-c966-46c3-b964-5cb4390c5a26 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:21.214222 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-85d7e8a4-d9bc-416f-9129-1a78ca7759ca None None] MFA Rules not processed for user `bdf645979892496ebdeb1398b302807a`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:21.215471 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-85d7e8a4-d9bc-416f-9129-1a78ca7759ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:21.264120 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a90de8-c966-46c3-b964-5cb4390c5a26 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:21.270238 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2056d51-bf81-43e3-840e-f4df65462e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:21.271759 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2056d51-bf81-43e3-840e-f4df65462e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:21.272270 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2056d51-bf81-43e3-840e-f4df65462e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:21.272650 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2056d51-bf81-43e3-840e-f4df65462e8c admin admin] PATH_INFO: `/v3/users/de733b96d2a545dbbe2ad500d525e148` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:21.274213 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2056d51-bf81-43e3-840e-f4df65462e8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=de733b96d2a545dbbe2ad500d525e148)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:21.277466 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2056d51-bf81-43e3-840e-f4df65462e8c admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:21.306022 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 961/1926] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:21.307193 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7e8a4-d9bc-416f-9129-1a78ca7759ca None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:21.320946 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7e8a4-d9bc-416f-9129-1a78ca7759ca None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:21.328096 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bc0a8-76f5-4039-a6b2-96e1e8efb77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:21.328960 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bc0a8-76f5-4039-a6b2-96e1e8efb77f admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:21.329241 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bc0a8-76f5-4039-a6b2-96e1e8efb77f admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:21.329516 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bc0a8-76f5-4039-a6b2-96e1e8efb77f admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:21.330219 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595bc0a8-76f5-4039-a6b2-96e1e8efb77f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:21.332184 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595bc0a8-76f5-4039-a6b2-96e1e8efb77f admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:21.336455 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:21.340408 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-b2056d51-bf81-43e3-840e-f4df65462e8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de733b96d2a545dbbe2ad500d525e148'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:21.341129 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-b2056d51-bf81-43e3-840e-f4df65462e8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de733b96d2a545dbbe2ad500d525e148'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:21.357399 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-b2056d51-bf81-43e3-840e-f4df65462e8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de733b96d2a545dbbe2ad500d525e148'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:21.362844 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 962/1927] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:21 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:21:21.366445 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-b2056d51-bf81-43e3-840e-f4df65462e8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de733b96d2a545dbbe2ad500d525e148'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:21.367354 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bc0a8-76f5-4039-a6b2-96e1e8efb77f admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:21.367510 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-b2056d51-bf81-43e3-840e-f4df65462e8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de733b96d2a545dbbe2ad500d525e148'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:21.369062 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-595bc0a8-76f5-4039-a6b2-96e1e8efb77f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:21.383460 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 966/1928] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:21 2022] DELETE /identity/v3/users/de733b96d2a545dbbe2ad500d525e148 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:21.388133 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b85c92-79c6-4b73-9c43-3b3645d26481 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:21.388412 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b85c92-79c6-4b73-9c43-3b3645d26481 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:21.388684 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b85c92-79c6-4b73-9c43-3b3645d26481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:21.409463 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-b5b85c92-79c6-4b73-9c43-3b3645d26481 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:21.410798 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-b5b85c92-79c6-4b73-9c43-3b3645d26481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:21.449696 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:21.455037 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bc0a8-76f5-4039-a6b2-96e1e8efb77f admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:21.490827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 967/1929] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:21.498388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b85c92-79c6-4b73-9c43-3b3645d26481 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:21.500335 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-b5b85c92-79c6-4b73-9c43-3b3645d26481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:21.539422 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57203f64-7ef4-4deb-812e-b2234239b7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:21.540196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57203f64-7ef4-4deb-812e-b2234239b7dc admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:21.540551 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57203f64-7ef4-4deb-812e-b2234239b7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:21.541250 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57203f64-7ef4-4deb-812e-b2234239b7dc admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:21.541721 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57203f64-7ef4-4deb-812e-b2234239b7dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:21.544358 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57203f64-7ef4-4deb-812e-b2234239b7dc admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:21.570811 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 963/1930] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:21 2022] POST /identity/v3/users => generated 299 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:21:21.573630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57203f64-7ef4-4deb-812e-b2234239b7dc admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:21.577770 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b85c92-79c6-4b73-9c43-3b3645d26481 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:21.582248 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e595280-9edc-460b-9bef-65229eef92bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:21.583567 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e595280-9edc-460b-9bef-65229eef92bf service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:21.583854 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e595280-9edc-460b-9bef-65229eef92bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:21.585233 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e595280-9edc-460b-9bef-65229eef92bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:21.585346 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57203f64-7ef4-4deb-812e-b2234239b7dc admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:21.589711 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b4713-20d7-4eaf-8f86-7446b7fa46ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:21.590415 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b4713-20d7-4eaf-8f86-7446b7fa46ee admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:21.591418 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b4713-20d7-4eaf-8f86-7446b7fa46ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:21.591418 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b4713-20d7-4eaf-8f86-7446b7fa46ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:21.591911 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b4713-20d7-4eaf-8f86-7446b7fa46ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:21.594170 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b4713-20d7-4eaf-8f86-7446b7fa46ee admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:21.594722 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e595280-9edc-460b-9bef-65229eef92bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:21.596194 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e595280-9edc-460b-9bef-65229eef92bf service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:21.606060 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 964/1931] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:21:21.607362 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 968/1932] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:21:21.610193 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b4713-20d7-4eaf-8f86-7446b7fa46ee admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:21.621916 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b4713-20d7-4eaf-8f86-7446b7fa46ee admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:21.627004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2ccb8-6f28-4dea-be8c-d8e3af50e8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:21.628278 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2ccb8-6f28-4dea-be8c-d8e3af50e8e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:21.628611 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2ccb8-6f28-4dea-be8c-d8e3af50e8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:21.629244 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2ccb8-6f28-4dea-be8c-d8e3af50e8e6 admin admin] PATH_INFO: `/v3/projects/1e8ef90f30c948b181ebadd9efdcf417/users/3b3fd517e2d3423db1ccb50fa83d31ad/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:21.646916 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd2ccb8-6f28-4dea-be8c-d8e3af50e8e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e8ef90f30c948b181ebadd9efdcf417, user_id=3b3fd517e2d3423db1ccb50fa83d31ad, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:21.650197 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd2ccb8-6f28-4dea-be8c-d8e3af50e8e6 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:21.666506 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 965/1933] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:21 2022] PUT /identity/v3/projects/1e8ef90f30c948b181ebadd9efdcf417/users/3b3fd517e2d3423db1ccb50fa83d31ad/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:21:21.670502 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e595280-9edc-460b-9bef-65229eef92bf service neutron] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:21.680628 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e595280-9edc-460b-9bef-65229eef92bf service neutron] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:21.762139 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f921a-42f6-4414-8a38-704f618a0b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:21.763172 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f921a-42f6-4414-8a38-704f618a0b6b admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:21.763634 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f921a-42f6-4414-8a38-704f618a0b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:21.764086 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f921a-42f6-4414-8a38-704f618a0b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:21.764985 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f921a-42f6-4414-8a38-704f618a0b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:21.769825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f921a-42f6-4414-8a38-704f618a0b6b admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:21.782392 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 969/1934] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:21.786233 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2ccb8-6f28-4dea-be8c-d8e3af50e8e6 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:21.797812 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2ccb8-6f28-4dea-be8c-d8e3af50e8e6 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:21.803577 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f6912-1e0b-404b-9930-cd141a94b778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:21.804496 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f6912-1e0b-404b-9930-cd141a94b778 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:21.804848 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f6912-1e0b-404b-9930-cd141a94b778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:21.805210 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f6912-1e0b-404b-9930-cd141a94b778 admin admin] PATH_INFO: `/v3/projects/1e8ef90f30c948b181ebadd9efdcf417/users/3b3fd517e2d3423db1ccb50fa83d31ad/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:21.807353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f6912-1e0b-404b-9930-cd141a94b778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e8ef90f30c948b181ebadd9efdcf417, user_id=3b3fd517e2d3423db1ccb50fa83d31ad, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:21.810096 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f6912-1e0b-404b-9930-cd141a94b778 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:21.821278 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 966/1935] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:21 2022] PUT /identity/v3/projects/1e8ef90f30c948b181ebadd9efdcf417/users/3b3fd517e2d3423db1ccb50fa83d31ad/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:21.831030 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c704c2-28b3-4787-85f0-2eec9cfee90d None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:21.831388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c704c2-28b3-4787-85f0-2eec9cfee90d None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:21.831743 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c704c2-28b3-4787-85f0-2eec9cfee90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:21.859753 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-54c704c2-28b3-4787-85f0-2eec9cfee90d None None] MFA Rules not processed for user `3b3fd517e2d3423db1ccb50fa83d31ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:21.861177 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-54c704c2-28b3-4787-85f0-2eec9cfee90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:21.927033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f6912-1e0b-404b-9930-cd141a94b778 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:21.929392 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-e50f6912-1e0b-404b-9930-cd141a94b778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:21.960981 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 970/1936] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:21.971376 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:21.972752 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c704c2-28b3-4787-85f0-2eec9cfee90d None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:21.974271 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-54c704c2-28b3-4787-85f0-2eec9cfee90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:21.982976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:22.011206 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f6912-1e0b-404b-9930-cd141a94b778 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:22.017348 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ec70e-9f01-4ee6-a367-216bc670591f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:22.018832 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ec70e-9f01-4ee6-a367-216bc670591f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:22.019194 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ec70e-9f01-4ee6-a367-216bc670591f admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:22.019479 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ec70e-9f01-4ee6-a367-216bc670591f admin admin] PATH_INFO: `/v3/projects/6a8a41d196a242ef9f560309991afc1d` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:22.020785 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ec70e-9f01-4ee6-a367-216bc670591f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a8a41d196a242ef9f560309991afc1d)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:22.023463 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ec70e-9f01-4ee6-a367-216bc670591f admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:22.077399 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c704c2-28b3-4787-85f0-2eec9cfee90d None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:22.113066 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-511ec70e-9f01-4ee6-a367-216bc670591f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a8a41d196a242ef9f560309991afc1d', 'request_id': 'req-511ec70e-9f01-4ee6-a367-216bc670591f'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:22.147788 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-511ec70e-9f01-4ee6-a367-216bc670591f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a8a41d196a242ef9f560309991afc1d', 'request_id': 'req-511ec70e-9f01-4ee6-a367-216bc670591f'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:22.163971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-511ec70e-9f01-4ee6-a367-216bc670591f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a8a41d196a242ef9f560309991afc1d', 'request_id': 'req-511ec70e-9f01-4ee6-a367-216bc670591f'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:22.168905 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de54aa-7286-4ef0-9e57-f59756678a94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:22.170238 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de54aa-7286-4ef0-9e57-f59756678a94 service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:22.170954 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de54aa-7286-4ef0-9e57-f59756678a94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:22.171625 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de54aa-7286-4ef0-9e57-f59756678a94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:22.187657 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-511ec70e-9f01-4ee6-a367-216bc670591f admin admin] The token cache is being invalidate because project 6a8a41d196a242ef9f560309991afc1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:22.188186 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-511ec70e-9f01-4ee6-a367-216bc670591f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:22.192002 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-511ec70e-9f01-4ee6-a367-216bc670591f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:22.199336 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 967/1937] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:21 2022] DELETE /identity/v3/projects/6a8a41d196a242ef9f560309991afc1d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:21:22.200993 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c9cc4-521f-4454-8240-135b18ab2992 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:22.201281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c9cc4-521f-4454-8240-135b18ab2992 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:22.201555 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c9cc4-521f-4454-8240-135b18ab2992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:22.228573 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-113c9cc4-521f-4454-8240-135b18ab2992 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:22.229936 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-113c9cc4-521f-4454-8240-135b18ab2992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:22.264272 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de54aa-7286-4ef0-9e57-f59756678a94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:22.267479 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de54aa-7286-4ef0-9e57-f59756678a94 service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:22.281229 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 971/1938] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:21:22.320407 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 968/1939] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:22.328683 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cade7d-93fd-4b0a-b3df-6be9c56b5686 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:22.328975 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cade7d-93fd-4b0a-b3df-6be9c56b5686 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:22.329255 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cade7d-93fd-4b0a-b3df-6be9c56b5686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:22.338589 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c9cc4-521f-4454-8240-135b18ab2992 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:22.343808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-113c9cc4-521f-4454-8240-135b18ab2992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:22.358433 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c9cc4-521f-4454-8240-135b18ab2992 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:22.362734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-33cade7d-93fd-4b0a-b3df-6be9c56b5686 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:22.363408 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0933a68-1e89-49d8-aaeb-9ef8eab4c4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:22.364037 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-33cade7d-93fd-4b0a-b3df-6be9c56b5686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:22.364437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0933a68-1e89-49d8-aaeb-9ef8eab4c4c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:22.365202 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0933a68-1e89-49d8-aaeb-9ef8eab4c4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:22.365774 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0933a68-1e89-49d8-aaeb-9ef8eab4c4c1 admin admin] PATH_INFO: `/v3/users/bdf645979892496ebdeb1398b302807a` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:22.368023 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0933a68-1e89-49d8-aaeb-9ef8eab4c4c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdf645979892496ebdeb1398b302807a)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:22.370379 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0933a68-1e89-49d8-aaeb-9ef8eab4c4c1 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:22.377172 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 972/1940] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:22.378115 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cade7d-93fd-4b0a-b3df-6be9c56b5686 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:22.393534 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cade7d-93fd-4b0a-b3df-6be9c56b5686 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:22.400604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b891cd-5976-4cf5-a7f5-b2f840ccf538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:22.401282 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b891cd-5976-4cf5-a7f5-b2f840ccf538 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:22.401558 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b891cd-5976-4cf5-a7f5-b2f840ccf538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:22.401942 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b891cd-5976-4cf5-a7f5-b2f840ccf538 admin admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:22.402734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b891cd-5976-4cf5-a7f5-b2f840ccf538 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:21:22.403045 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b891cd-5976-4cf5-a7f5-b2f840ccf538 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:22.404943 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b891cd-5976-4cf5-a7f5-b2f840ccf538 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:22.421413 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 973/1941] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:21:22.426208 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b891cd-5976-4cf5-a7f5-b2f840ccf538 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:22.437048 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b891cd-5976-4cf5-a7f5-b2f840ccf538 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:22.439517 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b0933a68-1e89-49d8-aaeb-9ef8eab4c4c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdf645979892496ebdeb1398b302807a'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:22.440278 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b0933a68-1e89-49d8-aaeb-9ef8eab4c4c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdf645979892496ebdeb1398b302807a'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:22.441656 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947c345-63ea-4a61-9f85-c2187a85bd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:22.442372 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947c345-63ea-4a61-9f85-c2187a85bd54 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:22.442796 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947c345-63ea-4a61-9f85-c2187a85bd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:22.443075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947c345-63ea-4a61-9f85-c2187a85bd54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:22.444294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947c345-63ea-4a61-9f85-c2187a85bd54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:22.446218 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947c345-63ea-4a61-9f85-c2187a85bd54 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:22.455061 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:22.463018 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b0933a68-1e89-49d8-aaeb-9ef8eab4c4c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdf645979892496ebdeb1398b302807a'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:22.464985 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b0933a68-1e89-49d8-aaeb-9ef8eab4c4c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdf645979892496ebdeb1398b302807a'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:22.476727 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b0933a68-1e89-49d8-aaeb-9ef8eab4c4c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdf645979892496ebdeb1398b302807a'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:22.480198 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 974/1942] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:22 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:21:22.485263 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947c345-63ea-4a61-9f85-c2187a85bd54 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:22.488161 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-3947c345-63ea-4a61-9f85-c2187a85bd54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:22.492413 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 969/1943] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:22 2022] DELETE /identity/v3/users/bdf645979892496ebdeb1398b302807a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:22.496662 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218a2e7-eafc-43e6-861d-09ef4720b2d4 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:22.497092 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218a2e7-eafc-43e6-861d-09ef4720b2d4 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:22.497400 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218a2e7-eafc-43e6-861d-09ef4720b2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:22.515577 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-8218a2e7-eafc-43e6-861d-09ef4720b2d4 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:22.516795 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-8218a2e7-eafc-43e6-861d-09ef4720b2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:22.528848 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:22.583047 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947c345-63ea-4a61-9f85-c2187a85bd54 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:22.596250 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 970/1944] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:21:22.607561 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218a2e7-eafc-43e6-861d-09ef4720b2d4 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:22.609473 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-8218a2e7-eafc-43e6-861d-09ef4720b2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:22.645654 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2457abd-7bfa-482b-90f9-2418464b4b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:22.646341 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2457abd-7bfa-482b-90f9-2418464b4b5a admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:22.647270 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2457abd-7bfa-482b-90f9-2418464b4b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:22.647526 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2457abd-7bfa-482b-90f9-2418464b4b5a admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:22.648208 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2457abd-7bfa-482b-90f9-2418464b4b5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:22.650374 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2457abd-7bfa-482b-90f9-2418464b4b5a admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:22.673768 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 975/1945] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:22 2022] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:21:22.678016 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2457abd-7bfa-482b-90f9-2418464b4b5a admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:22.689727 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2457abd-7bfa-482b-90f9-2418464b4b5a admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:22.690070 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218a2e7-eafc-43e6-861d-09ef4720b2d4 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:22.695590 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca896e3-efd4-41fc-8263-958c567c1d0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:22.696070 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ab708-4141-4e01-a132-668ff835cb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:22.696318 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca896e3-efd4-41fc-8263-958c567c1d0a service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:22.696663 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca896e3-efd4-41fc-8263-958c567c1d0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:22.696836 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ab708-4141-4e01-a132-668ff835cb8a admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:22.696979 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca896e3-efd4-41fc-8263-958c567c1d0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:22.697125 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ab708-4141-4e01-a132-668ff835cb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:22.697382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ab708-4141-4e01-a132-668ff835cb8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:22.698166 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ab708-4141-4e01-a132-668ff835cb8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:22.700200 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ab708-4141-4e01-a132-668ff835cb8a admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:22.710146 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca896e3-efd4-41fc-8263-958c567c1d0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:22.711736 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca896e3-efd4-41fc-8263-958c567c1d0a service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:22.715889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 976/1946] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:21:22.716361 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ab708-4141-4e01-a132-668ff835cb8a admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:22.725563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 971/1947] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:21:22.727192 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ab708-4141-4e01-a132-668ff835cb8a admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:22.734545 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88946f6c-e445-4c79-8370-71077578f71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:22.735524 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88946f6c-e445-4c79-8370-71077578f71d admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:22.735956 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88946f6c-e445-4c79-8370-71077578f71d admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:22.736131 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88946f6c-e445-4c79-8370-71077578f71d admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:22.736857 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88946f6c-e445-4c79-8370-71077578f71d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:22.738592 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88946f6c-e445-4c79-8370-71077578f71d admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:22.752809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 977/1948] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:21:22.757424 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca896e3-efd4-41fc-8263-958c567c1d0a service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:22.778867 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca896e3-efd4-41fc-8263-958c567c1d0a service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:22.785360 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc5741-dc7d-45de-a507-da12b5b98025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:22.786406 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc5741-dc7d-45de-a507-da12b5b98025 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:22.786731 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc5741-dc7d-45de-a507-da12b5b98025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:22.787011 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc5741-dc7d-45de-a507-da12b5b98025 admin admin] PATH_INFO: `/v3/projects/89b29afe187841c89856d498c492b9c6/users/727e0747ece24b21894669f9333117b2/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:22.812090 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc5741-dc7d-45de-a507-da12b5b98025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89b29afe187841c89856d498c492b9c6, user_id=727e0747ece24b21894669f9333117b2, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:22.815011 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc5741-dc7d-45de-a507-da12b5b98025 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:22.832709 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 972/1949] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:22 2022] PUT /identity/v3/projects/89b29afe187841c89856d498c492b9c6/users/727e0747ece24b21894669f9333117b2/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:22.844769 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739af2ce-7756-415a-a7b1-4f336ff718e5 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:22.845053 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739af2ce-7756-415a-a7b1-4f336ff718e5 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:22.845333 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739af2ce-7756-415a-a7b1-4f336ff718e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:22.876481 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-739af2ce-7756-415a-a7b1-4f336ff718e5 None None] MFA Rules not processed for user `727e0747ece24b21894669f9333117b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:22.877693 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-739af2ce-7756-415a-a7b1-4f336ff718e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:22.955313 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 978/1950] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:22.956026 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc5741-dc7d-45de-a507-da12b5b98025 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:23.026397 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:23.033052 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc5741-dc7d-45de-a507-da12b5b98025 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:23.039097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c6b46-7386-45f5-89f2-4dfd996988cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:23.039914 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c6b46-7386-45f5-89f2-4dfd996988cf admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:23.040387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c6b46-7386-45f5-89f2-4dfd996988cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:23.043180 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c6b46-7386-45f5-89f2-4dfd996988cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:23.044230 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c6b46-7386-45f5-89f2-4dfd996988cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:23.046894 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c6b46-7386-45f5-89f2-4dfd996988cf admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:23.065165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739af2ce-7756-415a-a7b1-4f336ff718e5 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:23.067233 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-739af2ce-7756-415a-a7b1-4f336ff718e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:23.083912 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739af2ce-7756-415a-a7b1-4f336ff718e5 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:23.087340 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 973/1951] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:22 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:23.090013 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c6b46-7386-45f5-89f2-4dfd996988cf admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:23.122270 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:23.157052 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd9e15-4a6f-4f95-9311-386b14ae4315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:23.158222 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd9e15-4a6f-4f95-9311-386b14ae4315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:23.158624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd9e15-4a6f-4f95-9311-386b14ae4315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:23.159024 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd9e15-4a6f-4f95-9311-386b14ae4315 admin admin] PATH_INFO: `/v3/projects/1a3e7499caae49c2ac9fb10018d6f6be` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:23.160524 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd9e15-4a6f-4f95-9311-386b14ae4315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a3e7499caae49c2ac9fb10018d6f6be)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:23.164463 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd9e15-4a6f-4f95-9311-386b14ae4315 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:23.174466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c6b46-7386-45f5-89f2-4dfd996988cf admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:23.180221 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901b8d9-66c0-4301-a500-ae6b835ce2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:23.180930 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901b8d9-66c0-4301-a500-ae6b835ce2b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:23.181221 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901b8d9-66c0-4301-a500-ae6b835ce2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:23.181501 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901b8d9-66c0-4301-a500-ae6b835ce2b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:23.182207 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901b8d9-66c0-4301-a500-ae6b835ce2b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:23.184232 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901b8d9-66c0-4301-a500-ae6b835ce2b4 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:23.208409 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 974/1952] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:23 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:23.214337 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901b8d9-66c0-4301-a500-ae6b835ce2b4 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:23.222839 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-96bd9e15-4a6f-4f95-9311-386b14ae4315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a3e7499caae49c2ac9fb10018d6f6be', 'request_id': 'req-96bd9e15-4a6f-4f95-9311-386b14ae4315'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:23.229446 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901b8d9-66c0-4301-a500-ae6b835ce2b4 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:23.230451 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-96bd9e15-4a6f-4f95-9311-386b14ae4315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a3e7499caae49c2ac9fb10018d6f6be', 'request_id': 'req-96bd9e15-4a6f-4f95-9311-386b14ae4315'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:23.237192 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-96bd9e15-4a6f-4f95-9311-386b14ae4315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a3e7499caae49c2ac9fb10018d6f6be', 'request_id': 'req-96bd9e15-4a6f-4f95-9311-386b14ae4315'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:23.253461 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-96bd9e15-4a6f-4f95-9311-386b14ae4315 admin admin] The token cache is being invalidate because project 1a3e7499caae49c2ac9fb10018d6f6be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:23.253926 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-96bd9e15-4a6f-4f95-9311-386b14ae4315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:23.254438 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-96bd9e15-4a6f-4f95-9311-386b14ae4315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:23.259151 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 979/1953] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:23 2022] DELETE /identity/v3/projects/1a3e7499caae49c2ac9fb10018d6f6be => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:21:23.260350 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd9e15-4a6f-4f95-9311-386b14ae4315 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:23.262210 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-96bd9e15-4a6f-4f95-9311-386b14ae4315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:23.316893 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131f7b7-f291-40e2-ac04-96e56901918b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:23.317862 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131f7b7-f291-40e2-ac04-96e56901918b admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:23.318297 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131f7b7-f291-40e2-ac04-96e56901918b admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:23.318773 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131f7b7-f291-40e2-ac04-96e56901918b admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:23.319662 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131f7b7-f291-40e2-ac04-96e56901918b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:23.321271 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131f7b7-f291-40e2-ac04-96e56901918b admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:23.335561 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 975/1954] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:23.342339 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131f7b7-f291-40e2-ac04-96e56901918b admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:23.345258 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-0131f7b7-f291-40e2-ac04-96e56901918b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:23.364089 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd9e15-4a6f-4f95-9311-386b14ae4315 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:23.373780 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3110bb28-5b0f-41f3-8f87-b0bc8bccc8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:23.374857 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110bb28-5b0f-41f3-8f87-b0bc8bccc8bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:23.375338 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110bb28-5b0f-41f3-8f87-b0bc8bccc8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:23.375765 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110bb28-5b0f-41f3-8f87-b0bc8bccc8bd admin admin] PATH_INFO: `/v3/users/3b3fd517e2d3423db1ccb50fa83d31ad` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:23.377947 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3110bb28-5b0f-41f3-8f87-b0bc8bccc8bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b3fd517e2d3423db1ccb50fa83d31ad)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:23.379075 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131f7b7-f291-40e2-ac04-96e56901918b admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:23.380050 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3110bb28-5b0f-41f3-8f87-b0bc8bccc8bd admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:23.392512 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52e961-409f-46dd-a1e7-204259e0bfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:23.395376 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52e961-409f-46dd-a1e7-204259e0bfe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:23.395659 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52e961-409f-46dd-a1e7-204259e0bfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:23.395997 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52e961-409f-46dd-a1e7-204259e0bfe5 admin admin] PATH_INFO: `/v3/projects/31b3ebf39164444b8430adb28720d283/users/ee543ccd0a604abfb6da653b5337f986/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:23.437941 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52e961-409f-46dd-a1e7-204259e0bfe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31b3ebf39164444b8430adb28720d283, user_id=ee543ccd0a604abfb6da653b5337f986, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:23.444829 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52e961-409f-46dd-a1e7-204259e0bfe5 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:23.467482 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-3110bb28-5b0f-41f3-8f87-b0bc8bccc8bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b3fd517e2d3423db1ccb50fa83d31ad'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:23.469742 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-3110bb28-5b0f-41f3-8f87-b0bc8bccc8bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b3fd517e2d3423db1ccb50fa83d31ad'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:23.482441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 976/1955] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:23 2022] PUT /identity/v3/projects/31b3ebf39164444b8430adb28720d283/users/ee543ccd0a604abfb6da653b5337f986/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:23.483838 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52e961-409f-46dd-a1e7-204259e0bfe5 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:23.486311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-1e52e961-409f-46dd-a1e7-204259e0bfe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:23.489643 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-3110bb28-5b0f-41f3-8f87-b0bc8bccc8bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b3fd517e2d3423db1ccb50fa83d31ad'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:23.492732 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:23.505663 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-3110bb28-5b0f-41f3-8f87-b0bc8bccc8bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b3fd517e2d3423db1ccb50fa83d31ad'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:23.507266 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-3110bb28-5b0f-41f3-8f87-b0bc8bccc8bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b3fd517e2d3423db1ccb50fa83d31ad'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:23.523029 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 980/1956] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:23 2022] DELETE /identity/v3/users/3b3fd517e2d3423db1ccb50fa83d31ad => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:21:23.605641 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:23.638502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52e961-409f-46dd-a1e7-204259e0bfe5 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:23.765794 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72da6e-12cd-4b6f-8849-d05bfe9aeb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:23.766733 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72da6e-12cd-4b6f-8849-d05bfe9aeb57 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:23.767217 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72da6e-12cd-4b6f-8849-d05bfe9aeb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:23.767929 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72da6e-12cd-4b6f-8849-d05bfe9aeb57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:23.769038 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72da6e-12cd-4b6f-8849-d05bfe9aeb57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:23.773049 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72da6e-12cd-4b6f-8849-d05bfe9aeb57 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:23.792168 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 977/1957] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:23.796188 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3110bb28-5b0f-41f3-8f87-b0bc8bccc8bd admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:23.814883 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3110bb28-5b0f-41f3-8f87-b0bc8bccc8bd admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:23.827142 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f5ffc-8091-4041-a1e6-880db770b15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:23.828293 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f5ffc-8091-4041-a1e6-880db770b15f admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:23.828636 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f5ffc-8091-4041-a1e6-880db770b15f admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:23.828847 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f5ffc-8091-4041-a1e6-880db770b15f admin admin] PATH_INFO: `/v3/projects/31b3ebf39164444b8430adb28720d283/users/ee543ccd0a604abfb6da653b5337f986/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:23.831824 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f5ffc-8091-4041-a1e6-880db770b15f admin admin] RBAC: Authorizing `identity:create_grant(project_id=31b3ebf39164444b8430adb28720d283, user_id=ee543ccd0a604abfb6da653b5337f986, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:23.841415 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f5ffc-8091-4041-a1e6-880db770b15f admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:23.861316 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 981/1958] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:23 2022] PUT /identity/v3/projects/31b3ebf39164444b8430adb28720d283/users/ee543ccd0a604abfb6da653b5337f986/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:23.873294 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b2ccc-68d0-4699-a580-817d29f73c07 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:23.874672 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b2ccc-68d0-4699-a580-817d29f73c07 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:23.874968 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b2ccc-68d0-4699-a580-817d29f73c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:23.935088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-8d5b2ccc-68d0-4699-a580-817d29f73c07 None None] MFA Rules not processed for user `ee543ccd0a604abfb6da653b5337f986`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:23.946338 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-8d5b2ccc-68d0-4699-a580-817d29f73c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:24.147932 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 978/1959] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:23 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:24.203812 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f5ffc-8091-4041-a1e6-880db770b15f admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:24.205977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-346f5ffc-8091-4041-a1e6-880db770b15f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:24.212356 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b2ccc-68d0-4699-a580-817d29f73c07 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:24.213841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-8d5b2ccc-68d0-4699-a580-817d29f73c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:24.309138 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f5ffc-8091-4041-a1e6-880db770b15f admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:24.313686 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f6cb6-1557-4f6f-ab51-512993590e8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:24.314536 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b2ccc-68d0-4699-a580-817d29f73c07 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:24.314998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f6cb6-1557-4f6f-ab51-512993590e8c service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:24.315502 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f6cb6-1557-4f6f-ab51-512993590e8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:24.316044 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f6cb6-1557-4f6f-ab51-512993590e8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:24.318292 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-927f6cb6-1557-4f6f-ab51-512993590e8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:24.321729 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa8257-91f6-460d-bfac-42bb3d238617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:24.322772 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa8257-91f6-460d-bfac-42bb3d238617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:24.323284 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa8257-91f6-460d-bfac-42bb3d238617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:24.323766 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa8257-91f6-460d-bfac-42bb3d238617 admin admin] PATH_INFO: `/v3/projects/1e8ef90f30c948b181ebadd9efdcf417` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:24.325511 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fa8257-91f6-460d-bfac-42bb3d238617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e8ef90f30c948b181ebadd9efdcf417)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:24.327428 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fa8257-91f6-460d-bfac-42bb3d238617 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:24.340949 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:24.387938 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f6cb6-1557-4f6f-ab51-512993590e8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:24.389398 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f6cb6-1557-4f6f-ab51-512993590e8c service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:24.392846 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-52fa8257-91f6-460d-bfac-42bb3d238617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e8ef90f30c948b181ebadd9efdcf417', 'request_id': 'req-52fa8257-91f6-460d-bfac-42bb3d238617'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:24.400984 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 982/1960] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:24.405952 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-52fa8257-91f6-460d-bfac-42bb3d238617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e8ef90f30c948b181ebadd9efdcf417', 'request_id': 'req-52fa8257-91f6-460d-bfac-42bb3d238617'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:24.416141 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-52fa8257-91f6-460d-bfac-42bb3d238617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e8ef90f30c948b181ebadd9efdcf417', 'request_id': 'req-52fa8257-91f6-460d-bfac-42bb3d238617'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:24.427751 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-52fa8257-91f6-460d-bfac-42bb3d238617 admin admin] The token cache is being invalidate because project 1e8ef90f30c948b181ebadd9efdcf417 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:24.428571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-52fa8257-91f6-460d-bfac-42bb3d238617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:24.430317 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-52fa8257-91f6-460d-bfac-42bb3d238617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:24.432189 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 979/1961] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:24 2022] DELETE /identity/v3/projects/1e8ef90f30c948b181ebadd9efdcf417 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:24.437644 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c5587-a12a-44bb-b2e6-db58850b5e65 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:24.437940 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c5587-a12a-44bb-b2e6-db58850b5e65 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:24.438220 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c5587-a12a-44bb-b2e6-db58850b5e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:24.461216 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-fc0c5587-a12a-44bb-b2e6-db58850b5e65 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:24.462550 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-fc0c5587-a12a-44bb-b2e6-db58850b5e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:24.557394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 983/1962] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:24.565482 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa4b5d-5968-4478-8c96-5725aba117ca None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:24.566108 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa4b5d-5968-4478-8c96-5725aba117ca None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:24.566556 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa4b5d-5968-4478-8c96-5725aba117ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:24.590863 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-6bfa4b5d-5968-4478-8c96-5725aba117ca None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:24.592376 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-6bfa4b5d-5968-4478-8c96-5725aba117ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:24.602891 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 980/1963] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:24.610121 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c5587-a12a-44bb-b2e6-db58850b5e65 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:24.621382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c5587-a12a-44bb-b2e6-db58850b5e65 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:24.626232 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186ea64-df08-4e64-80af-3ab53c1b7643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:24.626936 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186ea64-df08-4e64-80af-3ab53c1b7643 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:24.627277 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186ea64-df08-4e64-80af-3ab53c1b7643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:24.627513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186ea64-df08-4e64-80af-3ab53c1b7643 admin admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:24.628291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186ea64-df08-4e64-80af-3ab53c1b7643 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:21:24.628597 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186ea64-df08-4e64-80af-3ab53c1b7643 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:24.630393 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186ea64-df08-4e64-80af-3ab53c1b7643 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:24.643462 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 984/1964] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:21:24.647917 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa4b5d-5968-4478-8c96-5725aba117ca None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:24.662199 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa4b5d-5968-4478-8c96-5725aba117ca None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:24.669271 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f37f29-54d8-493a-b798-ef0d86bbab4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:24.669950 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f37f29-54d8-493a-b798-ef0d86bbab4f admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:24.670551 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f37f29-54d8-493a-b798-ef0d86bbab4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:24.671453 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f37f29-54d8-493a-b798-ef0d86bbab4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:24.672709 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f37f29-54d8-493a-b798-ef0d86bbab4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:24.675298 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f37f29-54d8-493a-b798-ef0d86bbab4f admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:24.741408 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 981/1965] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:24 2022] POST /identity/v3/projects => generated 389 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:21:24.745913 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186ea64-df08-4e64-80af-3ab53c1b7643 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:24.763056 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186ea64-df08-4e64-80af-3ab53c1b7643 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:24.779728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:24.842431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcbc93-9fcf-4efc-a49d-93bf313784c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:24.843151 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcbc93-9fcf-4efc-a49d-93bf313784c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:24.843439 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcbc93-9fcf-4efc-a49d-93bf313784c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:24.843718 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcbc93-9fcf-4efc-a49d-93bf313784c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:24.844425 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abcbc93-9fcf-4efc-a49d-93bf313784c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:24.846435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abcbc93-9fcf-4efc-a49d-93bf313784c2 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:24.869883 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 985/1966] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:24 2022] POST /identity/v3/users => generated 295 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:21:24.873952 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f37f29-54d8-493a-b798-ef0d86bbab4f admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:24.885539 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f37f29-54d8-493a-b798-ef0d86bbab4f admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:24.890979 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f9e96-c6e9-4f37-8529-3e28a60f44ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:24.891667 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f9e96-c6e9-4f37-8529-3e28a60f44ff admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:24.891954 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f9e96-c6e9-4f37-8529-3e28a60f44ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:24.892233 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f9e96-c6e9-4f37-8529-3e28a60f44ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:24.892970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f9e96-c6e9-4f37-8529-3e28a60f44ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:24.894827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f9e96-c6e9-4f37-8529-3e28a60f44ff admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:24.907613 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 982/1967] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:24.911462 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcbc93-9fcf-4efc-a49d-93bf313784c2 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:24.922677 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcbc93-9fcf-4efc-a49d-93bf313784c2 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:24.928641 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88b564-13cd-420f-888a-98daa86f32b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:24.929504 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88b564-13cd-420f-888a-98daa86f32b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:24.929872 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88b564-13cd-420f-888a-98daa86f32b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:24.930221 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88b564-13cd-420f-888a-98daa86f32b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:24.931091 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88b564-13cd-420f-888a-98daa86f32b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:24.932808 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88b564-13cd-420f-888a-98daa86f32b3 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:24.944629 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 986/1968] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:21:24.950074 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f9e96-c6e9-4f37-8529-3e28a60f44ff admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:24.961578 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f9e96-c6e9-4f37-8529-3e28a60f44ff admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:24.967545 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd65d0-8dc0-4439-a5ae-81cf1dac4a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:24.968438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd65d0-8dc0-4439-a5ae-81cf1dac4a6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:24.968724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd65d0-8dc0-4439-a5ae-81cf1dac4a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:24.969002 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd65d0-8dc0-4439-a5ae-81cf1dac4a6c admin admin] PATH_INFO: `/v3/projects/9de9b40679e843fa9d8b57a9133f1a8d/users/aeb13930ab3142b891712d0eb2809d69/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:24.985051 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd65d0-8dc0-4439-a5ae-81cf1dac4a6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9de9b40679e843fa9d8b57a9133f1a8d, user_id=aeb13930ab3142b891712d0eb2809d69, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:24.987797 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd65d0-8dc0-4439-a5ae-81cf1dac4a6c admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:25.002543 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 983/1969] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:24 2022] PUT /identity/v3/projects/9de9b40679e843fa9d8b57a9133f1a8d/users/aeb13930ab3142b891712d0eb2809d69/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:25.016097 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490fbfc-2eb3-46b1-ad06-551d1f4397a0 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:25.016463 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490fbfc-2eb3-46b1-ad06-551d1f4397a0 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:25.016671 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490fbfc-2eb3-46b1-ad06-551d1f4397a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:25.046012 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-9490fbfc-2eb3-46b1-ad06-551d1f4397a0 None None] MFA Rules not processed for user `aeb13930ab3142b891712d0eb2809d69`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:25.047340 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-9490fbfc-2eb3-46b1-ad06-551d1f4397a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:25.113728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 987/1970] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:25.118191 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd65d0-8dc0-4439-a5ae-81cf1dac4a6c admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:25.185231 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd65d0-8dc0-4439-a5ae-81cf1dac4a6c admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:25.190033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a677b054-0cb9-454e-b23f-17de94e51eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:25.190739 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677b054-0cb9-454e-b23f-17de94e51eae admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:25.191027 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677b054-0cb9-454e-b23f-17de94e51eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:25.191306 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677b054-0cb9-454e-b23f-17de94e51eae admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:25.192011 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a677b054-0cb9-454e-b23f-17de94e51eae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:25.193952 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a677b054-0cb9-454e-b23f-17de94e51eae admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:25.225871 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 984/1971] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:25 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:25.229990 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490fbfc-2eb3-46b1-ad06-551d1f4397a0 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:25.240726 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490fbfc-2eb3-46b1-ad06-551d1f4397a0 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:25.307378 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7e874-a36e-4623-8c81-de4610f162bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:25.308776 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7e874-a36e-4623-8c81-de4610f162bd admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:25.309056 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7e874-a36e-4623-8c81-de4610f162bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:25.309319 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7e874-a36e-4623-8c81-de4610f162bd admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:25.310006 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7e874-a36e-4623-8c81-de4610f162bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:25.311959 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7e874-a36e-4623-8c81-de4610f162bd admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:25.337254 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 988/1972] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:25 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:25.338423 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a677b054-0cb9-454e-b23f-17de94e51eae admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:25.349311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a677b054-0cb9-454e-b23f-17de94e51eae admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:25.354603 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d0faf-99ec-4952-9361-bbbe04712680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:25.358541 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d0faf-99ec-4952-9361-bbbe04712680 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:25.358860 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d0faf-99ec-4952-9361-bbbe04712680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:25.359137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d0faf-99ec-4952-9361-bbbe04712680 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:25.359875 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d0faf-99ec-4952-9361-bbbe04712680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:25.361477 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d0faf-99ec-4952-9361-bbbe04712680 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:25.374831 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 985/1973] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:25.377812 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7e874-a36e-4623-8c81-de4610f162bd admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:25.391910 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7e874-a36e-4623-8c81-de4610f162bd admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:25.397744 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d10fc-07f2-40d2-ac39-31a028723e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:25.398856 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d10fc-07f2-40d2-ac39-31a028723e61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:25.399139 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d10fc-07f2-40d2-ac39-31a028723e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:25.400837 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d10fc-07f2-40d2-ac39-31a028723e61 admin admin] PATH_INFO: `/v3/projects/37f45fa58eca4dc7b5b4b596ef19721b/users/30a652c646f643b6ac1bf29b73338128/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:25.406019 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:25.423193 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d10fc-07f2-40d2-ac39-31a028723e61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37f45fa58eca4dc7b5b4b596ef19721b, user_id=30a652c646f643b6ac1bf29b73338128, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:25.427338 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d10fc-07f2-40d2-ac39-31a028723e61 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:25.447172 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 989/1974] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:25 2022] PUT /identity/v3/projects/37f45fa58eca4dc7b5b4b596ef19721b/users/30a652c646f643b6ac1bf29b73338128/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:25.451453 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d0faf-99ec-4952-9361-bbbe04712680 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:25.464942 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d0faf-99ec-4952-9361-bbbe04712680 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:25.473342 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:25.530340 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52660c69-f0a6-469d-8927-efb8818bc9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:25.531043 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52660c69-f0a6-469d-8927-efb8818bc9da admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:25.531262 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52660c69-f0a6-469d-8927-efb8818bc9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:25.531596 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52660c69-f0a6-469d-8927-efb8818bc9da admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:25.532310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52660c69-f0a6-469d-8927-efb8818bc9da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:25.533918 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52660c69-f0a6-469d-8927-efb8818bc9da admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:25.545071 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 986/1975] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:21:25.549042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d10fc-07f2-40d2-ac39-31a028723e61 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:25.562327 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d10fc-07f2-40d2-ac39-31a028723e61 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:25.566955 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b471f6-3dde-497b-b853-5ffe70379009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:25.567845 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b471f6-3dde-497b-b853-5ffe70379009 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:25.568126 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b471f6-3dde-497b-b853-5ffe70379009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:25.568417 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b471f6-3dde-497b-b853-5ffe70379009 admin admin] PATH_INFO: `/v3/projects/37f45fa58eca4dc7b5b4b596ef19721b/users/30a652c646f643b6ac1bf29b73338128/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:25.570488 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b471f6-3dde-497b-b853-5ffe70379009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37f45fa58eca4dc7b5b4b596ef19721b, user_id=30a652c646f643b6ac1bf29b73338128, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:25.573258 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b471f6-3dde-497b-b853-5ffe70379009 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:25.583887 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 990/1976] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:25 2022] PUT /identity/v3/projects/37f45fa58eca4dc7b5b4b596ef19721b/users/30a652c646f643b6ac1bf29b73338128/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:25.594109 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475edcf-850c-4bfb-bc2f-5f2f309efcdd None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:25.594404 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475edcf-850c-4bfb-bc2f-5f2f309efcdd None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:25.594784 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475edcf-850c-4bfb-bc2f-5f2f309efcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:25.626514 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-7475edcf-850c-4bfb-bc2f-5f2f309efcdd None None] MFA Rules not processed for user `30a652c646f643b6ac1bf29b73338128`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:25.627825 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-7475edcf-850c-4bfb-bc2f-5f2f309efcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:25.721774 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 987/1977] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:25.734883 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b471f6-3dde-497b-b853-5ffe70379009 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:25.736794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-96b471f6-3dde-497b-b853-5ffe70379009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:25.814249 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b471f6-3dde-497b-b853-5ffe70379009 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:25.824612 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716d19c-277b-43dc-8550-cb0a9f8a94c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:25.825283 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716d19c-277b-43dc-8550-cb0a9f8a94c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:25.825609 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716d19c-277b-43dc-8550-cb0a9f8a94c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:25.825885 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716d19c-277b-43dc-8550-cb0a9f8a94c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:25.836416 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716d19c-277b-43dc-8550-cb0a9f8a94c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:25.837853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716d19c-277b-43dc-8550-cb0a9f8a94c8 service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:25.849227 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 991/1978] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:21:26.261022 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475edcf-850c-4bfb-bc2f-5f2f309efcdd None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:26.345609 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475edcf-850c-4bfb-bc2f-5f2f309efcdd None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:26.351793 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5a5f1-d035-4e16-b19a-8cbdc97ca644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:26.352675 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5a5f1-d035-4e16-b19a-8cbdc97ca644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:26.352963 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5a5f1-d035-4e16-b19a-8cbdc97ca644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:26.353245 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5a5f1-d035-4e16-b19a-8cbdc97ca644 admin admin] PATH_INFO: `/v3/users/aeb13930ab3142b891712d0eb2809d69` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:26.354453 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be5a5f1-d035-4e16-b19a-8cbdc97ca644 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeb13930ab3142b891712d0eb2809d69)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:26.356525 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be5a5f1-d035-4e16-b19a-8cbdc97ca644 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:26.398165 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:26.408817 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-6be5a5f1-d035-4e16-b19a-8cbdc97ca644 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeb13930ab3142b891712d0eb2809d69'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:26.409576 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-6be5a5f1-d035-4e16-b19a-8cbdc97ca644 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeb13930ab3142b891712d0eb2809d69'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:26.423383 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-6be5a5f1-d035-4e16-b19a-8cbdc97ca644 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeb13930ab3142b891712d0eb2809d69'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:26.424100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-6be5a5f1-d035-4e16-b19a-8cbdc97ca644 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeb13930ab3142b891712d0eb2809d69'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:26.432025 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-6be5a5f1-d035-4e16-b19a-8cbdc97ca644 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeb13930ab3142b891712d0eb2809d69'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:26.449080 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 988/1979] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:26 2022] DELETE /identity/v3/users/aeb13930ab3142b891712d0eb2809d69 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:26.454346 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a34e72-1ea5-40d8-b9ff-6232b3418225 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:26.454959 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a34e72-1ea5-40d8-b9ff-6232b3418225 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:26.454959 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a34e72-1ea5-40d8-b9ff-6232b3418225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:26.484506 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-f0a34e72-1ea5-40d8-b9ff-6232b3418225 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:26.485804 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-f0a34e72-1ea5-40d8-b9ff-6232b3418225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:26.560800 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 992/1980] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:26.571664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5a5f1-d035-4e16-b19a-8cbdc97ca644 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:26.573215 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-6be5a5f1-d035-4e16-b19a-8cbdc97ca644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:26.655618 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5a5f1-d035-4e16-b19a-8cbdc97ca644 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:26.660226 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4aef6a-7f25-446a-995e-52a5d33df471 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:26.661167 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4aef6a-7f25-446a-995e-52a5d33df471 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:26.661539 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4aef6a-7f25-446a-995e-52a5d33df471 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:26.661910 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4aef6a-7f25-446a-995e-52a5d33df471 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:26.673632 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4aef6a-7f25-446a-995e-52a5d33df471 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:26.675271 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4aef6a-7f25-446a-995e-52a5d33df471 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:26.691830 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 989/1981] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:26.981056 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a34e72-1ea5-40d8-b9ff-6232b3418225 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:26.982542 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-f0a34e72-1ea5-40d8-b9ff-6232b3418225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:27.004058 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a34e72-1ea5-40d8-b9ff-6232b3418225 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:27.014457 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a327f46-1139-4bbd-a85d-581dbc3b12a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:27.015441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a327f46-1139-4bbd-a85d-581dbc3b12a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:27.015786 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a327f46-1139-4bbd-a85d-581dbc3b12a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:27.016126 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a327f46-1139-4bbd-a85d-581dbc3b12a7 admin admin] PATH_INFO: `/v3/projects/9de9b40679e843fa9d8b57a9133f1a8d` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:27.017309 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a327f46-1139-4bbd-a85d-581dbc3b12a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9de9b40679e843fa9d8b57a9133f1a8d)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:27.019269 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a327f46-1139-4bbd-a85d-581dbc3b12a7 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:27.066017 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-8a327f46-1139-4bbd-a85d-581dbc3b12a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9de9b40679e843fa9d8b57a9133f1a8d', 'request_id': 'req-8a327f46-1139-4bbd-a85d-581dbc3b12a7'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:27.072063 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-8a327f46-1139-4bbd-a85d-581dbc3b12a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9de9b40679e843fa9d8b57a9133f1a8d', 'request_id': 'req-8a327f46-1139-4bbd-a85d-581dbc3b12a7'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:27.077654 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-8a327f46-1139-4bbd-a85d-581dbc3b12a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9de9b40679e843fa9d8b57a9133f1a8d', 'request_id': 'req-8a327f46-1139-4bbd-a85d-581dbc3b12a7'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:27.085850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:27.091006 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-8a327f46-1139-4bbd-a85d-581dbc3b12a7 admin admin] The token cache is being invalidate because project 9de9b40679e843fa9d8b57a9133f1a8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:27.091486 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-8a327f46-1139-4bbd-a85d-581dbc3b12a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:27.092538 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-8a327f46-1139-4bbd-a85d-581dbc3b12a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:27.094390 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 993/1982] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:26 2022] DELETE /identity/v3/projects/9de9b40679e843fa9d8b57a9133f1a8d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:27.098510 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4aef6a-7f25-446a-995e-52a5d33df471 service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:27.108927 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4aef6a-7f25-446a-995e-52a5d33df471 service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:27.170143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666612b7-ba1d-47ea-9f1d-20fbc5afde62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:27.171163 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666612b7-ba1d-47ea-9f1d-20fbc5afde62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:27.172634 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666612b7-ba1d-47ea-9f1d-20fbc5afde62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:27.173025 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666612b7-ba1d-47ea-9f1d-20fbc5afde62 admin admin] PATH_INFO: `/v3/users/30a652c646f643b6ac1bf29b73338128` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:27.174321 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666612b7-ba1d-47ea-9f1d-20fbc5afde62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30a652c646f643b6ac1bf29b73338128)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:27.176518 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666612b7-ba1d-47ea-9f1d-20fbc5afde62 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:27.229368 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a327f46-1139-4bbd-a85d-581dbc3b12a7 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:27.231113 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-8a327f46-1139-4bbd-a85d-581dbc3b12a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:27.235910 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-666612b7-ba1d-47ea-9f1d-20fbc5afde62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30a652c646f643b6ac1bf29b73338128'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:27.237131 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-666612b7-ba1d-47ea-9f1d-20fbc5afde62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30a652c646f643b6ac1bf29b73338128'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:27.246920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:27.252804 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a327f46-1139-4bbd-a85d-581dbc3b12a7 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:27.255652 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-666612b7-ba1d-47ea-9f1d-20fbc5afde62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30a652c646f643b6ac1bf29b73338128'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:27.256751 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-666612b7-ba1d-47ea-9f1d-20fbc5afde62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30a652c646f643b6ac1bf29b73338128'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:27.258263 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ddf4d5-128c-44a4-9ef9-d7ed4e39f4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:27.259350 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddf4d5-128c-44a4-9ef9-d7ed4e39f4ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:27.260766 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddf4d5-128c-44a4-9ef9-d7ed4e39f4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:27.261055 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddf4d5-128c-44a4-9ef9-d7ed4e39f4ae admin admin] PATH_INFO: `/v3/users/727e0747ece24b21894669f9333117b2` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:27.266769 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ddf4d5-128c-44a4-9ef9-d7ed4e39f4ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=727e0747ece24b21894669f9333117b2)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:27.269525 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ddf4d5-128c-44a4-9ef9-d7ed4e39f4ae admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:27.271907 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-666612b7-ba1d-47ea-9f1d-20fbc5afde62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30a652c646f643b6ac1bf29b73338128'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:27.294011 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 990/1983] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:27 2022] DELETE /identity/v3/users/30a652c646f643b6ac1bf29b73338128 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:27.344461 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-17ddf4d5-128c-44a4-9ef9-d7ed4e39f4ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '727e0747ece24b21894669f9333117b2'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:27.352448 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-17ddf4d5-128c-44a4-9ef9-d7ed4e39f4ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '727e0747ece24b21894669f9333117b2'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:27.387661 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-17ddf4d5-128c-44a4-9ef9-d7ed4e39f4ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '727e0747ece24b21894669f9333117b2'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:27.402390 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-17ddf4d5-128c-44a4-9ef9-d7ed4e39f4ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '727e0747ece24b21894669f9333117b2'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:27.403224 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-17ddf4d5-128c-44a4-9ef9-d7ed4e39f4ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '727e0747ece24b21894669f9333117b2'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:27.417455 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 994/1984] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:27 2022] DELETE /identity/v3/users/727e0747ece24b21894669f9333117b2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:21:27.421990 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846830e1-9dcd-4c46-8341-cf62fafa95f6 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:27.422273 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846830e1-9dcd-4c46-8341-cf62fafa95f6 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:27.422546 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846830e1-9dcd-4c46-8341-cf62fafa95f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:27.451306 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-846830e1-9dcd-4c46-8341-cf62fafa95f6 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:27.455330 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-846830e1-9dcd-4c46-8341-cf62fafa95f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:27.543253 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 991/1985] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:27.563444 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ddf4d5-128c-44a4-9ef9-d7ed4e39f4ae admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:27.565010 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-17ddf4d5-128c-44a4-9ef9-d7ed4e39f4ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:27.688212 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ddf4d5-128c-44a4-9ef9-d7ed4e39f4ae admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:27.695320 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db13af7-bf85-4870-ab5d-67e33268c9de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:27.696113 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db13af7-bf85-4870-ab5d-67e33268c9de service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:27.696526 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db13af7-bf85-4870-ab5d-67e33268c9de service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:27.696967 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db13af7-bf85-4870-ab5d-67e33268c9de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:27.711464 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db13af7-bf85-4870-ab5d-67e33268c9de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:27.713464 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db13af7-bf85-4870-ab5d-67e33268c9de service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:27.755192 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 995/1986] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:27.756248 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846830e1-9dcd-4c46-8341-cf62fafa95f6 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:27.757728 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-846830e1-9dcd-4c46-8341-cf62fafa95f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:27.777578 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846830e1-9dcd-4c46-8341-cf62fafa95f6 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:27.792833 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365da659-856d-4896-bdd6-468f3a5e5173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:27.793889 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365da659-856d-4896-bdd6-468f3a5e5173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:27.794318 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365da659-856d-4896-bdd6-468f3a5e5173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:27.794748 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365da659-856d-4896-bdd6-468f3a5e5173 admin admin] PATH_INFO: `/v3/projects/37f45fa58eca4dc7b5b4b596ef19721b` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:27.797250 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365da659-856d-4896-bdd6-468f3a5e5173 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37f45fa58eca4dc7b5b4b596ef19721b)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:27.800982 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365da659-856d-4896-bdd6-468f3a5e5173 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:27.930939 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-365da659-856d-4896-bdd6-468f3a5e5173 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37f45fa58eca4dc7b5b4b596ef19721b', 'request_id': 'req-365da659-856d-4896-bdd6-468f3a5e5173'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:27.946742 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db13af7-bf85-4870-ab5d-67e33268c9de service neutron] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:27.948466 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-5db13af7-bf85-4870-ab5d-67e33268c9de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:27.952887 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-365da659-856d-4896-bdd6-468f3a5e5173 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37f45fa58eca4dc7b5b4b596ef19721b', 'request_id': 'req-365da659-856d-4896-bdd6-468f3a5e5173'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:27.961853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-365da659-856d-4896-bdd6-468f3a5e5173 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37f45fa58eca4dc7b5b4b596ef19721b', 'request_id': 'req-365da659-856d-4896-bdd6-468f3a5e5173'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:27.982435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db13af7-bf85-4870-ab5d-67e33268c9de service neutron] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:27.987029 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-365da659-856d-4896-bdd6-468f3a5e5173 admin admin] The token cache is being invalidate because project 37f45fa58eca4dc7b5b4b596ef19721b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:27.987366 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-365da659-856d-4896-bdd6-468f3a5e5173 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:27.988055 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-365da659-856d-4896-bdd6-468f3a5e5173 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:27.990177 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 992/1987] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:27 2022] DELETE /identity/v3/projects/37f45fa58eca4dc7b5b4b596ef19721b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:27.995940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657ad26-50cf-4768-a3c1-eebb415e9c31 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:27.995940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657ad26-50cf-4768-a3c1-eebb415e9c31 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:27.996179 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657ad26-50cf-4768-a3c1-eebb415e9c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:28.038697 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-5657ad26-50cf-4768-a3c1-eebb415e9c31 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:28.040024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-5657ad26-50cf-4768-a3c1-eebb415e9c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:28.171585 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:28.189308 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 993/1988] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:21:28.194667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070efeb-61bc-44b1-8ece-90a5f255e7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:28.195601 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070efeb-61bc-44b1-8ece-90a5f255e7ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:28.195886 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070efeb-61bc-44b1-8ece-90a5f255e7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:28.196164 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070efeb-61bc-44b1-8ece-90a5f255e7ef admin admin] PATH_INFO: `/v3/users/4b5d786e9d724129895f4299bd88fbcb` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:28.201346 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070efeb-61bc-44b1-8ece-90a5f255e7ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b5d786e9d724129895f4299bd88fbcb)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:28.203843 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070efeb-61bc-44b1-8ece-90a5f255e7ef admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:28.204471 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62925482-b59b-41ac-8f4c-313398339531 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:28.204762 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62925482-b59b-41ac-8f4c-313398339531 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:28.205040 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62925482-b59b-41ac-8f4c-313398339531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:28.228617 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-62925482-b59b-41ac-8f4c-313398339531 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:28.229845 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-62925482-b59b-41ac-8f4c-313398339531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:28.237249 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:28.240937 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 994/1989] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:28.245406 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62925482-b59b-41ac-8f4c-313398339531 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:28.271220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62925482-b59b-41ac-8f4c-313398339531 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:28.287433 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725c793-0005-47ba-921d-624df3e8fbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:28.288268 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725c793-0005-47ba-921d-624df3e8fbaf admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:28.288721 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725c793-0005-47ba-921d-624df3e8fbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:28.289160 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725c793-0005-47ba-921d-624df3e8fbaf admin admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:28.290044 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d725c793-0005-47ba-921d-624df3e8fbaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:21:28.292401 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d725c793-0005-47ba-921d-624df3e8fbaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:28.298789 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d725c793-0005-47ba-921d-624df3e8fbaf admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:28.309911 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-9070efeb-61bc-44b1-8ece-90a5f255e7ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b5d786e9d724129895f4299bd88fbcb'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:28.310570 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-9070efeb-61bc-44b1-8ece-90a5f255e7ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b5d786e9d724129895f4299bd88fbcb'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:28.332848 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 995/1990] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:21:28.337352 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725c793-0005-47ba-921d-624df3e8fbaf admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:28.339883 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-d725c793-0005-47ba-921d-624df3e8fbaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:28.355710 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-9070efeb-61bc-44b1-8ece-90a5f255e7ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b5d786e9d724129895f4299bd88fbcb'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:28.358334 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725c793-0005-47ba-921d-624df3e8fbaf admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:28.367420 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ae4ec-7a0a-4e1e-abf7-18101fca2d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:28.367637 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ae4ec-7a0a-4e1e-abf7-18101fca2d7d admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:28.367969 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ae4ec-7a0a-4e1e-abf7-18101fca2d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:28.368248 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ae4ec-7a0a-4e1e-abf7-18101fca2d7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:28.370200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ae4ec-7a0a-4e1e-abf7-18101fca2d7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:28.372169 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ae4ec-7a0a-4e1e-abf7-18101fca2d7d admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:28.384363 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-9070efeb-61bc-44b1-8ece-90a5f255e7ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b5d786e9d724129895f4299bd88fbcb'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:28.385734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-9070efeb-61bc-44b1-8ece-90a5f255e7ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b5d786e9d724129895f4299bd88fbcb'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:28.412940 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 996/1991] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:27 2022] DELETE /identity/v3/users/4b5d786e9d724129895f4299bd88fbcb => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:21:28.412940 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070efeb-61bc-44b1-8ece-90a5f255e7ef admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:28.414428 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-9070efeb-61bc-44b1-8ece-90a5f255e7ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:28.424862 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 996/1992] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:28 2022] POST /identity/v3/projects => generated 375 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:28.426469 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8341a7-55c7-49a6-b20c-6725cc1db375 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:28.426783 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8341a7-55c7-49a6-b20c-6725cc1db375 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:28.427060 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8341a7-55c7-49a6-b20c-6725cc1db375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:28.446951 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-de8341a7-55c7-49a6-b20c-6725cc1db375 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:28.448166 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-de8341a7-55c7-49a6-b20c-6725cc1db375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:28.532438 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070efeb-61bc-44b1-8ece-90a5f255e7ef admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:28.539570 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c945d8f-905d-4133-ae28-ef238b3e8aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:28.540249 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 997/1993] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:28.541834 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c945d8f-905d-4133-ae28-ef238b3e8aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:28.542171 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c945d8f-905d-4133-ae28-ef238b3e8aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:28.542547 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c945d8f-905d-4133-ae28-ef238b3e8aca admin admin] PATH_INFO: `/v3/projects/89b29afe187841c89856d498c492b9c6` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:28.544784 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8341a7-55c7-49a6-b20c-6725cc1db375 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:28.554048 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c945d8f-905d-4133-ae28-ef238b3e8aca admin admin] RBAC: Authorizing `identity:delete_project(project_id=89b29afe187841c89856d498c492b9c6)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:28.555862 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8341a7-55c7-49a6-b20c-6725cc1db375 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:28.557112 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c945d8f-905d-4133-ae28-ef238b3e8aca admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:28.561207 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fdf0ff-a04a-44ea-9cb9-87b38d877d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:28.561995 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdf0ff-a04a-44ea-9cb9-87b38d877d06 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:28.562274 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdf0ff-a04a-44ea-9cb9-87b38d877d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:28.562679 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdf0ff-a04a-44ea-9cb9-87b38d877d06 admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:28.563431 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fdf0ff-a04a-44ea-9cb9-87b38d877d06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:28.565474 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fdf0ff-a04a-44ea-9cb9-87b38d877d06 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:28.589094 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 998/1994] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:28 2022] POST /identity/v3/users => generated 288 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:28.590376 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fdf0ff-a04a-44ea-9cb9-87b38d877d06 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:28.594263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-86fdf0ff-a04a-44ea-9cb9-87b38d877d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:28.625265 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-2c945d8f-905d-4133-ae28-ef238b3e8aca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89b29afe187841c89856d498c492b9c6', 'request_id': 'req-2c945d8f-905d-4133-ae28-ef238b3e8aca'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:28.632852 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-2c945d8f-905d-4133-ae28-ef238b3e8aca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89b29afe187841c89856d498c492b9c6', 'request_id': 'req-2c945d8f-905d-4133-ae28-ef238b3e8aca'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:28.640519 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-2c945d8f-905d-4133-ae28-ef238b3e8aca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89b29afe187841c89856d498c492b9c6', 'request_id': 'req-2c945d8f-905d-4133-ae28-ef238b3e8aca'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:28.658827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-2c945d8f-905d-4133-ae28-ef238b3e8aca admin admin] The token cache is being invalidate because project 89b29afe187841c89856d498c492b9c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:28.659313 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-2c945d8f-905d-4133-ae28-ef238b3e8aca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:28.660148 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-2c945d8f-905d-4133-ae28-ef238b3e8aca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:28.666824 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 997/1995] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:28 2022] DELETE /identity/v3/projects/89b29afe187841c89856d498c492b9c6 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:28.668414 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c945d8f-905d-4133-ae28-ef238b3e8aca admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:28.671286 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fdf0ff-a04a-44ea-9cb9-87b38d877d06 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:28.672670 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-2c945d8f-905d-4133-ae28-ef238b3e8aca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:28.712895 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:28.745250 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed03f4c-042a-4cac-965b-fd286bd95920 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:28.745919 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed03f4c-042a-4cac-965b-fd286bd95920 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:28.746198 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed03f4c-042a-4cac-965b-fd286bd95920 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:28.746472 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed03f4c-042a-4cac-965b-fd286bd95920 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:28.748419 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-1ed03f4c-042a-4cac-965b-fd286bd95920 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:28.758991 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:28.770070 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c945d8f-905d-4133-ae28-ef238b3e8aca admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:28.775201 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48d58d-242d-4447-af5b-33a98662e7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:28.776136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48d58d-242d-4447-af5b-33a98662e7d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:28.776602 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48d58d-242d-4447-af5b-33a98662e7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:28.776984 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48d58d-242d-4447-af5b-33a98662e7d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:28.777786 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48d58d-242d-4447-af5b-33a98662e7d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:28.779783 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48d58d-242d-4447-af5b-33a98662e7d8 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:28.790888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 998/1996] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:28.791720 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48d58d-242d-4447-af5b-33a98662e7d8 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:28.793406 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-6d48d58d-242d-4447-af5b-33a98662e7d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:28.808662 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48d58d-242d-4447-af5b-33a98662e7d8 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:28.813414 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e023e-8242-428d-8d90-f8c95954ce86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:28.814346 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e023e-8242-428d-8d90-f8c95954ce86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:28.814655 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e023e-8242-428d-8d90-f8c95954ce86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:28.814942 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e023e-8242-428d-8d90-f8c95954ce86 admin admin] PATH_INFO: `/v3/users/ee543ccd0a604abfb6da653b5337f986` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:28.816353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e023e-8242-428d-8d90-f8c95954ce86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee543ccd0a604abfb6da653b5337f986)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:28.818388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e023e-8242-428d-8d90-f8c95954ce86 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:28.827366 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed03f4c-042a-4cac-965b-fd286bd95920 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:28.829049 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed03f4c-042a-4cac-965b-fd286bd95920 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:28.840423 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 999/1997] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:28.841409 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed03f4c-042a-4cac-965b-fd286bd95920 service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:28.853144 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed03f4c-042a-4cac-965b-fd286bd95920 service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:28.859527 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6b543-877a-42bd-b1cd-c013998615d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:28.860762 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6b543-877a-42bd-b1cd-c013998615d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:28.861053 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6b543-877a-42bd-b1cd-c013998615d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:28.861460 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6b543-877a-42bd-b1cd-c013998615d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:28.862583 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad6b543-877a-42bd-b1cd-c013998615d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:28.864851 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad6b543-877a-42bd-b1cd-c013998615d2 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:28.881138 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1000/1998] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:28.886223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6b543-877a-42bd-b1cd-c013998615d2 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:28.899660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-d01e023e-8242-428d-8d90-f8c95954ce86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee543ccd0a604abfb6da653b5337f986'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:28.900369 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-d01e023e-8242-428d-8d90-f8c95954ce86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee543ccd0a604abfb6da653b5337f986'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:28.910545 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6b543-877a-42bd-b1cd-c013998615d2 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:28.917854 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-d01e023e-8242-428d-8d90-f8c95954ce86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee543ccd0a604abfb6da653b5337f986'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:28.927433 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1de1a-083f-4256-8be5-ac8931508d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:28.930580 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1de1a-083f-4256-8be5-ac8931508d80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:28.930890 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1de1a-083f-4256-8be5-ac8931508d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:28.931174 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1de1a-083f-4256-8be5-ac8931508d80 admin admin] PATH_INFO: `/v3/projects/eeb89edd3fdc4f9c912c9e9188ec78ac/users/a7779dbc37a3403a96e07173281b8853/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:28.932079 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-d01e023e-8242-428d-8d90-f8c95954ce86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee543ccd0a604abfb6da653b5337f986'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:28.933317 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-d01e023e-8242-428d-8d90-f8c95954ce86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee543ccd0a604abfb6da653b5337f986'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:28.953911 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 999/1999] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:28 2022] DELETE /identity/v3/users/ee543ccd0a604abfb6da653b5337f986 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:28.981175 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1de1a-083f-4256-8be5-ac8931508d80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeb89edd3fdc4f9c912c9e9188ec78ac, user_id=a7779dbc37a3403a96e07173281b8853, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:28.985691 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1de1a-083f-4256-8be5-ac8931508d80 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:29.022057 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1001/2000] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:28 2022] PUT /identity/v3/projects/eeb89edd3fdc4f9c912c9e9188ec78ac/users/a7779dbc37a3403a96e07173281b8853/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:29.032282 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5475c-1415-4a7c-9e14-4a5787339842 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:29.032566 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5475c-1415-4a7c-9e14-4a5787339842 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:29.032864 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5475c-1415-4a7c-9e14-4a5787339842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:29.067783 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-1df5475c-1415-4a7c-9e14-4a5787339842 None None] MFA Rules not processed for user `a7779dbc37a3403a96e07173281b8853`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:29.069682 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-1df5475c-1415-4a7c-9e14-4a5787339842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:29.197758 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1000/2001] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:29.251966 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1de1a-083f-4256-8be5-ac8931508d80 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:29.254836 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-3de1de1a-083f-4256-8be5-ac8931508d80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:29.331279 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1de1a-083f-4256-8be5-ac8931508d80 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:29.335997 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92e616-b3d9-49b9-9e96-db7db19fcc65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:29.336875 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92e616-b3d9-49b9-9e96-db7db19fcc65 service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:29.337313 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92e616-b3d9-49b9-9e96-db7db19fcc65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:29.337779 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92e616-b3d9-49b9-9e96-db7db19fcc65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:29.352792 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92e616-b3d9-49b9-9e96-db7db19fcc65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:29.354328 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92e616-b3d9-49b9-9e96-db7db19fcc65 service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:29.398028 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1002/2002] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:29.455021 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5475c-1415-4a7c-9e14-4a5787339842 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:29.456611 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-1df5475c-1415-4a7c-9e14-4a5787339842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:29.533140 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:29.600089 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92e616-b3d9-49b9-9e96-db7db19fcc65 service cinder] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:29.601770 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-fa92e616-b3d9-49b9-9e96-db7db19fcc65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:29.665049 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5475c-1415-4a7c-9e14-4a5787339842 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:29.679581 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2263591-7593-4290-a42e-35acfefb76de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:29.680479 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2263591-7593-4290-a42e-35acfefb76de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:29.680768 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2263591-7593-4290-a42e-35acfefb76de admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:29.681074 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2263591-7593-4290-a42e-35acfefb76de admin admin] PATH_INFO: `/v3/projects/ee3a1950c9744172af7a2a2b41f64129` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:29.683239 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2263591-7593-4290-a42e-35acfefb76de admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee3a1950c9744172af7a2a2b41f64129)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:29.685270 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2263591-7593-4290-a42e-35acfefb76de admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:29.790894 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92e616-b3d9-49b9-9e96-db7db19fcc65 service cinder] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:29.803064 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-d2263591-7593-4290-a42e-35acfefb76de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee3a1950c9744172af7a2a2b41f64129', 'request_id': 'req-d2263591-7593-4290-a42e-35acfefb76de'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:29.814182 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-d2263591-7593-4290-a42e-35acfefb76de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee3a1950c9744172af7a2a2b41f64129', 'request_id': 'req-d2263591-7593-4290-a42e-35acfefb76de'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:29.821703 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-d2263591-7593-4290-a42e-35acfefb76de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee3a1950c9744172af7a2a2b41f64129', 'request_id': 'req-d2263591-7593-4290-a42e-35acfefb76de'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:29.837985 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:29.847751 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-d2263591-7593-4290-a42e-35acfefb76de admin admin] The token cache is being invalidate because project ee3a1950c9744172af7a2a2b41f64129 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:29.848276 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-d2263591-7593-4290-a42e-35acfefb76de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:29.850023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-d2263591-7593-4290-a42e-35acfefb76de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:29.861389 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1001/2003] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:29 2022] DELETE /identity/v3/projects/ee3a1950c9744172af7a2a2b41f64129 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:29.863430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2263591-7593-4290-a42e-35acfefb76de admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:29.865216 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-d2263591-7593-4290-a42e-35acfefb76de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:29.992086 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b88175-5b39-4852-ac9f-9c08a42415cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:29.993001 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b88175-5b39-4852-ac9f-9c08a42415cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:29.993282 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b88175-5b39-4852-ac9f-9c08a42415cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:29.993555 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b88175-5b39-4852-ac9f-9c08a42415cc admin admin] PATH_INFO: `/v3/projects/31b3ebf39164444b8430adb28720d283` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:29.996976 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b88175-5b39-4852-ac9f-9c08a42415cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=31b3ebf39164444b8430adb28720d283)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:30.007420 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2263591-7593-4290-a42e-35acfefb76de admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:30.007558 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b88175-5b39-4852-ac9f-9c08a42415cc admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:30.018386 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d9923-b8b1-46d3-9183-b8bc446d58dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:30.020398 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d9923-b8b1-46d3-9183-b8bc446d58dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:30.020685 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d9923-b8b1-46d3-9183-b8bc446d58dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:30.020967 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d9923-b8b1-46d3-9183-b8bc446d58dc admin admin] PATH_INFO: `/v3/users/9d4639df79ea4aa1b074d40805672549` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:30.025943 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d9923-b8b1-46d3-9183-b8bc446d58dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d4639df79ea4aa1b074d40805672549)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:30.030900 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d9923-b8b1-46d3-9183-b8bc446d58dc admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:30.159440 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b7b88175-5b39-4852-ac9f-9c08a42415cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31b3ebf39164444b8430adb28720d283', 'request_id': 'req-b7b88175-5b39-4852-ac9f-9c08a42415cc'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:30.180590 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b7b88175-5b39-4852-ac9f-9c08a42415cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31b3ebf39164444b8430adb28720d283', 'request_id': 'req-b7b88175-5b39-4852-ac9f-9c08a42415cc'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:30.191736 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-9b8d9923-b8b1-46d3-9183-b8bc446d58dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d4639df79ea4aa1b074d40805672549'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:30.192427 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b7b88175-5b39-4852-ac9f-9c08a42415cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31b3ebf39164444b8430adb28720d283', 'request_id': 'req-b7b88175-5b39-4852-ac9f-9c08a42415cc'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:30.194269 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-9b8d9923-b8b1-46d3-9183-b8bc446d58dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d4639df79ea4aa1b074d40805672549'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:30.218687 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b7b88175-5b39-4852-ac9f-9c08a42415cc admin admin] The token cache is being invalidate because project 31b3ebf39164444b8430adb28720d283 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:30.218888 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b7b88175-5b39-4852-ac9f-9c08a42415cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:30.220339 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:30.220970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b7b88175-5b39-4852-ac9f-9c08a42415cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:30.229702 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1003/2004] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:29 2022] DELETE /identity/v3/projects/31b3ebf39164444b8430adb28720d283 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:30.234396 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c24b6-472b-40a3-955f-53a2cdabba45 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:30.234703 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c24b6-472b-40a3-955f-53a2cdabba45 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:30.234992 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c24b6-472b-40a3-955f-53a2cdabba45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:30.242941 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-9b8d9923-b8b1-46d3-9183-b8bc446d58dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d4639df79ea4aa1b074d40805672549'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:30.263528 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-9b8d9923-b8b1-46d3-9183-b8bc446d58dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d4639df79ea4aa1b074d40805672549'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:30.266908 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-9b8d9923-b8b1-46d3-9183-b8bc446d58dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d4639df79ea4aa1b074d40805672549'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:30.274351 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-d15c24b6-472b-40a3-955f-53a2cdabba45 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:30.275659 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-d15c24b6-472b-40a3-955f-53a2cdabba45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:30.307410 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1002/2005] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:29 2022] DELETE /identity/v3/users/9d4639df79ea4aa1b074d40805672549 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:30.416591 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1004/2006] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:21:30.434062 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e1b80-3aee-470b-9b32-5e9384754b39 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:30.434409 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e1b80-3aee-470b-9b32-5e9384754b39 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:30.434739 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e1b80-3aee-470b-9b32-5e9384754b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:30.481250 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-493e1b80-3aee-470b-9b32-5e9384754b39 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:30.482182 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-493e1b80-3aee-470b-9b32-5e9384754b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:30.622922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1003/2007] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:30.627202 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c24b6-472b-40a3-955f-53a2cdabba45 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:30.641463 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c24b6-472b-40a3-955f-53a2cdabba45 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:30.650602 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ca85a-00fb-43c1-b52e-ca4708f70d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:30.651319 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ca85a-00fb-43c1-b52e-ca4708f70d80 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:30.651606 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ca85a-00fb-43c1-b52e-ca4708f70d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:30.651964 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ca85a-00fb-43c1-b52e-ca4708f70d80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:30.674481 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ca85a-00fb-43c1-b52e-ca4708f70d80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:21:30.674481 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ca85a-00fb-43c1-b52e-ca4708f70d80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:30.679600 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ca85a-00fb-43c1-b52e-ca4708f70d80 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:30.686583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e1b80-3aee-470b-9b32-5e9384754b39 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:30.688718 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-493e1b80-3aee-470b-9b32-5e9384754b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:30.704712 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1005/2008] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:21:30.706225 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ca85a-00fb-43c1-b52e-ca4708f70d80 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:30.708651 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e1b80-3aee-470b-9b32-5e9384754b39 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:30.714868 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e7bbf-57cd-48e9-b8dc-0f39bf005c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:30.716640 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e7bbf-57cd-48e9-b8dc-0f39bf005c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:30.717031 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e7bbf-57cd-48e9-b8dc-0f39bf005c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:30.732207 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e7bbf-57cd-48e9-b8dc-0f39bf005c38 admin admin] PATH_INFO: `/v3/users/e12b7df75e0c4695a29bf7d7b49f5bd6` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:30.734007 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e7bbf-57cd-48e9-b8dc-0f39bf005c38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e12b7df75e0c4695a29bf7d7b49f5bd6)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:30.736379 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e7bbf-57cd-48e9-b8dc-0f39bf005c38 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:30.740868 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ca85a-00fb-43c1-b52e-ca4708f70d80 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:30.748588 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a1741-da43-4c69-8d4a-d37ca70fa2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:30.749275 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a1741-da43-4c69-8d4a-d37ca70fa2ec admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:30.749569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a1741-da43-4c69-8d4a-d37ca70fa2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:30.749847 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a1741-da43-4c69-8d4a-d37ca70fa2ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:30.750557 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a1741-da43-4c69-8d4a-d37ca70fa2ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:30.753413 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a1741-da43-4c69-8d4a-d37ca70fa2ec admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:30.813604 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1006/2009] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:30 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:30.814979 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a1741-da43-4c69-8d4a-d37ca70fa2ec admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:30.836461 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-359e7bbf-57cd-48e9-b8dc-0f39bf005c38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e12b7df75e0c4695a29bf7d7b49f5bd6'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:30.837813 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-359e7bbf-57cd-48e9-b8dc-0f39bf005c38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e12b7df75e0c4695a29bf7d7b49f5bd6'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:30.846754 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:30.875254 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-359e7bbf-57cd-48e9-b8dc-0f39bf005c38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e12b7df75e0c4695a29bf7d7b49f5bd6'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:30.893208 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-359e7bbf-57cd-48e9-b8dc-0f39bf005c38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e12b7df75e0c4695a29bf7d7b49f5bd6'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:30.893847 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-359e7bbf-57cd-48e9-b8dc-0f39bf005c38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e12b7df75e0c4695a29bf7d7b49f5bd6'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:30.920614 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1004/2010] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:30 2022] DELETE /identity/v3/users/e12b7df75e0c4695a29bf7d7b49f5bd6 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:30.931150 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc345873-6038-410b-9ea3-153900433e1a None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:30.931613 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc345873-6038-410b-9ea3-153900433e1a None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:30.931613 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc345873-6038-410b-9ea3-153900433e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:30.938992 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a1741-da43-4c69-8d4a-d37ca70fa2ec admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:30.982346 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-dc345873-6038-410b-9ea3-153900433e1a None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:30.983642 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-dc345873-6038-410b-9ea3-153900433e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:31.027260 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563479af-4707-48b4-b1f0-c5cb41c5a76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:31.028064 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563479af-4707-48b4-b1f0-c5cb41c5a76a admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:31.028408 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563479af-4707-48b4-b1f0-c5cb41c5a76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:31.028613 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563479af-4707-48b4-b1f0-c5cb41c5a76a admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:31.029582 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563479af-4707-48b4-b1f0-c5cb41c5a76a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:31.031582 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563479af-4707-48b4-b1f0-c5cb41c5a76a admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:31.038819 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:31.058994 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1007/2011] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:30 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:31.058994 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563479af-4707-48b4-b1f0-c5cb41c5a76a admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:31.058994 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-563479af-4707-48b4-b1f0-c5cb41c5a76a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:31.070118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1005/2012] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:31.073650 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563479af-4707-48b4-b1f0-c5cb41c5a76a admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:31.073755 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc345873-6038-410b-9ea3-153900433e1a None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:31.077968 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fba39a-de86-4446-b1c2-cd30ef46e10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:31.079239 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fba39a-de86-4446-b1c2-cd30ef46e10f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:31.079527 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fba39a-de86-4446-b1c2-cd30ef46e10f admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:31.079802 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fba39a-de86-4446-b1c2-cd30ef46e10f admin admin] PATH_INFO: `/v3/projects/8379ffae441743b28f3390f8c262c25f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:31.079904 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-dc345873-6038-410b-9ea3-153900433e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:31.081005 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fba39a-de86-4446-b1c2-cd30ef46e10f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8379ffae441743b28f3390f8c262c25f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:31.083182 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fba39a-de86-4446-b1c2-cd30ef46e10f admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:31.092482 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc345873-6038-410b-9ea3-153900433e1a None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:31.097141 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38207d-01ce-49e7-8d52-f8c81b389a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:31.097813 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38207d-01ce-49e7-8d52-f8c81b389a83 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:31.098093 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38207d-01ce-49e7-8d52-f8c81b389a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:31.098414 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38207d-01ce-49e7-8d52-f8c81b389a83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:31.099236 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38207d-01ce-49e7-8d52-f8c81b389a83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:31.101533 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38207d-01ce-49e7-8d52-f8c81b389a83 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:31.113876 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1006/2013] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:31.114769 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38207d-01ce-49e7-8d52-f8c81b389a83 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:31.116689 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-da38207d-01ce-49e7-8d52-f8c81b389a83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:31.133719 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-12fba39a-de86-4446-b1c2-cd30ef46e10f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8379ffae441743b28f3390f8c262c25f', 'request_id': 'req-12fba39a-de86-4446-b1c2-cd30ef46e10f'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:31.144134 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-12fba39a-de86-4446-b1c2-cd30ef46e10f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8379ffae441743b28f3390f8c262c25f', 'request_id': 'req-12fba39a-de86-4446-b1c2-cd30ef46e10f'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:31.154761 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-12fba39a-de86-4446-b1c2-cd30ef46e10f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8379ffae441743b28f3390f8c262c25f', 'request_id': 'req-12fba39a-de86-4446-b1c2-cd30ef46e10f'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:31.169417 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-12fba39a-de86-4446-b1c2-cd30ef46e10f admin admin] The token cache is being invalidate because project 8379ffae441743b28f3390f8c262c25f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:31.169716 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-12fba39a-de86-4446-b1c2-cd30ef46e10f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:31.170684 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-12fba39a-de86-4446-b1c2-cd30ef46e10f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:31.173084 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1008/2014] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:31 2022] DELETE /identity/v3/projects/8379ffae441743b28f3390f8c262c25f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:31.173996 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fba39a-de86-4446-b1c2-cd30ef46e10f admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:31.175482 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-12fba39a-de86-4446-b1c2-cd30ef46e10f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:31.187415 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38207d-01ce-49e7-8d52-f8c81b389a83 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:31.231929 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:31.260072 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc41957-311e-4858-a2bf-899de7fcd365 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:31.260761 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc41957-311e-4858-a2bf-899de7fcd365 service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:31.261047 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc41957-311e-4858-a2bf-899de7fcd365 service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:31.261326 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc41957-311e-4858-a2bf-899de7fcd365 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:31.263542 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-ebc41957-311e-4858-a2bf-899de7fcd365 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:31.269120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fba39a-de86-4446-b1c2-cd30ef46e10f admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:31.275146 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587623ac-d3dd-4de9-a8b6-1051d76a6d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:31.276095 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587623ac-d3dd-4de9-a8b6-1051d76a6d7b admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:31.276482 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587623ac-d3dd-4de9-a8b6-1051d76a6d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:31.276826 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587623ac-d3dd-4de9-a8b6-1051d76a6d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:31.277634 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587623ac-d3dd-4de9-a8b6-1051d76a6d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:31.279697 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587623ac-d3dd-4de9-a8b6-1051d76a6d7b admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:31.283641 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc41957-311e-4858-a2bf-899de7fcd365 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:31.285647 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc41957-311e-4858-a2bf-899de7fcd365 service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:31.293456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1009/2015] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:31.294994 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e2146-a98b-4efc-8fc6-75b2e87ec4a4 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:31.295285 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e2146-a98b-4efc-8fc6-75b2e87ec4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:31.295774 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e2146-a98b-4efc-8fc6-75b2e87ec4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:31.315217 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1007/2016] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:31.316246 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc41957-311e-4858-a2bf-899de7fcd365 service neutron] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:31.319989 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-aa3e2146-a98b-4efc-8fc6-75b2e87ec4a4 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:31.321443 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-aa3e2146-a98b-4efc-8fc6-75b2e87ec4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:31.331575 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1010/2017] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:31.340064 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78c6a4-6dfe-4936-854b-18bfb0b05557 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:31.340561 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78c6a4-6dfe-4936-854b-18bfb0b05557 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:31.340987 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78c6a4-6dfe-4936-854b-18bfb0b05557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:31.342051 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc41957-311e-4858-a2bf-899de7fcd365 service neutron] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:31.350113 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842ec95-caf9-44e1-8cb9-5d2797e104a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:31.351133 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842ec95-caf9-44e1-8cb9-5d2797e104a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:31.352561 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842ec95-caf9-44e1-8cb9-5d2797e104a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:31.352915 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842ec95-caf9-44e1-8cb9-5d2797e104a1 admin admin] PATH_INFO: `/v3/projects/94e3e63014d9416bb99e04de3b4f499b/users/b697d377ed9f4461b4fc0d78bdaaaae8/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:31.391007 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842ec95-caf9-44e1-8cb9-5d2797e104a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94e3e63014d9416bb99e04de3b4f499b, user_id=b697d377ed9f4461b4fc0d78bdaaaae8, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:31.393471 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-3d78c6a4-6dfe-4936-854b-18bfb0b05557 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:31.394009 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842ec95-caf9-44e1-8cb9-5d2797e104a1 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:31.394866 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-3d78c6a4-6dfe-4936-854b-18bfb0b05557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:31.415909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1008/2018] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:31 2022] PUT /identity/v3/projects/94e3e63014d9416bb99e04de3b4f499b/users/b697d377ed9f4461b4fc0d78bdaaaae8/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:31.426977 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1011/2019] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:31.428599 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc839bd9-17ff-46b9-8ca6-a2e7088bcf03 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:31.429179 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc839bd9-17ff-46b9-8ca6-a2e7088bcf03 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:31.429795 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc839bd9-17ff-46b9-8ca6-a2e7088bcf03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:31.431336 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78c6a4-6dfe-4936-854b-18bfb0b05557 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:31.451061 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78c6a4-6dfe-4936-854b-18bfb0b05557 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:31.474337 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-bc839bd9-17ff-46b9-8ca6-a2e7088bcf03 None None] MFA Rules not processed for user `b697d377ed9f4461b4fc0d78bdaaaae8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:31.475540 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-bc839bd9-17ff-46b9-8ca6-a2e7088bcf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:31.532125 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6079a-b5d0-4938-b012-e5787e3e0af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:31.532862 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6079a-b5d0-4938-b012-e5787e3e0af6 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:31.534052 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6079a-b5d0-4938-b012-e5787e3e0af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:31.534052 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6079a-b5d0-4938-b012-e5787e3e0af6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:31.534793 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6079a-b5d0-4938-b012-e5787e3e0af6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:21:31.535095 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6079a-b5d0-4938-b012-e5787e3e0af6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:31.538394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6079a-b5d0-4938-b012-e5787e3e0af6 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:31.557219 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1012/2020] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:21:31.558321 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6079a-b5d0-4938-b012-e5787e3e0af6 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:31.569535 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6079a-b5d0-4938-b012-e5787e3e0af6 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:31.577452 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15191f50-1d23-47ff-87a4-6b1eca0a6b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:31.578302 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15191f50-1d23-47ff-87a4-6b1eca0a6b56 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:31.581814 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15191f50-1d23-47ff-87a4-6b1eca0a6b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:31.581814 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15191f50-1d23-47ff-87a4-6b1eca0a6b56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:31.581814 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15191f50-1d23-47ff-87a4-6b1eca0a6b56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:31.582666 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15191f50-1d23-47ff-87a4-6b1eca0a6b56 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:31.587690 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:31.600664 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1009/2021] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:21:31.616623 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc839bd9-17ff-46b9-8ca6-a2e7088bcf03 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:31.619612 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-bc839bd9-17ff-46b9-8ca6-a2e7088bcf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:31.629263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1013/2022] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:31 2022] POST /identity/v3/projects => generated 365 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:31.630163 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15191f50-1d23-47ff-87a4-6b1eca0a6b56 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:31.725258 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15191f50-1d23-47ff-87a4-6b1eca0a6b56 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:31.731122 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4bcf9-ab2c-421e-bcb9-84c70ec8e0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:31.731808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4bcf9-ab2c-421e-bcb9-84c70ec8e0e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:31.732103 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4bcf9-ab2c-421e-bcb9-84c70ec8e0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:31.732376 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4bcf9-ab2c-421e-bcb9-84c70ec8e0e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:31.733228 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4bcf9-ab2c-421e-bcb9-84c70ec8e0e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:31.735225 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4bcf9-ab2c-421e-bcb9-84c70ec8e0e3 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:31.747961 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc839bd9-17ff-46b9-8ca6-a2e7088bcf03 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:31.761599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1014/2023] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:31 2022] POST /identity/v3/users => generated 283 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:31.762517 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4bcf9-ab2c-421e-bcb9-84c70ec8e0e3 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:31.764570 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-6de4bcf9-ab2c-421e-bcb9-84c70ec8e0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:31.787697 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4bcf9-ab2c-421e-bcb9-84c70ec8e0e3 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:31.792843 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc36c0-c2a9-4c12-a9c3-87de730f9396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:31.794082 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc36c0-c2a9-4c12-a9c3-87de730f9396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:31.794584 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc36c0-c2a9-4c12-a9c3-87de730f9396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:31.795144 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc36c0-c2a9-4c12-a9c3-87de730f9396 admin admin] PATH_INFO: `/v3/projects/fa2b6ae3d1bc413f94dda358c4da784c` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:31.796404 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc36c0-c2a9-4c12-a9c3-87de730f9396 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa2b6ae3d1bc413f94dda358c4da784c)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:31.800703 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc36c0-c2a9-4c12-a9c3-87de730f9396 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:31.805937 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263881d-f75b-46bc-9aa0-cb16ca3943a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:31.806601 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263881d-f75b-46bc-9aa0-cb16ca3943a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:31.806916 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263881d-f75b-46bc-9aa0-cb16ca3943a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:31.807189 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263881d-f75b-46bc-9aa0-cb16ca3943a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:31.817405 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:31.859691 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-a2cc36c0-c2a9-4c12-a9c3-87de730f9396 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa2b6ae3d1bc413f94dda358c4da784c', 'request_id': 'req-a2cc36c0-c2a9-4c12-a9c3-87de730f9396'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:31.869216 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-a2cc36c0-c2a9-4c12-a9c3-87de730f9396 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa2b6ae3d1bc413f94dda358c4da784c', 'request_id': 'req-a2cc36c0-c2a9-4c12-a9c3-87de730f9396'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:31.877892 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263881d-f75b-46bc-9aa0-cb16ca3943a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:31.879553 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263881d-f75b-46bc-9aa0-cb16ca3943a0 service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:31.879733 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-a2cc36c0-c2a9-4c12-a9c3-87de730f9396 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa2b6ae3d1bc413f94dda358c4da784c', 'request_id': 'req-a2cc36c0-c2a9-4c12-a9c3-87de730f9396'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:31.891685 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1010/2024] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:31.892266 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-a2cc36c0-c2a9-4c12-a9c3-87de730f9396 admin admin] The token cache is being invalidate because project fa2b6ae3d1bc413f94dda358c4da784c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:31.892520 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263881d-f75b-46bc-9aa0-cb16ca3943a0 service cinder] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:31.892695 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-a2cc36c0-c2a9-4c12-a9c3-87de730f9396 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:31.893567 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-a2cc36c0-c2a9-4c12-a9c3-87de730f9396 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:31.895183 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1015/2025] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:31 2022] DELETE /identity/v3/projects/fa2b6ae3d1bc413f94dda358c4da784c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:31.900577 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc36c0-c2a9-4c12-a9c3-87de730f9396 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:31.902296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-a2cc36c0-c2a9-4c12-a9c3-87de730f9396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:31.904677 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263881d-f75b-46bc-9aa0-cb16ca3943a0 service cinder] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:31.981065 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2de5f9-2271-4d06-9470-dd6a5dea04a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:31.981580 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2de5f9-2271-4d06-9470-dd6a5dea04a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:31.981869 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2de5f9-2271-4d06-9470-dd6a5dea04a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:31.982454 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2de5f9-2271-4d06-9470-dd6a5dea04a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:31.983222 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2de5f9-2271-4d06-9470-dd6a5dea04a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:31.984562 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc36c0-c2a9-4c12-a9c3-87de730f9396 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:31.984850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2de5f9-2271-4d06-9470-dd6a5dea04a5 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:31.996435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1011/2026] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:32.000520 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2de5f9-2271-4d06-9470-dd6a5dea04a5 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:32.001503 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9cd123-66f5-439a-9424-37dfcc0ad453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:32.002016 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-9d2de5f9-2271-4d06-9470-dd6a5dea04a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:32.002406 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cd123-66f5-439a-9424-37dfcc0ad453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:32.002726 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cd123-66f5-439a-9424-37dfcc0ad453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:32.003157 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cd123-66f5-439a-9424-37dfcc0ad453 admin admin] PATH_INFO: `/v3/users/b12c96f77c444b7289f3a3d07b37aaa2` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:32.004227 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9cd123-66f5-439a-9424-37dfcc0ad453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b12c96f77c444b7289f3a3d07b37aaa2)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:32.006759 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9cd123-66f5-439a-9424-37dfcc0ad453 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:32.010583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:32.018207 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2de5f9-2271-4d06-9470-dd6a5dea04a5 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:32.025464 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09646dd-9dc4-4a23-9262-5fafe6745def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:32.027138 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09646dd-9dc4-4a23-9262-5fafe6745def admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:32.027617 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09646dd-9dc4-4a23-9262-5fafe6745def admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:32.028228 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09646dd-9dc4-4a23-9262-5fafe6745def admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:32.029184 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09646dd-9dc4-4a23-9262-5fafe6745def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:32.031713 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09646dd-9dc4-4a23-9262-5fafe6745def admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:32.044539 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1012/2027] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:21:32.048660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09646dd-9dc4-4a23-9262-5fafe6745def admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:32.064280 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09646dd-9dc4-4a23-9262-5fafe6745def admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:32.070057 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee1988-0629-4bcc-b3bd-71e79d3eac61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:32.071109 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee1988-0629-4bcc-b3bd-71e79d3eac61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:32.071942 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee1988-0629-4bcc-b3bd-71e79d3eac61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:32.072380 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee1988-0629-4bcc-b3bd-71e79d3eac61 admin admin] PATH_INFO: `/v3/projects/148e3be280d143de9728099a7b7f9484/users/962ee2a86b184374bccc45831596a1d7/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:32.086421 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-5d9cd123-66f5-439a-9424-37dfcc0ad453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b12c96f77c444b7289f3a3d07b37aaa2'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:32.087478 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-5d9cd123-66f5-439a-9424-37dfcc0ad453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b12c96f77c444b7289f3a3d07b37aaa2'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:32.092467 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee1988-0629-4bcc-b3bd-71e79d3eac61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=148e3be280d143de9728099a7b7f9484, user_id=962ee2a86b184374bccc45831596a1d7, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:32.096423 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee1988-0629-4bcc-b3bd-71e79d3eac61 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:32.115648 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1013/2028] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:32 2022] PUT /identity/v3/projects/148e3be280d143de9728099a7b7f9484/users/962ee2a86b184374bccc45831596a1d7/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:32.127277 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2ac1e-73e5-433b-8b04-4006d82726e0 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:32.127680 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2ac1e-73e5-433b-8b04-4006d82726e0 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:32.127986 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2ac1e-73e5-433b-8b04-4006d82726e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:32.135054 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-5d9cd123-66f5-439a-9424-37dfcc0ad453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b12c96f77c444b7289f3a3d07b37aaa2'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:32.136010 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-5d9cd123-66f5-439a-9424-37dfcc0ad453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b12c96f77c444b7289f3a3d07b37aaa2'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:32.149605 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-5d9cd123-66f5-439a-9424-37dfcc0ad453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b12c96f77c444b7289f3a3d07b37aaa2'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:32.171683 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1016/2029] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:31 2022] DELETE /identity/v3/users/b12c96f77c444b7289f3a3d07b37aaa2 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:32.188451 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-0ba2ac1e-73e5-433b-8b04-4006d82726e0 None None] MFA Rules not processed for user `962ee2a86b184374bccc45831596a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:32.189742 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-0ba2ac1e-73e5-433b-8b04-4006d82726e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:32.290504 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1014/2030] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:32.291376 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9cd123-66f5-439a-9424-37dfcc0ad453 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:32.298996 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-5d9cd123-66f5-439a-9424-37dfcc0ad453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:32.395022 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:32.466567 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9cd123-66f5-439a-9424-37dfcc0ad453 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:32.473947 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4ed37-9b69-4192-ac50-8ccfaab86c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:32.475125 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4ed37-9b69-4192-ac50-8ccfaab86c68 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:32.475125 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4ed37-9b69-4192-ac50-8ccfaab86c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:32.475507 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4ed37-9b69-4192-ac50-8ccfaab86c68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:32.476226 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4ed37-9b69-4192-ac50-8ccfaab86c68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:32.480514 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4ed37-9b69-4192-ac50-8ccfaab86c68 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:32.519522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1017/2031] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:32 2022] POST /identity/v3/projects => generated 367 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:32.523250 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2ac1e-73e5-433b-8b04-4006d82726e0 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:32.535075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2ac1e-73e5-433b-8b04-4006d82726e0 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:32.597695 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4ed37-9b69-4192-ac50-8ccfaab86c68 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:32.599972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-b7e4ed37-9b69-4192-ac50-8ccfaab86c68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:32.614034 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a06004-7e8b-4acc-9e5e-eda2e53f23f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:32.614882 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a06004-7e8b-4acc-9e5e-eda2e53f23f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:32.615740 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a06004-7e8b-4acc-9e5e-eda2e53f23f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:32.616188 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a06004-7e8b-4acc-9e5e-eda2e53f23f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:32.617080 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a06004-7e8b-4acc-9e5e-eda2e53f23f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:32.619604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a06004-7e8b-4acc-9e5e-eda2e53f23f8 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:32.644567 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1015/2032] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:32 2022] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:32.648960 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a06004-7e8b-4acc-9e5e-eda2e53f23f8 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:32.661256 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a06004-7e8b-4acc-9e5e-eda2e53f23f8 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:32.667324 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f260e4-95b6-4014-a138-bf39032f8510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:32.668783 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f260e4-95b6-4014-a138-bf39032f8510 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:32.668783 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f260e4-95b6-4014-a138-bf39032f8510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:32.668783 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f260e4-95b6-4014-a138-bf39032f8510 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:32.669373 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f260e4-95b6-4014-a138-bf39032f8510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:32.671019 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f260e4-95b6-4014-a138-bf39032f8510 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:32.682584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1016/2033] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:21:32.684087 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9a73e-9ea6-45ba-87d6-324edd9499c5 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:32.684380 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9a73e-9ea6-45ba-87d6-324edd9499c5 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:32.684658 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9a73e-9ea6-45ba-87d6-324edd9499c5 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:32.686379 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1017/2034] 10.222.0.13 () {54 vars in 921 bytes} [Wed Jun 29 12:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:21:32.695976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555738e-52ab-470f-811a-1bb36d027bfa None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:32.696457 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555738e-52ab-470f-811a-1bb36d027bfa None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:32.696847 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555738e-52ab-470f-811a-1bb36d027bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:32.714115 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4ed37-9b69-4192-ac50-8ccfaab86c68 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:32.719581 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535bbada-cece-4683-b55c-356cbe5dad5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:32.720590 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535bbada-cece-4683-b55c-356cbe5dad5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:32.720863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-0555738e-52ab-470f-811a-1bb36d027bfa None None] MFA Rules not processed for user `cd57c8b894e74c709ea389ed462184fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:32.720976 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535bbada-cece-4683-b55c-356cbe5dad5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:32.721194 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535bbada-cece-4683-b55c-356cbe5dad5e admin admin] PATH_INFO: `/v3/projects/29739a9103a34b668740a58b25371036` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:32.722677 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535bbada-cece-4683-b55c-356cbe5dad5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=29739a9103a34b668740a58b25371036)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:32.725016 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535bbada-cece-4683-b55c-356cbe5dad5e admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:32.728023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-0555738e-52ab-470f-811a-1bb36d027bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:32.781192 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:32.806142 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-535bbada-cece-4683-b55c-356cbe5dad5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29739a9103a34b668740a58b25371036', 'request_id': 'req-535bbada-cece-4683-b55c-356cbe5dad5e'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:32.816727 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-535bbada-cece-4683-b55c-356cbe5dad5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29739a9103a34b668740a58b25371036', 'request_id': 'req-535bbada-cece-4683-b55c-356cbe5dad5e'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:32.824218 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-535bbada-cece-4683-b55c-356cbe5dad5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29739a9103a34b668740a58b25371036', 'request_id': 'req-535bbada-cece-4683-b55c-356cbe5dad5e'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:32.827600 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1018/2035] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Jun 29 12:21:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:32.828283 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555738e-52ab-470f-811a-1bb36d027bfa None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:32.840896 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555738e-52ab-470f-811a-1bb36d027bfa None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:32.845618 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-535bbada-cece-4683-b55c-356cbe5dad5e admin admin] The token cache is being invalidate because project 29739a9103a34b668740a58b25371036 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:32.845910 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-535bbada-cece-4683-b55c-356cbe5dad5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:32.846669 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-535bbada-cece-4683-b55c-356cbe5dad5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:32.848459 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1018/2036] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:32 2022] DELETE /identity/v3/projects/29739a9103a34b668740a58b25371036 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:32.849884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535bbada-cece-4683-b55c-356cbe5dad5e admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:32.851717 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-535bbada-cece-4683-b55c-356cbe5dad5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:32.899754 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:32.911240 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ceae7-3622-478a-b399-1dbeafa2f584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:32.912703 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ceae7-3622-478a-b399-1dbeafa2f584 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:32.912986 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ceae7-3622-478a-b399-1dbeafa2f584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:32.913257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ceae7-3622-478a-b399-1dbeafa2f584 admin admin] PATH_INFO: `/v3/projects/fddfc408dda14c4fb991a4f5c45c368d/users/c4bc369a27b34d019a0a5294a9bbaf65/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:32.929598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ceae7-3622-478a-b399-1dbeafa2f584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fddfc408dda14c4fb991a4f5c45c368d, user_id=c4bc369a27b34d019a0a5294a9bbaf65, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:32.932380 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ceae7-3622-478a-b399-1dbeafa2f584 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:32.935353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535bbada-cece-4683-b55c-356cbe5dad5e admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:32.941266 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe00c8-126d-4e65-ad01-eb4f68abe4c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57c8b894e74c709ea389ed462184fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:32.941981 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe00c8-126d-4e65-ad01-eb4f68abe4c1 service placement] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:32.942282 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe00c8-126d-4e65-ad01-eb4f68abe4c1 service placement] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:32.942558 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe00c8-126d-4e65-ad01-eb4f68abe4c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:32.945033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-f3fe00c8-126d-4e65-ad01-eb4f68abe4c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:32.947368 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1019/2037] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:32 2022] PUT /identity/v3/projects/fddfc408dda14c4fb991a4f5c45c368d/users/c4bc369a27b34d019a0a5294a9bbaf65/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:32.948860 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6855e-1806-4a32-b611-7cfe13f98a8e None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:32.949210 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6855e-1806-4a32-b611-7cfe13f98a8e None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:32.949554 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6855e-1806-4a32-b611-7cfe13f98a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:32.959311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe00c8-126d-4e65-ad01-eb4f68abe4c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:32.960960 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe00c8-126d-4e65-ad01-eb4f68abe4c1 service placement] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:32.969710 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-66d6855e-1806-4a32-b611-7cfe13f98a8e None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:32.971339 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-66d6855e-1806-4a32-b611-7cfe13f98a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:32.972169 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1019/2038] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:32.972766 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe00c8-126d-4e65-ad01-eb4f68abe4c1 service placement] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:32.974133 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-f3fe00c8-126d-4e65-ad01-eb4f68abe4c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:32.988564 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe00c8-126d-4e65-ad01-eb4f68abe4c1 service placement] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:33.055144 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1020/2039] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:33.063778 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a3ee1-92bd-4171-b358-62cbd6b344d6 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:33.064469 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a3ee1-92bd-4171-b358-62cbd6b344d6 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:33.065300 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a3ee1-92bd-4171-b358-62cbd6b344d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:33.072246 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7db01-38e9-4b1b-ad2b-fba4db64a82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:33.072999 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7db01-38e9-4b1b-ad2b-fba4db64a82f admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:33.073344 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7db01-38e9-4b1b-ad2b-fba4db64a82f admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:33.073689 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7db01-38e9-4b1b-ad2b-fba4db64a82f admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:33.074772 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7db01-38e9-4b1b-ad2b-fba4db64a82f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:33.077352 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7db01-38e9-4b1b-ad2b-fba4db64a82f admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:33.090443 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1020/2040] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:33.091565 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-a98a3ee1-92bd-4171-b358-62cbd6b344d6 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:33.092781 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-a98a3ee1-92bd-4171-b358-62cbd6b344d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:33.095200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7db01-38e9-4b1b-ad2b-fba4db64a82f admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:33.101728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1021/2041] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:33.105934 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a3ee1-92bd-4171-b358-62cbd6b344d6 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:33.107110 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7db01-38e9-4b1b-ad2b-fba4db64a82f admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:33.112794 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80fc6c-8675-4e0b-9524-071d36f7ea52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:33.114089 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80fc6c-8675-4e0b-9524-071d36f7ea52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:33.114522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80fc6c-8675-4e0b-9524-071d36f7ea52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:33.115047 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80fc6c-8675-4e0b-9524-071d36f7ea52 admin admin] PATH_INFO: `/v3/projects/fddfc408dda14c4fb991a4f5c45c368d/users/c4bc369a27b34d019a0a5294a9bbaf65/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:33.115404 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a3ee1-92bd-4171-b358-62cbd6b344d6 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:33.117395 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d80fc6c-8675-4e0b-9524-071d36f7ea52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fddfc408dda14c4fb991a4f5c45c368d, user_id=c4bc369a27b34d019a0a5294a9bbaf65, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:33.120060 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b0f64-6ff0-43e7-a1f0-a1f0650f5e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:33.120715 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b0f64-6ff0-43e7-a1f0-a1f0650f5e8b admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:33.120897 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d80fc6c-8675-4e0b-9524-071d36f7ea52 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:33.121003 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b0f64-6ff0-43e7-a1f0-a1f0650f5e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:33.121265 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b0f64-6ff0-43e7-a1f0-a1f0650f5e8b admin admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:33.121988 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b0f64-6ff0-43e7-a1f0-a1f0650f5e8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:21:33.122294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b0f64-6ff0-43e7-a1f0-a1f0650f5e8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:33.123931 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b0f64-6ff0-43e7-a1f0-a1f0650f5e8b admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:33.134181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1021/2042] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:33 2022] PUT /identity/v3/projects/fddfc408dda14c4fb991a4f5c45c368d/users/c4bc369a27b34d019a0a5294a9bbaf65/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:33.137076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1022/2043] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:21:33.143222 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80fc6c-8675-4e0b-9524-071d36f7ea52 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:33.145286 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da97cc-9b04-4c71-a59a-2658edbd7160 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:33.145853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da97cc-9b04-4c71-a59a-2658edbd7160 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:33.146084 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da97cc-9b04-4c71-a59a-2658edbd7160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:33.185692 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-50da97cc-9b04-4c71-a59a-2658edbd7160 None None] MFA Rules not processed for user `c4bc369a27b34d019a0a5294a9bbaf65`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:33.187242 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-50da97cc-9b04-4c71-a59a-2658edbd7160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:33.213082 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:33.222076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80fc6c-8675-4e0b-9524-071d36f7ea52 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:33.227222 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3b1b0-d5dd-4b89-b4e3-1e23a56475f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:33.227897 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3b1b0-d5dd-4b89-b4e3-1e23a56475f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:33.228185 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3b1b0-d5dd-4b89-b4e3-1e23a56475f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:33.228467 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3b1b0-d5dd-4b89-b4e3-1e23a56475f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:33.229170 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3b1b0-d5dd-4b89-b4e3-1e23a56475f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:33.231137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3b1b0-d5dd-4b89-b4e3-1e23a56475f1 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:33.262443 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1022/2044] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:33 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:21:33.263934 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3b1b0-d5dd-4b89-b4e3-1e23a56475f1 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:33.274815 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1023/2045] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:33 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:33.284707 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da97cc-9b04-4c71-a59a-2658edbd7160 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:33.286160 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-50da97cc-9b04-4c71-a59a-2658edbd7160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:33.317564 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:33.351929 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3b1b0-d5dd-4b89-b4e3-1e23a56475f1 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:33.361639 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a78e8f-fc2d-47f5-af09-4eb7bcccd93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:33.362406 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a78e8f-fc2d-47f5-af09-4eb7bcccd93c admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:33.362670 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a78e8f-fc2d-47f5-af09-4eb7bcccd93c admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:33.362979 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a78e8f-fc2d-47f5-af09-4eb7bcccd93c admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:33.363794 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a78e8f-fc2d-47f5-af09-4eb7bcccd93c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:33.366294 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a78e8f-fc2d-47f5-af09-4eb7bcccd93c admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:33.367521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da97cc-9b04-4c71-a59a-2658edbd7160 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:33.388399 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1023/2046] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:33 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:21:33.389308 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a78e8f-fc2d-47f5-af09-4eb7bcccd93c admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:33.391218 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-55a78e8f-fc2d-47f5-af09-4eb7bcccd93c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:33.403732 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a78e8f-fc2d-47f5-af09-4eb7bcccd93c admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:33.409295 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec8bed4-b96b-477c-aebf-df1c13d2fa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:33.410287 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8bed4-b96b-477c-aebf-df1c13d2fa42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:33.410684 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8bed4-b96b-477c-aebf-df1c13d2fa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:33.411025 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8bed4-b96b-477c-aebf-df1c13d2fa42 admin admin] PATH_INFO: `/v3/users/72f28b848687488698db23b7a1253a37` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:33.412349 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec8bed4-b96b-477c-aebf-df1c13d2fa42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72f28b848687488698db23b7a1253a37)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:33.414833 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec8bed4-b96b-477c-aebf-df1c13d2fa42 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:33.426213 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32291bf0-b2fe-4020-be8e-c2fa5c42eec4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:33.427198 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32291bf0-b2fe-4020-be8e-c2fa5c42eec4 service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:33.428062 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32291bf0-b2fe-4020-be8e-c2fa5c42eec4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:33.428261 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32291bf0-b2fe-4020-be8e-c2fa5c42eec4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:33.474746 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-5ec8bed4-b96b-477c-aebf-df1c13d2fa42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72f28b848687488698db23b7a1253a37'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:33.475429 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-5ec8bed4-b96b-477c-aebf-df1c13d2fa42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72f28b848687488698db23b7a1253a37'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:33.488638 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-5ec8bed4-b96b-477c-aebf-df1c13d2fa42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72f28b848687488698db23b7a1253a37'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:33.489349 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-5ec8bed4-b96b-477c-aebf-df1c13d2fa42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72f28b848687488698db23b7a1253a37'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:33.501807 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-5ec8bed4-b96b-477c-aebf-df1c13d2fa42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72f28b848687488698db23b7a1253a37'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:33.505063 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32291bf0-b2fe-4020-be8e-c2fa5c42eec4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:33.507195 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32291bf0-b2fe-4020-be8e-c2fa5c42eec4 service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:33.517468 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1024/2047] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:33 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:21:33.519241 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32291bf0-b2fe-4020-be8e-c2fa5c42eec4 service cinder] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:33.519779 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-32291bf0-b2fe-4020-be8e-c2fa5c42eec4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:33.531802 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1024/2048] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:33 2022] DELETE /identity/v3/users/72f28b848687488698db23b7a1253a37 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:33.532623 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec8bed4-b96b-477c-aebf-df1c13d2fa42 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:33.536434 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32291bf0-b2fe-4020-be8e-c2fa5c42eec4 service cinder] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:33.540537 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-5ec8bed4-b96b-477c-aebf-df1c13d2fa42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:33.569025 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:33.614472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd4354-9361-4e18-b9bb-6baea27a12a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:33.616119 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd4354-9361-4e18-b9bb-6baea27a12a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:33.616493 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd4354-9361-4e18-b9bb-6baea27a12a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:33.616839 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd4354-9361-4e18-b9bb-6baea27a12a5 admin admin] PATH_INFO: `/v3/users/a7779dbc37a3403a96e07173281b8853` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:33.618925 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd4354-9361-4e18-b9bb-6baea27a12a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7779dbc37a3403a96e07173281b8853)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:33.621877 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd4354-9361-4e18-b9bb-6baea27a12a5 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:33.674826 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec8bed4-b96b-477c-aebf-df1c13d2fa42 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:33.688700 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffd94c-f85a-4658-8691-88615c0e7ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:33.689683 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffd94c-f85a-4658-8691-88615c0e7ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:33.690046 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffd94c-f85a-4658-8691-88615c0e7ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:33.690860 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffd94c-f85a-4658-8691-88615c0e7ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:33.692047 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffd94c-f85a-4658-8691-88615c0e7ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:33.694991 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffd94c-f85a-4658-8691-88615c0e7ee9 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:33.696663 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-90cd4354-9361-4e18-b9bb-6baea27a12a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7779dbc37a3403a96e07173281b8853'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:33.698534 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-90cd4354-9361-4e18-b9bb-6baea27a12a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7779dbc37a3403a96e07173281b8853'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:33.707194 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1025/2049] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:33.711411 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffd94c-f85a-4658-8691-88615c0e7ee9 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:33.713263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-06ffd94c-f85a-4658-8691-88615c0e7ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:33.734066 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-90cd4354-9361-4e18-b9bb-6baea27a12a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7779dbc37a3403a96e07173281b8853'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:33.744812 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-90cd4354-9361-4e18-b9bb-6baea27a12a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7779dbc37a3403a96e07173281b8853'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:33.745547 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-90cd4354-9361-4e18-b9bb-6baea27a12a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7779dbc37a3403a96e07173281b8853'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:33.761929 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1025/2050] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:33 2022] DELETE /identity/v3/users/a7779dbc37a3403a96e07173281b8853 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:33.765671 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd4354-9361-4e18-b9bb-6baea27a12a5 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:33.767091 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-90cd4354-9361-4e18-b9bb-6baea27a12a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:33.769075 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:33.804865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffd94c-f85a-4658-8691-88615c0e7ee9 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:33.855861 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd4354-9361-4e18-b9bb-6baea27a12a5 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:33.861363 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3eabe7-45e5-4a4c-ad61-659bc3332cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:33.862040 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3eabe7-45e5-4a4c-ad61-659bc3332cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:33.862329 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3eabe7-45e5-4a4c-ad61-659bc3332cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:33.862612 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3eabe7-45e5-4a4c-ad61-659bc3332cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:33.863397 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3eabe7-45e5-4a4c-ad61-659bc3332cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:33.865597 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3eabe7-45e5-4a4c-ad61-659bc3332cb8 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:33.868357 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359e182-1bf4-4626-a1ba-5639ade67799 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:33.869186 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359e182-1bf4-4626-a1ba-5639ade67799 service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:33.869537 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359e182-1bf4-4626-a1ba-5639ade67799 service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:33.869893 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359e182-1bf4-4626-a1ba-5639ade67799 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:33.872084 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-6359e182-1bf4-4626-a1ba-5639ade67799 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:33.875778 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1026/2051] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:33.877267 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58057374-3f49-477b-8797-aa730cdd9835 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:33.877560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58057374-3f49-477b-8797-aa730cdd9835 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:33.877840 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58057374-3f49-477b-8797-aa730cdd9835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:33.895001 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-58057374-3f49-477b-8797-aa730cdd9835 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:33.896285 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-58057374-3f49-477b-8797-aa730cdd9835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:33.903924 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1027/2052] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:33.907554 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58057374-3f49-477b-8797-aa730cdd9835 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:33.907554 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-58057374-3f49-477b-8797-aa730cdd9835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:33.921223 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58057374-3f49-477b-8797-aa730cdd9835 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:33.925949 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566963e-b8be-4db5-b443-fde4b88242fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:33.926815 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566963e-b8be-4db5-b443-fde4b88242fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:33.927102 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566963e-b8be-4db5-b443-fde4b88242fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:33.928023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566963e-b8be-4db5-b443-fde4b88242fe admin admin] PATH_INFO: `/v3/projects/3ae915f7bf074af08401ff84769821e9` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:33.929210 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566963e-b8be-4db5-b443-fde4b88242fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ae915f7bf074af08401ff84769821e9)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:33.931178 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566963e-b8be-4db5-b443-fde4b88242fe admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:33.938509 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6359e182-1bf4-4626-a1ba-5639ade67799 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:33.940091 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6359e182-1bf4-4626-a1ba-5639ade67799 service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:33.949092 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1026/2053] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:33 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:33.949860 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359e182-1bf4-4626-a1ba-5639ade67799 service cinder] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:33.960209 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359e182-1bf4-4626-a1ba-5639ade67799 service cinder] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:33.965065 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075cf09-c8f4-4854-9e9b-92a00957c92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:33.965963 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075cf09-c8f4-4854-9e9b-92a00957c92b admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:33.966329 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075cf09-c8f4-4854-9e9b-92a00957c92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:33.966514 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075cf09-c8f4-4854-9e9b-92a00957c92b admin admin] PATH_INFO: `/v3/projects/a84633df41034a9481e96b5cb40f12e1/users/0ff04ad16b67452b9250f15e24d8c6cb/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:33.966994 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:33.986116 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075cf09-c8f4-4854-9e9b-92a00957c92b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a84633df41034a9481e96b5cb40f12e1, user_id=0ff04ad16b67452b9250f15e24d8c6cb, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:33.988999 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075cf09-c8f4-4854-9e9b-92a00957c92b admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:33.989493 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-c566963e-b8be-4db5-b443-fde4b88242fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ae915f7bf074af08401ff84769821e9', 'request_id': 'req-c566963e-b8be-4db5-b443-fde4b88242fe'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:33.999425 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-c566963e-b8be-4db5-b443-fde4b88242fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ae915f7bf074af08401ff84769821e9', 'request_id': 'req-c566963e-b8be-4db5-b443-fde4b88242fe'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:34.006287 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1027/2054] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:33 2022] PUT /identity/v3/projects/a84633df41034a9481e96b5cb40f12e1/users/0ff04ad16b67452b9250f15e24d8c6cb/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:34.007140 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075cf09-c8f4-4854-9e9b-92a00957c92b admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:34.009209 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-3075cf09-c8f4-4854-9e9b-92a00957c92b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:34.016165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-c566963e-b8be-4db5-b443-fde4b88242fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ae915f7bf074af08401ff84769821e9', 'request_id': 'req-c566963e-b8be-4db5-b443-fde4b88242fe'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:34.031128 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-c566963e-b8be-4db5-b443-fde4b88242fe admin admin] The token cache is being invalidate because project 3ae915f7bf074af08401ff84769821e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:34.031472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-c566963e-b8be-4db5-b443-fde4b88242fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:34.032130 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-c566963e-b8be-4db5-b443-fde4b88242fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:34.037598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1028/2055] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:33 2022] DELETE /identity/v3/projects/3ae915f7bf074af08401ff84769821e9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:34.037598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d545e5-788c-43c3-8e23-573c15ce0f4a None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:34.037598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d545e5-788c-43c3-8e23-573c15ce0f4a None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:34.037598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d545e5-788c-43c3-8e23-573c15ce0f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:34.069978 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-31d545e5-788c-43c3-8e23-573c15ce0f4a None None] MFA Rules not processed for user `0ff04ad16b67452b9250f15e24d8c6cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:34.071213 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-31d545e5-788c-43c3-8e23-573c15ce0f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:34.086362 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075cf09-c8f4-4854-9e9b-92a00957c92b admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:34.092936 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb9f11-b3b5-41fc-8968-bfc9e844c295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:34.093730 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb9f11-b3b5-41fc-8968-bfc9e844c295 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:34.094066 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb9f11-b3b5-41fc-8968-bfc9e844c295 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:34.094450 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb9f11-b3b5-41fc-8968-bfc9e844c295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:34.096862 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-c8fb9f11-b3b5-41fc-8968-bfc9e844c295 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:34.141781 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:34.174535 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1029/2056] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:34.175549 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d545e5-788c-43c3-8e23-573c15ce0f4a None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:34.176843 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-31d545e5-788c-43c3-8e23-573c15ce0f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:34.182099 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb9f11-b3b5-41fc-8968-bfc9e844c295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:34.183915 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb9f11-b3b5-41fc-8968-bfc9e844c295 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:34.191381 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d545e5-788c-43c3-8e23-573c15ce0f4a None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:34.193778 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1028/2057] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:34.194403 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb9f11-b3b5-41fc-8968-bfc9e844c295 service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:34.195898 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-c8fb9f11-b3b5-41fc-8968-bfc9e844c295 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:34.196885 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba1eab-a992-41a9-b380-c6d74d1f17fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:34.197855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba1eab-a992-41a9-b380-c6d74d1f17fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:34.198527 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba1eab-a992-41a9-b380-c6d74d1f17fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:34.199014 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba1eab-a992-41a9-b380-c6d74d1f17fe admin admin] PATH_INFO: `/v3/users/2af2cd17d5654cabbf7e042d3c6224b8` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:34.200522 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba1eab-a992-41a9-b380-c6d74d1f17fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=2af2cd17d5654cabbf7e042d3c6224b8)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:34.203230 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba1eab-a992-41a9-b380-c6d74d1f17fe admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:34.208328 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb9f11-b3b5-41fc-8968-bfc9e844c295 service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:34.214524 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d191b5-f2ec-4e5b-bf0b-048e826ed27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:34.215024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d191b5-f2ec-4e5b-bf0b-048e826ed27b admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:34.215503 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d191b5-f2ec-4e5b-bf0b-048e826ed27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:34.216123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d191b5-f2ec-4e5b-bf0b-048e826ed27b admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:34.216989 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d191b5-f2ec-4e5b-bf0b-048e826ed27b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:34.219205 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d191b5-f2ec-4e5b-bf0b-048e826ed27b admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:34.257367 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1029/2058] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:34 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:34.261571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d191b5-f2ec-4e5b-bf0b-048e826ed27b admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:34.274215 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-4fba1eab-a992-41a9-b380-c6d74d1f17fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2af2cd17d5654cabbf7e042d3c6224b8'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:34.275175 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-4fba1eab-a992-41a9-b380-c6d74d1f17fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2af2cd17d5654cabbf7e042d3c6224b8'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:34.295626 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-4fba1eab-a992-41a9-b380-c6d74d1f17fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2af2cd17d5654cabbf7e042d3c6224b8'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:34.304676 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-4fba1eab-a992-41a9-b380-c6d74d1f17fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2af2cd17d5654cabbf7e042d3c6224b8'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:34.311348 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-4fba1eab-a992-41a9-b380-c6d74d1f17fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2af2cd17d5654cabbf7e042d3c6224b8'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:34.336433 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d191b5-f2ec-4e5b-bf0b-048e826ed27b admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:34.340592 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1030/2059] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:34 2022] DELETE /identity/v3/users/2af2cd17d5654cabbf7e042d3c6224b8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:34.345506 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93df8bf-e10f-46e6-b2ce-d13e9ba600af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:34.346215 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93df8bf-e10f-46e6-b2ce-d13e9ba600af admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:34.346503 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93df8bf-e10f-46e6-b2ce-d13e9ba600af admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:34.346833 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93df8bf-e10f-46e6-b2ce-d13e9ba600af admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:34.347547 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93df8bf-e10f-46e6-b2ce-d13e9ba600af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:34.350181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93df8bf-e10f-46e6-b2ce-d13e9ba600af admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:34.380072 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1030/2060] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:34 2022] POST /identity/v3/users => generated 294 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:34.383592 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba1eab-a992-41a9-b380-c6d74d1f17fe admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:34.385101 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-4fba1eab-a992-41a9-b380-c6d74d1f17fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:34.415980 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:34.467069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba1eab-a992-41a9-b380-c6d74d1f17fe admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:34.472266 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433de0b-8310-4a7e-9b86-7d1085b3c96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:34.472958 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433de0b-8310-4a7e-9b86-7d1085b3c96d admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:34.473242 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433de0b-8310-4a7e-9b86-7d1085b3c96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:34.473621 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433de0b-8310-4a7e-9b86-7d1085b3c96d admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:34.474862 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2433de0b-8310-4a7e-9b86-7d1085b3c96d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:34.476494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2433de0b-8310-4a7e-9b86-7d1085b3c96d admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:34.490820 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1031/2061] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:34.492368 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93df8bf-e10f-46e6-b2ce-d13e9ba600af admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:34.503145 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93df8bf-e10f-46e6-b2ce-d13e9ba600af admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:34.509104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76593aee-f216-4d03-a889-17fbe963962b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:34.510616 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76593aee-f216-4d03-a889-17fbe963962b admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:34.510773 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76593aee-f216-4d03-a889-17fbe963962b admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:34.511136 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76593aee-f216-4d03-a889-17fbe963962b admin admin] PATH_INFO: `/v3/projects/009b04aed2c841a0b94decacc07acf83/users/63cb68fded03459ebe31bfa53819a626/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:34.531499 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76593aee-f216-4d03-a889-17fbe963962b admin admin] RBAC: Authorizing `identity:create_grant(project_id=009b04aed2c841a0b94decacc07acf83, user_id=63cb68fded03459ebe31bfa53819a626, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:34.534310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76593aee-f216-4d03-a889-17fbe963962b admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:34.551214 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1031/2062] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:34 2022] PUT /identity/v3/projects/009b04aed2c841a0b94decacc07acf83/users/63cb68fded03459ebe31bfa53819a626/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:34.555890 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433de0b-8310-4a7e-9b86-7d1085b3c96d admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:34.567355 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433de0b-8310-4a7e-9b86-7d1085b3c96d admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:34.570270 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76593aee-f216-4d03-a889-17fbe963962b admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:34.571999 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-76593aee-f216-4d03-a889-17fbe963962b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:34.638708 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1524d1-dc6e-41e7-b44a-27e1d87a2acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:34.639659 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1524d1-dc6e-41e7-b44a-27e1d87a2acb admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:34.640057 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1524d1-dc6e-41e7-b44a-27e1d87a2acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:34.640469 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1524d1-dc6e-41e7-b44a-27e1d87a2acb admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:34.641304 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1524d1-dc6e-41e7-b44a-27e1d87a2acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:34.643062 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1524d1-dc6e-41e7-b44a-27e1d87a2acb admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:34.658681 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1032/2063] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:34.661421 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1524d1-dc6e-41e7-b44a-27e1d87a2acb admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:34.672129 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1524d1-dc6e-41e7-b44a-27e1d87a2acb admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:34.677271 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3f2f5-51e4-4d30-b7d9-5e5c090d1b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:34.677976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3f2f5-51e4-4d30-b7d9-5e5c090d1b09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:34.678266 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3f2f5-51e4-4d30-b7d9-5e5c090d1b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:34.678548 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3f2f5-51e4-4d30-b7d9-5e5c090d1b09 admin admin] PATH_INFO: `/v3/projects/009b04aed2c841a0b94decacc07acf83/users/63cb68fded03459ebe31bfa53819a626/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:34.680611 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b3f2f5-51e4-4d30-b7d9-5e5c090d1b09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=009b04aed2c841a0b94decacc07acf83, user_id=63cb68fded03459ebe31bfa53819a626, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:34.683438 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b3f2f5-51e4-4d30-b7d9-5e5c090d1b09 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:34.690112 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76593aee-f216-4d03-a889-17fbe963962b admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:34.695724 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1033/2064] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:34 2022] PUT /identity/v3/projects/009b04aed2c841a0b94decacc07acf83/users/63cb68fded03459ebe31bfa53819a626/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:34.707204 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5c4bf-2773-43c5-ae70-ab2bd7f9670f None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:34.707487 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5c4bf-2773-43c5-ae70-ab2bd7f9670f None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:34.707763 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5c4bf-2773-43c5-ae70-ab2bd7f9670f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:34.714341 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:34.740269 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-0de5c4bf-2773-43c5-ae70-ab2bd7f9670f None None] MFA Rules not processed for user `63cb68fded03459ebe31bfa53819a626`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:34.741595 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-0de5c4bf-2773-43c5-ae70-ab2bd7f9670f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:34.790605 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85ef03-6078-4169-a495-95ac9f1fdd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:34.791525 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85ef03-6078-4169-a495-95ac9f1fdd36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:34.791802 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85ef03-6078-4169-a495-95ac9f1fdd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:34.792071 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85ef03-6078-4169-a495-95ac9f1fdd36 admin admin] PATH_INFO: `/v3/projects/22291033461d41a5a68f5f013a879e2c` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:34.793286 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85ef03-6078-4169-a495-95ac9f1fdd36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22291033461d41a5a68f5f013a879e2c)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:34.795278 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85ef03-6078-4169-a495-95ac9f1fdd36 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:34.826810 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1034/2065] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:34.827630 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5c4bf-2773-43c5-ae70-ab2bd7f9670f None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:34.828956 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-0de5c4bf-2773-43c5-ae70-ab2bd7f9670f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:34.844483 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5c4bf-2773-43c5-ae70-ab2bd7f9670f None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:34.847328 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-7d85ef03-6078-4169-a495-95ac9f1fdd36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22291033461d41a5a68f5f013a879e2c', 'request_id': 'req-7d85ef03-6078-4169-a495-95ac9f1fdd36'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:34.856874 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-7d85ef03-6078-4169-a495-95ac9f1fdd36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22291033461d41a5a68f5f013a879e2c', 'request_id': 'req-7d85ef03-6078-4169-a495-95ac9f1fdd36'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:34.863458 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-7d85ef03-6078-4169-a495-95ac9f1fdd36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22291033461d41a5a68f5f013a879e2c', 'request_id': 'req-7d85ef03-6078-4169-a495-95ac9f1fdd36'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:34.869375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:34.874512 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-7d85ef03-6078-4169-a495-95ac9f1fdd36 admin admin] The token cache is being invalidate because project 22291033461d41a5a68f5f013a879e2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:34.874976 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-7d85ef03-6078-4169-a495-95ac9f1fdd36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:34.875672 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-7d85ef03-6078-4169-a495-95ac9f1fdd36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:34.877272 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1032/2066] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:34 2022] DELETE /identity/v3/projects/22291033461d41a5a68f5f013a879e2c => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:21:34.878060 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85ef03-6078-4169-a495-95ac9f1fdd36 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:34.879504 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-7d85ef03-6078-4169-a495-95ac9f1fdd36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:34.912829 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f3414-86cc-4090-a343-1afc310d2f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:34.913690 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f3414-86cc-4090-a343-1afc310d2f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:34.913970 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f3414-86cc-4090-a343-1afc310d2f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:34.914243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f3414-86cc-4090-a343-1afc310d2f9c admin admin] PATH_INFO: `/v3/projects/eeb89edd3fdc4f9c912c9e9188ec78ac` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:34.915436 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f3414-86cc-4090-a343-1afc310d2f9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeb89edd3fdc4f9c912c9e9188ec78ac)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:34.917692 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f3414-86cc-4090-a343-1afc310d2f9c admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:34.938710 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85ef03-6078-4169-a495-95ac9f1fdd36 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:34.942410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8913fe3-d8bd-414f-8016-1997975d9001 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:34.943137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8913fe3-d8bd-414f-8016-1997975d9001 service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:34.943416 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8913fe3-d8bd-414f-8016-1997975d9001 service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:34.943694 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8913fe3-d8bd-414f-8016-1997975d9001 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:34.945632 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-f8913fe3-d8bd-414f-8016-1997975d9001 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:34.964489 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-c35f3414-86cc-4090-a343-1afc310d2f9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeb89edd3fdc4f9c912c9e9188ec78ac', 'request_id': 'req-c35f3414-86cc-4090-a343-1afc310d2f9c'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:34.970715 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-c35f3414-86cc-4090-a343-1afc310d2f9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeb89edd3fdc4f9c912c9e9188ec78ac', 'request_id': 'req-c35f3414-86cc-4090-a343-1afc310d2f9c'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:34.977271 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-c35f3414-86cc-4090-a343-1afc310d2f9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeb89edd3fdc4f9c912c9e9188ec78ac', 'request_id': 'req-c35f3414-86cc-4090-a343-1afc310d2f9c'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:34.990255 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-c35f3414-86cc-4090-a343-1afc310d2f9c admin admin] The token cache is being invalidate because project eeb89edd3fdc4f9c912c9e9188ec78ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:34.990474 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-c35f3414-86cc-4090-a343-1afc310d2f9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:34.991156 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-c35f3414-86cc-4090-a343-1afc310d2f9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:34.993083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1035/2067] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:34 2022] DELETE /identity/v3/projects/eeb89edd3fdc4f9c912c9e9188ec78ac => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:34.994067 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e5c27-946d-4219-9d60-4eed4712d11a None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:34.994351 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e5c27-946d-4219-9d60-4eed4712d11a None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:34.994630 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e5c27-946d-4219-9d60-4eed4712d11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:35.007068 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8913fe3-d8bd-414f-8016-1997975d9001 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:35.008542 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8913fe3-d8bd-414f-8016-1997975d9001 service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:35.012069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-267e5c27-946d-4219-9d60-4eed4712d11a None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:35.013246 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-267e5c27-946d-4219-9d60-4eed4712d11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:35.017526 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1033/2068] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:35.018808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdb8bf-1f03-4865-b56c-55d57d9b7cd2 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:35.019096 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdb8bf-1f03-4865-b56c-55d57d9b7cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:35.019375 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdb8bf-1f03-4865-b56c-55d57d9b7cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:35.026877 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:35.039561 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-67bdb8bf-1f03-4865-b56c-55d57d9b7cd2 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:35.041170 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-67bdb8bf-1f03-4865-b56c-55d57d9b7cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:35.092685 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1036/2069] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:35.094909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8df147-5b66-43e5-8d5e-702061921b02 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:35.095401 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8df147-5b66-43e5-8d5e-702061921b02 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:35.095855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8df147-5b66-43e5-8d5e-702061921b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:35.108232 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1034/2070] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:35.115989 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6762e8-62e6-4c00-95e2-ee4a1904d0c9 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:35.116284 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6762e8-62e6-4c00-95e2-ee4a1904d0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:35.116567 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6762e8-62e6-4c00-95e2-ee4a1904d0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:35.116883 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-dc8df147-5b66-43e5-8d5e-702061921b02 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:35.118101 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-dc8df147-5b66-43e5-8d5e-702061921b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:35.126797 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1037/2071] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:21:35.130987 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8df147-5b66-43e5-8d5e-702061921b02 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:35.136275 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-ef6762e8-62e6-4c00-95e2-ee4a1904d0c9 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:35.137570 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-ef6762e8-62e6-4c00-95e2-ee4a1904d0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:35.140820 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8df147-5b66-43e5-8d5e-702061921b02 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:35.145783 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036125d-11af-4160-a8f7-15beac15d1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:35.147030 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036125d-11af-4160-a8f7-15beac15d1ea admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:35.147311 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036125d-11af-4160-a8f7-15beac15d1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:35.147591 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036125d-11af-4160-a8f7-15beac15d1ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:35.148353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9036125d-11af-4160-a8f7-15beac15d1ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:21:35.148746 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9036125d-11af-4160-a8f7-15beac15d1ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:35.150516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9036125d-11af-4160-a8f7-15beac15d1ea admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:35.161436 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1035/2072] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:21:35.164319 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6762e8-62e6-4c00-95e2-ee4a1904d0c9 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:35.165764 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1038/2073] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:21:35.170111 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036125d-11af-4160-a8f7-15beac15d1ea admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:35.179292 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6762e8-62e6-4c00-95e2-ee4a1904d0c9 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:35.180539 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036125d-11af-4160-a8f7-15beac15d1ea admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:35.185822 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed726ca-033b-43b9-8519-d76e3645a9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:35.186079 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b6ec2-76b3-41d2-ad1f-8ddb3395ec9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:35.186543 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed726ca-033b-43b9-8519-d76e3645a9cc admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:35.186874 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed726ca-033b-43b9-8519-d76e3645a9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:35.187150 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed726ca-033b-43b9-8519-d76e3645a9cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:35.187659 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b6ec2-76b3-41d2-ad1f-8ddb3395ec9a admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:35.187953 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b6ec2-76b3-41d2-ad1f-8ddb3395ec9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:35.188229 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b6ec2-76b3-41d2-ad1f-8ddb3395ec9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:35.188838 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed726ca-033b-43b9-8519-d76e3645a9cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:35.189608 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b6ec2-76b3-41d2-ad1f-8ddb3395ec9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:21:35.189920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b6ec2-76b3-41d2-ad1f-8ddb3395ec9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:35.190776 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed726ca-033b-43b9-8519-d76e3645a9cc admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:35.192390 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b6ec2-76b3-41d2-ad1f-8ddb3395ec9a admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:35.212133 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1036/2074] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:21:35.213677 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b6ec2-76b3-41d2-ad1f-8ddb3395ec9a admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:35.227832 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1039/2075] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:35 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:35.232315 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed726ca-033b-43b9-8519-d76e3645a9cc admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:35.234865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b6ec2-76b3-41d2-ad1f-8ddb3395ec9a admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:35.247707 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:35.308545 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef97308-b26b-4e6c-86d1-0fa623924846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:35.309234 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef97308-b26b-4e6c-86d1-0fa623924846 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:35.309513 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef97308-b26b-4e6c-86d1-0fa623924846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:35.309792 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef97308-b26b-4e6c-86d1-0fa623924846 admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:35.310493 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef97308-b26b-4e6c-86d1-0fa623924846 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:35.312511 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef97308-b26b-4e6c-86d1-0fa623924846 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:35.336214 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed726ca-033b-43b9-8519-d76e3645a9cc admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:35.341337 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311207b6-c785-4412-8973-a687a29c64af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:35.342154 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311207b6-c785-4412-8973-a687a29c64af admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:35.343212 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311207b6-c785-4412-8973-a687a29c64af admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:35.343212 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311207b6-c785-4412-8973-a687a29c64af admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:35.344062 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311207b6-c785-4412-8973-a687a29c64af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:35.346436 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311207b6-c785-4412-8973-a687a29c64af admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:35.374795 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1040/2076] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:35 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:21:35.376886 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311207b6-c785-4412-8973-a687a29c64af admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:35.384432 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1037/2077] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:35 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:35.388312 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311207b6-c785-4412-8973-a687a29c64af admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:35.389527 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef97308-b26b-4e6c-86d1-0fa623924846 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:35.462341 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef97308-b26b-4e6c-86d1-0fa623924846 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:35.463640 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58497f1e-cc15-43ee-b1cb-6e2ebf100d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:35.464324 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58497f1e-cc15-43ee-b1cb-6e2ebf100d40 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:35.464611 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58497f1e-cc15-43ee-b1cb-6e2ebf100d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:35.464894 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58497f1e-cc15-43ee-b1cb-6e2ebf100d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:35.465628 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58497f1e-cc15-43ee-b1cb-6e2ebf100d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:35.467135 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f481f56-bf91-463c-a868-04f80bc41764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:35.467297 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58497f1e-cc15-43ee-b1cb-6e2ebf100d40 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:35.467804 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f481f56-bf91-463c-a868-04f80bc41764 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:35.468266 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f481f56-bf91-463c-a868-04f80bc41764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:35.468594 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f481f56-bf91-463c-a868-04f80bc41764 admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:35.469580 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f481f56-bf91-463c-a868-04f80bc41764 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:35.471240 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f481f56-bf91-463c-a868-04f80bc41764 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:35.477649 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1041/2078] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:21:35.481435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58497f1e-cc15-43ee-b1cb-6e2ebf100d40 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:35.490479 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:35.491973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58497f1e-cc15-43ee-b1cb-6e2ebf100d40 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:35.496791 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1038/2079] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:35 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:21:35.500034 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2cf9e-e18c-46c0-9854-13c93858172e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:35.500427 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f481f56-bf91-463c-a868-04f80bc41764 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:35.500719 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2cf9e-e18c-46c0-9854-13c93858172e admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:35.501007 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2cf9e-e18c-46c0-9854-13c93858172e admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:35.501282 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2cf9e-e18c-46c0-9854-13c93858172e admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:35.502005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2cf9e-e18c-46c0-9854-13c93858172e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:35.503636 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2cf9e-e18c-46c0-9854-13c93858172e admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:35.511068 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f481f56-bf91-463c-a868-04f80bc41764 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:35.514683 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1042/2080] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:21:35.515865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da6181-3f8f-4cbf-9b56-6d7f38b08ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:35.516510 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da6181-3f8f-4cbf-9b56-6d7f38b08ffe admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:35.516830 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da6181-3f8f-4cbf-9b56-6d7f38b08ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:35.517110 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da6181-3f8f-4cbf-9b56-6d7f38b08ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:35.517835 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da6181-3f8f-4cbf-9b56-6d7f38b08ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:35.518881 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2cf9e-e18c-46c0-9854-13c93858172e admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:35.519623 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da6181-3f8f-4cbf-9b56-6d7f38b08ffe admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:35.530449 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2cf9e-e18c-46c0-9854-13c93858172e admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:35.533712 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1039/2081] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:21:35.534720 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da6181-3f8f-4cbf-9b56-6d7f38b08ffe admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:35.535506 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea3e37-fcfc-4c76-b6e7-59bdb7cb6bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:35.536380 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea3e37-fcfc-4c76-b6e7-59bdb7cb6bbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:35.536713 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea3e37-fcfc-4c76-b6e7-59bdb7cb6bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:35.536992 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea3e37-fcfc-4c76-b6e7-59bdb7cb6bbc admin admin] PATH_INFO: `/v3/projects/6241a55d58ce422c94273bd4d76d72c8/users/dd0bd33e40734ae4b85433aeb718befd/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:35.544282 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da6181-3f8f-4cbf-9b56-6d7f38b08ffe admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:35.548855 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a886ff8-dcb8-421c-847f-6cbff338f18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:35.549499 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a886ff8-dcb8-421c-847f-6cbff338f18c admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:35.549777 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a886ff8-dcb8-421c-847f-6cbff338f18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:35.550052 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a886ff8-dcb8-421c-847f-6cbff338f18c admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:35.550798 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a886ff8-dcb8-421c-847f-6cbff338f18c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:35.552127 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea3e37-fcfc-4c76-b6e7-59bdb7cb6bbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6241a55d58ce422c94273bd4d76d72c8, user_id=dd0bd33e40734ae4b85433aeb718befd, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:35.552411 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a886ff8-dcb8-421c-847f-6cbff338f18c admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:35.554969 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea3e37-fcfc-4c76-b6e7-59bdb7cb6bbc admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:35.565068 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1040/2082] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:21:35.568626 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1043/2083] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:35 2022] PUT /identity/v3/projects/6241a55d58ce422c94273bd4d76d72c8/users/dd0bd33e40734ae4b85433aeb718befd/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:35.571847 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a886ff8-dcb8-421c-847f-6cbff338f18c admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:35.579269 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dfa0d-0156-4107-9ab5-21cc7d7d063d None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:35.579615 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dfa0d-0156-4107-9ab5-21cc7d7d063d None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:35.579892 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dfa0d-0156-4107-9ab5-21cc7d7d063d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:35.581845 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a886ff8-dcb8-421c-847f-6cbff338f18c admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:35.607431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-7e8dfa0d-0156-4107-9ab5-21cc7d7d063d None None] MFA Rules not processed for user `dd0bd33e40734ae4b85433aeb718befd`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:35.608626 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-7e8dfa0d-0156-4107-9ab5-21cc7d7d063d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:35.641989 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff945f-3ffb-4f40-92b3-3ccf8bdf3849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:35.642914 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff945f-3ffb-4f40-92b3-3ccf8bdf3849 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:35.643198 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff945f-3ffb-4f40-92b3-3ccf8bdf3849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:35.643475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff945f-3ffb-4f40-92b3-3ccf8bdf3849 admin admin] PATH_INFO: `/v3/projects/dfae2a64fc144aca94342516c06a562d/users/f156542c7b3a4eed9a41bb1a8c67cdde/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:35.658326 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ff945f-3ffb-4f40-92b3-3ccf8bdf3849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfae2a64fc144aca94342516c06a562d, user_id=f156542c7b3a4eed9a41bb1a8c67cdde, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:35.661147 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ff945f-3ffb-4f40-92b3-3ccf8bdf3849 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:35.664465 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:35.675074 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1041/2084] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:35 2022] PUT /identity/v3/projects/dfae2a64fc144aca94342516c06a562d/users/f156542c7b3a4eed9a41bb1a8c67cdde/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:21:35.675379 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1044/2085] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:21:35.683886 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f1e7f-5de6-46e4-a20c-ec443b095158 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:35.684175 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f1e7f-5de6-46e4-a20c-ec443b095158 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:35.684500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f1e7f-5de6-46e4-a20c-ec443b095158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:35.686551 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dfa0d-0156-4107-9ab5-21cc7d7d063d None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:35.687947 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-7e8dfa0d-0156-4107-9ab5-21cc7d7d063d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:35.702358 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-8e9f1e7f-5de6-46e4-a20c-ec443b095158 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:35.703579 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-8e9f1e7f-5de6-46e4-a20c-ec443b095158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:35.745832 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dfa0d-0156-4107-9ab5-21cc7d7d063d None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:35.772147 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1042/2086] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:21:35.782293 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f1e7f-5de6-46e4-a20c-ec443b095158 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:35.783953 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-8e9f1e7f-5de6-46e4-a20c-ec443b095158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:35.813604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60659e0-9ffc-4015-b1c5-57799fcd6a36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:35.814333 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60659e0-9ffc-4015-b1c5-57799fcd6a36 service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:35.814618 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60659e0-9ffc-4015-b1c5-57799fcd6a36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:35.815020 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60659e0-9ffc-4015-b1c5-57799fcd6a36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:35.850441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f1e7f-5de6-46e4-a20c-ec443b095158 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:35.854056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dcad3b-b3a3-4e6d-acd5-f436ebd12938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:35.854740 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcad3b-b3a3-4e6d-acd5-f436ebd12938 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:35.855022 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcad3b-b3a3-4e6d-acd5-f436ebd12938 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:35.855296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcad3b-b3a3-4e6d-acd5-f436ebd12938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:35.864362 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dcad3b-b3a3-4e6d-acd5-f436ebd12938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:35.865839 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dcad3b-b3a3-4e6d-acd5-f436ebd12938 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:35.872547 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60659e0-9ffc-4015-b1c5-57799fcd6a36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:35.873983 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60659e0-9ffc-4015-b1c5-57799fcd6a36 service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:35.875403 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1043/2087] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:21:35.883311 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1045/2088] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:21:36.534835 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44402e-c046-4386-bf5e-38ca0d6ac9c5 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:36.535399 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44402e-c046-4386-bf5e-38ca0d6ac9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:36.535399 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44402e-c046-4386-bf5e-38ca0d6ac9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:36.544105 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:36.564411 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-9d44402e-c046-4386-bf5e-38ca0d6ac9c5 None None] MFA Rules not processed for user `f156542c7b3a4eed9a41bb1a8c67cdde`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:36.565635 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-9d44402e-c046-4386-bf5e-38ca0d6ac9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:36.638276 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1044/2089] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:36.649496 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60659e0-9ffc-4015-b1c5-57799fcd6a36 service cinder] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:36.651140 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-b60659e0-9ffc-4015-b1c5-57799fcd6a36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:36.663115 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60659e0-9ffc-4015-b1c5-57799fcd6a36 service cinder] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:36.666729 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91dcd87-9df0-4e10-8f1c-8793f176387b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:36.667489 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dcd87-9df0-4e10-8f1c-8793f176387b service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:36.667778 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dcd87-9df0-4e10-8f1c-8793f176387b service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:36.668056 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dcd87-9df0-4e10-8f1c-8793f176387b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:36.676424 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91dcd87-9df0-4e10-8f1c-8793f176387b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:36.677938 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91dcd87-9df0-4e10-8f1c-8793f176387b service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:36.687621 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1046/2090] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:40.153549 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad20008-cf16-41d0-bf7a-692166b90fd7 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:40.154043 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad20008-cf16-41d0-bf7a-692166b90fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:40.154409 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad20008-cf16-41d0-bf7a-692166b90fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:40.172386 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-7ad20008-cf16-41d0-bf7a-692166b90fd7 None None] MFA Rules not processed for user `f156542c7b3a4eed9a41bb1a8c67cdde`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:40.173577 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-7ad20008-cf16-41d0-bf7a-692166b90fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:40.180465 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1045/2091] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:46.682986 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=77 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:50.167166 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=33 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:52.136788 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91dcd87-9df0-4e10-8f1c-8793f176387b service cinder] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:52.145678 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91dcd87-9df0-4e10-8f1c-8793f176387b service cinder] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:52.150063 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b348621-ad29-43e2-8221-915eb7c5b546 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:52.150741 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b348621-ad29-43e2-8221-915eb7c5b546 service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:52.151027 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b348621-ad29-43e2-8221-915eb7c5b546 service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:52.151305 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b348621-ad29-43e2-8221-915eb7c5b546 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:52.153154 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-9b348621-ad29-43e2-8221-915eb7c5b546 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:52.219721 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b348621-ad29-43e2-8221-915eb7c5b546 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:52.221221 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b348621-ad29-43e2-8221-915eb7c5b546 service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:52.231493 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1047/2092] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:52 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:52.423325 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad20008-cf16-41d0-bf7a-692166b90fd7 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:52.424773 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-7ad20008-cf16-41d0-bf7a-692166b90fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:52.441035 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad20008-cf16-41d0-bf7a-692166b90fd7 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:52.447749 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ea576-d7ba-4292-ad08-e027131af23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:52.449001 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ea576-d7ba-4292-ad08-e027131af23d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:52.449473 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ea576-d7ba-4292-ad08-e027131af23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:52.449820 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ea576-d7ba-4292-ad08-e027131af23d admin admin] PATH_INFO: `/v3/users/962ee2a86b184374bccc45831596a1d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:52.451365 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ea576-d7ba-4292-ad08-e027131af23d admin admin] RBAC: Authorizing `identity:delete_user(user_id=962ee2a86b184374bccc45831596a1d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:52.454155 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ea576-d7ba-4292-ad08-e027131af23d admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:52.530835 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b66ea576-d7ba-4292-ad08-e027131af23d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '962ee2a86b184374bccc45831596a1d7'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:52.531506 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b66ea576-d7ba-4292-ad08-e027131af23d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '962ee2a86b184374bccc45831596a1d7'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:52.548552 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b66ea576-d7ba-4292-ad08-e027131af23d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '962ee2a86b184374bccc45831596a1d7'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:52.549250 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b66ea576-d7ba-4292-ad08-e027131af23d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '962ee2a86b184374bccc45831596a1d7'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:52.558457 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b66ea576-d7ba-4292-ad08-e027131af23d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '962ee2a86b184374bccc45831596a1d7'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:52.580546 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1046/2093] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:52 2022] DELETE /identity/v3/users/962ee2a86b184374bccc45831596a1d7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:52.586751 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e02ba0-ccd1-4cca-841d-155526f3d806 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:52.587262 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e02ba0-ccd1-4cca-841d-155526f3d806 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:52.587539 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e02ba0-ccd1-4cca-841d-155526f3d806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:52.613420 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-f4e02ba0-ccd1-4cca-841d-155526f3d806 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:52.615439 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-f4e02ba0-ccd1-4cca-841d-155526f3d806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:52.674872 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1048/2094] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:52.684959 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ea576-d7ba-4292-ad08-e027131af23d admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:52.686378 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-b66ea576-d7ba-4292-ad08-e027131af23d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:52.752073 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ea576-d7ba-4292-ad08-e027131af23d admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:52.755767 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca8b981-d5ca-412f-969b-1e380c8a326a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:52.756414 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8b981-d5ca-412f-969b-1e380c8a326a service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:52.756697 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8b981-d5ca-412f-969b-1e380c8a326a service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:52.756970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8b981-d5ca-412f-969b-1e380c8a326a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:52.766096 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca8b981-d5ca-412f-969b-1e380c8a326a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:52.767594 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca8b981-d5ca-412f-969b-1e380c8a326a service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:52.777126 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1047/2095] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:53.153467 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e02ba0-ccd1-4cca-841d-155526f3d806 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:53.155253 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-f4e02ba0-ccd1-4cca-841d-155526f3d806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:53.167675 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e02ba0-ccd1-4cca-841d-155526f3d806 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:53.172414 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c6659-3d9c-412d-ad72-8bc8ce29fec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:53.173283 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c6659-3d9c-412d-ad72-8bc8ce29fec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:53.173568 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c6659-3d9c-412d-ad72-8bc8ce29fec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:53.173845 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c6659-3d9c-412d-ad72-8bc8ce29fec3 admin admin] PATH_INFO: `/v3/projects/148e3be280d143de9728099a7b7f9484` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:53.175413 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c6659-3d9c-412d-ad72-8bc8ce29fec3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=148e3be280d143de9728099a7b7f9484)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:53.177368 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c6659-3d9c-412d-ad72-8bc8ce29fec3 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:53.223692 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-da6c6659-3d9c-412d-ad72-8bc8ce29fec3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '148e3be280d143de9728099a7b7f9484', 'request_id': 'req-da6c6659-3d9c-412d-ad72-8bc8ce29fec3'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:53.229653 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-da6c6659-3d9c-412d-ad72-8bc8ce29fec3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '148e3be280d143de9728099a7b7f9484', 'request_id': 'req-da6c6659-3d9c-412d-ad72-8bc8ce29fec3'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:53.235068 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-da6c6659-3d9c-412d-ad72-8bc8ce29fec3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '148e3be280d143de9728099a7b7f9484', 'request_id': 'req-da6c6659-3d9c-412d-ad72-8bc8ce29fec3'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:53.247103 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-da6c6659-3d9c-412d-ad72-8bc8ce29fec3 admin admin] The token cache is being invalidate because project 148e3be280d143de9728099a7b7f9484 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:53.247406 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-da6c6659-3d9c-412d-ad72-8bc8ce29fec3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:53.248002 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-da6c6659-3d9c-412d-ad72-8bc8ce29fec3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:53.249532 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1049/2096] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:53 2022] DELETE /identity/v3/projects/148e3be280d143de9728099a7b7f9484 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:53.253779 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca8b981-d5ca-412f-969b-1e380c8a326a service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:53.263836 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca8b981-d5ca-412f-969b-1e380c8a326a service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:53.320848 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ba51c-a79d-4f74-a75f-c797ebc5259c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:53.321724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ba51c-a79d-4f74-a75f-c797ebc5259c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:53.322005 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ba51c-a79d-4f74-a75f-c797ebc5259c admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:53.322277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ba51c-a79d-4f74-a75f-c797ebc5259c admin admin] PATH_INFO: `/v3/users/c4bc369a27b34d019a0a5294a9bbaf65` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:53.323506 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ba51c-a79d-4f74-a75f-c797ebc5259c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4bc369a27b34d019a0a5294a9bbaf65)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:53.325430 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ba51c-a79d-4f74-a75f-c797ebc5259c admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:53.341994 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:53.371482 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b49ba51c-a79d-4f74-a75f-c797ebc5259c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4bc369a27b34d019a0a5294a9bbaf65'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:53.372136 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b49ba51c-a79d-4f74-a75f-c797ebc5259c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4bc369a27b34d019a0a5294a9bbaf65'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:53.384560 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b49ba51c-a79d-4f74-a75f-c797ebc5259c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4bc369a27b34d019a0a5294a9bbaf65'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:53.385188 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b49ba51c-a79d-4f74-a75f-c797ebc5259c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4bc369a27b34d019a0a5294a9bbaf65'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:53.392161 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b49ba51c-a79d-4f74-a75f-c797ebc5259c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4bc369a27b34d019a0a5294a9bbaf65'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:53.404942 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1048/2097] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:53 2022] DELETE /identity/v3/users/c4bc369a27b34d019a0a5294a9bbaf65 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:53.585906 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c6659-3d9c-412d-ad72-8bc8ce29fec3 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:53.587350 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-da6c6659-3d9c-412d-ad72-8bc8ce29fec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:53.600680 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c6659-3d9c-412d-ad72-8bc8ce29fec3 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:53.615823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:53.670085 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ecea2a-fab9-4db6-9ffe-b96f6a99fba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:53.671000 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecea2a-fab9-4db6-9ffe-b96f6a99fba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:53.671289 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecea2a-fab9-4db6-9ffe-b96f6a99fba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:53.671569 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecea2a-fab9-4db6-9ffe-b96f6a99fba9 admin admin] PATH_INFO: `/v3/users/dd0bd33e40734ae4b85433aeb718befd` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:53.672775 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ecea2a-fab9-4db6-9ffe-b96f6a99fba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd0bd33e40734ae4b85433aeb718befd)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:53.674904 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ecea2a-fab9-4db6-9ffe-b96f6a99fba9 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:53.689851 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ba51c-a79d-4f74-a75f-c797ebc5259c admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:53.691343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-b49ba51c-a79d-4f74-a75f-c797ebc5259c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:53.710808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ba51c-a79d-4f74-a75f-c797ebc5259c admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:53.716664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e2da2-4bbc-4c3c-9310-f1e601ea16e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:53.718440 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e2da2-4bbc-4c3c-9310-f1e601ea16e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:53.719110 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e2da2-4bbc-4c3c-9310-f1e601ea16e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:53.719393 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e2da2-4bbc-4c3c-9310-f1e601ea16e8 admin admin] PATH_INFO: `/v3/projects/fddfc408dda14c4fb991a4f5c45c368d` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:53.720753 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e2da2-4bbc-4c3c-9310-f1e601ea16e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fddfc408dda14c4fb991a4f5c45c368d)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:53.723151 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e2da2-4bbc-4c3c-9310-f1e601ea16e8 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:53.742755 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-28ecea2a-fab9-4db6-9ffe-b96f6a99fba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd0bd33e40734ae4b85433aeb718befd'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:53.743423 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-28ecea2a-fab9-4db6-9ffe-b96f6a99fba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd0bd33e40734ae4b85433aeb718befd'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:53.759830 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-28ecea2a-fab9-4db6-9ffe-b96f6a99fba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd0bd33e40734ae4b85433aeb718befd'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:53.770007 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-28ecea2a-fab9-4db6-9ffe-b96f6a99fba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd0bd33e40734ae4b85433aeb718befd'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:53.771494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-28ecea2a-fab9-4db6-9ffe-b96f6a99fba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd0bd33e40734ae4b85433aeb718befd'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:53.784364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-946e2da2-4bbc-4c3c-9310-f1e601ea16e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fddfc408dda14c4fb991a4f5c45c368d', 'request_id': 'req-946e2da2-4bbc-4c3c-9310-f1e601ea16e8'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:53.793212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-946e2da2-4bbc-4c3c-9310-f1e601ea16e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fddfc408dda14c4fb991a4f5c45c368d', 'request_id': 'req-946e2da2-4bbc-4c3c-9310-f1e601ea16e8'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:53.794220 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1050/2098] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:53 2022] DELETE /identity/v3/users/dd0bd33e40734ae4b85433aeb718befd => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:53.798358 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc669c-f87a-4d9e-ba56-a3eca28406bf None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:53.798696 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc669c-f87a-4d9e-ba56-a3eca28406bf None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:53.798986 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc669c-f87a-4d9e-ba56-a3eca28406bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:53.800983 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-946e2da2-4bbc-4c3c-9310-f1e601ea16e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fddfc408dda14c4fb991a4f5c45c368d', 'request_id': 'req-946e2da2-4bbc-4c3c-9310-f1e601ea16e8'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:53.815177 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-946e2da2-4bbc-4c3c-9310-f1e601ea16e8 admin admin] The token cache is being invalidate because project fddfc408dda14c4fb991a4f5c45c368d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:53.815468 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-946e2da2-4bbc-4c3c-9310-f1e601ea16e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:53.816132 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-946e2da2-4bbc-4c3c-9310-f1e601ea16e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:53.817979 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1049/2099] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:53 2022] DELETE /identity/v3/projects/fddfc408dda14c4fb991a4f5c45c368d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:21:53.820686 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-9bbc669c-f87a-4d9e-ba56-a3eca28406bf None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:53.821994 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-9bbc669c-f87a-4d9e-ba56-a3eca28406bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:53.822529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bb1a9-36dd-4266-a6e9-657ab82c93dc None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:53.822948 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bb1a9-36dd-4266-a6e9-657ab82c93dc None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:53.823238 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bb1a9-36dd-4266-a6e9-657ab82c93dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:53.842623 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-246bb1a9-36dd-4266-a6e9-657ab82c93dc None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:53.843884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-246bb1a9-36dd-4266-a6e9-657ab82c93dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:53.896828 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1051/2100] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:53.907910 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc669c-f87a-4d9e-ba56-a3eca28406bf None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:53.909647 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-9bbc669c-f87a-4d9e-ba56-a3eca28406bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:53.914808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1050/2101] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:21:53.922294 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463d5a8-36be-4f45-a965-a3d6f764dfc8 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:53.922679 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463d5a8-36be-4f45-a965-a3d6f764dfc8 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:53.923024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463d5a8-36be-4f45-a965-a3d6f764dfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:53.946371 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-1463d5a8-36be-4f45-a965-a3d6f764dfc8 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:53.947615 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-1463d5a8-36be-4f45-a965-a3d6f764dfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:53.956124 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1051/2102] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:53.960425 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463d5a8-36be-4f45-a965-a3d6f764dfc8 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:53.961042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:53.970967 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463d5a8-36be-4f45-a965-a3d6f764dfc8 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:53.977219 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd3dd4-2a3a-45cb-892f-01e3131215d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:53.977761 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd3dd4-2a3a-45cb-892f-01e3131215d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:53.978046 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd3dd4-2a3a-45cb-892f-01e3131215d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:53.978397 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd3dd4-2a3a-45cb-892f-01e3131215d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:53.979122 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd3dd4-2a3a-45cb-892f-01e3131215d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:21:53.979434 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd3dd4-2a3a-45cb-892f-01e3131215d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:53.981057 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd3dd4-2a3a-45cb-892f-01e3131215d2 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:53.981746 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc669c-f87a-4d9e-ba56-a3eca28406bf None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:53.985567 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f693e1d-4e33-49b6-aecb-06704dbfcd5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:53.986221 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f693e1d-4e33-49b6-aecb-06704dbfcd5f service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:53.986723 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f693e1d-4e33-49b6-aecb-06704dbfcd5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:53.987875 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f693e1d-4e33-49b6-aecb-06704dbfcd5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:53.989773 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:53.996432 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1052/2103] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:21:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:21:54.001477 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd3dd4-2a3a-45cb-892f-01e3131215d2 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:54.003906 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f693e1d-4e33-49b6-aecb-06704dbfcd5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:54.005743 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f693e1d-4e33-49b6-aecb-06704dbfcd5f service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:54.018427 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1052/2104] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:21:54.018723 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd3dd4-2a3a-45cb-892f-01e3131215d2 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:54.024445 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c5274-e2a0-47ae-8b73-6f28abcf5034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:54.024966 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c5274-e2a0-47ae-8b73-6f28abcf5034 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:54.025253 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c5274-e2a0-47ae-8b73-6f28abcf5034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:54.025528 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c5274-e2a0-47ae-8b73-6f28abcf5034 admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:54.026400 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c5274-e2a0-47ae-8b73-6f28abcf5034 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:54.028772 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c5274-e2a0-47ae-8b73-6f28abcf5034 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:54.076193 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1053/2105] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:54 2022] POST /identity/v3/projects => generated 377 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:54.080716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f693e1d-4e33-49b6-aecb-06704dbfcd5f service neutron] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:54.093281 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f693e1d-4e33-49b6-aecb-06704dbfcd5f service neutron] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:54.209401 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efecaecf-5965-4f2b-a248-92dfb97f261a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:54.210269 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecaecf-5965-4f2b-a248-92dfb97f261a admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:54.210592 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecaecf-5965-4f2b-a248-92dfb97f261a admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:54.210699 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecaecf-5965-4f2b-a248-92dfb97f261a admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:54.211443 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efecaecf-5965-4f2b-a248-92dfb97f261a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:54.214174 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efecaecf-5965-4f2b-a248-92dfb97f261a admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:54.244360 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1053/2106] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:54 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:54.245423 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c5274-e2a0-47ae-8b73-6f28abcf5034 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:54.256270 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c5274-e2a0-47ae-8b73-6f28abcf5034 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:54.262280 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5a05f-0b9c-4850-8d01-455ffe362924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:54.263047 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5a05f-0b9c-4850-8d01-455ffe362924 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:54.263329 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5a05f-0b9c-4850-8d01-455ffe362924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:54.263930 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5a05f-0b9c-4850-8d01-455ffe362924 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:54.264558 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5a05f-0b9c-4850-8d01-455ffe362924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:54.266240 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5a05f-0b9c-4850-8d01-455ffe362924 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:54.279273 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1054/2107] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:21:54.283395 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efecaecf-5965-4f2b-a248-92dfb97f261a admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:54.302738 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efecaecf-5965-4f2b-a248-92dfb97f261a admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:54.318054 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512bd92-33ae-4dca-881e-a6d059eb9b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:54.318660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512bd92-33ae-4dca-881e-a6d059eb9b82 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:54.319113 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512bd92-33ae-4dca-881e-a6d059eb9b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:54.319394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512bd92-33ae-4dca-881e-a6d059eb9b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:54.320279 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512bd92-33ae-4dca-881e-a6d059eb9b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:54.321937 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512bd92-33ae-4dca-881e-a6d059eb9b82 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:54.333570 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1054/2108] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:54.337795 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5a05f-0b9c-4850-8d01-455ffe362924 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:54.348964 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5a05f-0b9c-4850-8d01-455ffe362924 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:54.353802 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88db29-4be7-4c94-af54-8ec5b8d7193a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:54.354817 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88db29-4be7-4c94-af54-8ec5b8d7193a admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:54.355185 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88db29-4be7-4c94-af54-8ec5b8d7193a admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:54.355462 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88db29-4be7-4c94-af54-8ec5b8d7193a admin admin] PATH_INFO: `/v3/projects/2d795d32687e4e17953001c361a2283a/users/f62aee4ed2534ed9aeebb056b27fa613/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:54.371575 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d88db29-4be7-4c94-af54-8ec5b8d7193a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d795d32687e4e17953001c361a2283a, user_id=f62aee4ed2534ed9aeebb056b27fa613, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:54.374303 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d88db29-4be7-4c94-af54-8ec5b8d7193a admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:54.388599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1055/2109] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:54 2022] PUT /identity/v3/projects/2d795d32687e4e17953001c361a2283a/users/f62aee4ed2534ed9aeebb056b27fa613/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:54.398959 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429efeb2-d00e-477c-bbff-4251c75f35c1 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:54.399359 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429efeb2-d00e-477c-bbff-4251c75f35c1 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:54.399659 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429efeb2-d00e-477c-bbff-4251c75f35c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:54.430882 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88db29-4be7-4c94-af54-8ec5b8d7193a admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:54.431590 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-429efeb2-d00e-477c-bbff-4251c75f35c1 None None] MFA Rules not processed for user `f62aee4ed2534ed9aeebb056b27fa613`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:54.432813 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-429efeb2-d00e-477c-bbff-4251c75f35c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:54.433142 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-3d88db29-4be7-4c94-af54-8ec5b8d7193a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:54.505878 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88db29-4be7-4c94-af54-8ec5b8d7193a admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:54.508132 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1055/2110] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:54.513455 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a4cfa-ab6f-4243-9bb1-760a6d12e1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:54.514327 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a4cfa-ab6f-4243-9bb1-760a6d12e1d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:54.514610 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a4cfa-ab6f-4243-9bb1-760a6d12e1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:54.514917 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a4cfa-ab6f-4243-9bb1-760a6d12e1d0 admin admin] PATH_INFO: `/v3/projects/6241a55d58ce422c94273bd4d76d72c8` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:54.516165 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a4cfa-ab6f-4243-9bb1-760a6d12e1d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6241a55d58ce422c94273bd4d76d72c8)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:54.518267 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a4cfa-ab6f-4243-9bb1-760a6d12e1d0 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:54.518931 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429efeb2-d00e-477c-bbff-4251c75f35c1 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:54.520336 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-429efeb2-d00e-477c-bbff-4251c75f35c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:54.570568 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-585a4cfa-ab6f-4243-9bb1-760a6d12e1d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6241a55d58ce422c94273bd4d76d72c8', 'request_id': 'req-585a4cfa-ab6f-4243-9bb1-760a6d12e1d0'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:54.574586 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:54.578349 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429efeb2-d00e-477c-bbff-4251c75f35c1 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:54.579015 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-585a4cfa-ab6f-4243-9bb1-760a6d12e1d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6241a55d58ce422c94273bd4d76d72c8', 'request_id': 'req-585a4cfa-ab6f-4243-9bb1-760a6d12e1d0'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:54.585795 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-585a4cfa-ab6f-4243-9bb1-760a6d12e1d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6241a55d58ce422c94273bd4d76d72c8', 'request_id': 'req-585a4cfa-ab6f-4243-9bb1-760a6d12e1d0'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:54.596193 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-585a4cfa-ab6f-4243-9bb1-760a6d12e1d0 admin admin] The token cache is being invalidate because project 6241a55d58ce422c94273bd4d76d72c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:54.596489 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-585a4cfa-ab6f-4243-9bb1-760a6d12e1d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:54.597145 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-585a4cfa-ab6f-4243-9bb1-760a6d12e1d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:54.598769 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1056/2111] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:54 2022] DELETE /identity/v3/projects/6241a55d58ce422c94273bd4d76d72c8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:21:54.603354 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede70729-28ec-4eac-b673-bbd52828d2c5 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:54.603643 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede70729-28ec-4eac-b673-bbd52828d2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:54.603924 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede70729-28ec-4eac-b673-bbd52828d2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:54.621863 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-ede70729-28ec-4eac-b673-bbd52828d2c5 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:54.623094 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-ede70729-28ec-4eac-b673-bbd52828d2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:54.631731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b51a0-906d-42b5-8352-b65d3d2f7c5c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09d603d756a9484bbf48cfd6d56bdb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:54.632380 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b51a0-906d-42b5-8352-b65d3d2f7c5c service glance] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:54.632664 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b51a0-906d-42b5-8352-b65d3d2f7c5c service glance] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:54.632941 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b51a0-906d-42b5-8352-b65d3d2f7c5c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:54.634729 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-523b51a0-906d-42b5-8352-b65d3d2f7c5c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:54.654726 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:54.689169 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1057/2112] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:21:54.698109 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad9ee1-b6e0-458d-b2e0-269666c4dd89 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:54.698724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad9ee1-b6e0-458d-b2e0-269666c4dd89 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:54.698724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad9ee1-b6e0-458d-b2e0-269666c4dd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:54.701476 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b51a0-906d-42b5-8352-b65d3d2f7c5c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:54.703139 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b51a0-906d-42b5-8352-b65d3d2f7c5c service glance] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:54.712248 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1056/2113] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:54.718349 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-bbad9ee1-b6e0-458d-b2e0-269666c4dd89 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:54.719571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-bbad9ee1-b6e0-458d-b2e0-269666c4dd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:54.737127 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1058/2114] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:21:54.741895 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b51a0-906d-42b5-8352-b65d3d2f7c5c service glance] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:54.752877 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b51a0-906d-42b5-8352-b65d3d2f7c5c service glance] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:54.757787 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820664b0-f1d0-4d16-aea3-cb5022445463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:54.758449 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820664b0-f1d0-4d16-aea3-cb5022445463 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:54.758777 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820664b0-f1d0-4d16-aea3-cb5022445463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:54.759059 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820664b0-f1d0-4d16-aea3-cb5022445463 admin admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:54.759783 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820664b0-f1d0-4d16-aea3-cb5022445463 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:21:54.760091 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820664b0-f1d0-4d16-aea3-cb5022445463 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:54.761772 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820664b0-f1d0-4d16-aea3-cb5022445463 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:54.774037 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1057/2115] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:21:54.778537 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad9ee1-b6e0-458d-b2e0-269666c4dd89 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:54.788588 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad9ee1-b6e0-458d-b2e0-269666c4dd89 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:54.793289 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d06db-75f7-4b4e-b4e3-3eafc22626c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:54.793946 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d06db-75f7-4b4e-b4e3-3eafc22626c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:54.794231 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d06db-75f7-4b4e-b4e3-3eafc22626c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:54.794514 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d06db-75f7-4b4e-b4e3-3eafc22626c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:54.795244 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d06db-75f7-4b4e-b4e3-3eafc22626c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:54.797165 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d06db-75f7-4b4e-b4e3-3eafc22626c0 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:54.826171 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1059/2116] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:54 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:54.827224 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820664b0-f1d0-4d16-aea3-cb5022445463 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:54.838117 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820664b0-f1d0-4d16-aea3-cb5022445463 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:54.897918 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2461d3e-0690-44ea-b226-c3e00e39b89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:54.898655 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2461d3e-0690-44ea-b226-c3e00e39b89c admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:54.898945 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2461d3e-0690-44ea-b226-c3e00e39b89c admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:54.899319 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2461d3e-0690-44ea-b226-c3e00e39b89c admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:54.900041 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2461d3e-0690-44ea-b226-c3e00e39b89c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:54.901994 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2461d3e-0690-44ea-b226-c3e00e39b89c admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:54.924259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1058/2117] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:54 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:21:54.929249 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d06db-75f7-4b4e-b4e3-3eafc22626c0 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:54.939514 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d06db-75f7-4b4e-b4e3-3eafc22626c0 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:54.944299 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c87cae-94a2-4478-8c3b-bd718ce25df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:54.944966 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c87cae-94a2-4478-8c3b-bd718ce25df9 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:54.945250 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c87cae-94a2-4478-8c3b-bd718ce25df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:54.945529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c87cae-94a2-4478-8c3b-bd718ce25df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:54.946257 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c87cae-94a2-4478-8c3b-bd718ce25df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:54.947906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c87cae-94a2-4478-8c3b-bd718ce25df9 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:54.958507 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1060/2118] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:54.962554 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2461d3e-0690-44ea-b226-c3e00e39b89c admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:54.973639 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2461d3e-0690-44ea-b226-c3e00e39b89c admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:54.978321 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a949a-6ad3-4409-b2a8-8d01eeb45475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:54.979003 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a949a-6ad3-4409-b2a8-8d01eeb45475 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:54.979290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a949a-6ad3-4409-b2a8-8d01eeb45475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:54.979568 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a949a-6ad3-4409-b2a8-8d01eeb45475 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:54.980295 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a949a-6ad3-4409-b2a8-8d01eeb45475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:54.981920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a949a-6ad3-4409-b2a8-8d01eeb45475 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:54.992410 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1059/2119] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:54.996571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c87cae-94a2-4478-8c3b-bd718ce25df9 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:55.006627 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c87cae-94a2-4478-8c3b-bd718ce25df9 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:55.011594 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7520d9-7d6c-4031-9052-93181649fed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:55.012586 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7520d9-7d6c-4031-9052-93181649fed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:55.012935 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7520d9-7d6c-4031-9052-93181649fed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:55.013206 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7520d9-7d6c-4031-9052-93181649fed4 admin admin] PATH_INFO: `/v3/projects/4af37c498fd6498d82b653b20a229d52/users/24178e75912a43d5b76bd49adcb86545/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:55.029780 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7520d9-7d6c-4031-9052-93181649fed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4af37c498fd6498d82b653b20a229d52, user_id=24178e75912a43d5b76bd49adcb86545, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:55.032825 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7520d9-7d6c-4031-9052-93181649fed4 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:55.045429 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1061/2120] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:54 2022] PUT /identity/v3/projects/4af37c498fd6498d82b653b20a229d52/users/24178e75912a43d5b76bd49adcb86545/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:21:55.057037 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6c6aa-533e-414f-8fb7-418a1e2140f2 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:55.057952 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6c6aa-533e-414f-8fb7-418a1e2140f2 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:55.058789 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6c6aa-533e-414f-8fb7-418a1e2140f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:55.086901 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-9cc6c6aa-533e-414f-8fb7-418a1e2140f2 None None] MFA Rules not processed for user `24178e75912a43d5b76bd49adcb86545`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:55.088350 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-9cc6c6aa-533e-414f-8fb7-418a1e2140f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:55.101220 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:55.187649 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1060/2121] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:55.192555 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7520d9-7d6c-4031-9052-93181649fed4 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:55.268496 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7520d9-7d6c-4031-9052-93181649fed4 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:55.275612 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78ec1e-8753-40d3-a828-8ab974a097ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:55.276275 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78ec1e-8753-40d3-a828-8ab974a097ea admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:55.276566 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78ec1e-8753-40d3-a828-8ab974a097ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:55.276844 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78ec1e-8753-40d3-a828-8ab974a097ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:55.277537 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78ec1e-8753-40d3-a828-8ab974a097ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:55.279768 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78ec1e-8753-40d3-a828-8ab974a097ea admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:55.304838 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1062/2122] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:55 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:55.308905 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6c6aa-533e-414f-8fb7-418a1e2140f2 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:55.319903 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6c6aa-533e-414f-8fb7-418a1e2140f2 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:55.377570 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af397ef-512d-4110-8d80-8f421a2f614b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:55.378162 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af397ef-512d-4110-8d80-8f421a2f614b admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:55.378449 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af397ef-512d-4110-8d80-8f421a2f614b admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:55.378778 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af397ef-512d-4110-8d80-8f421a2f614b admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:55.379487 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af397ef-512d-4110-8d80-8f421a2f614b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:55.381485 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af397ef-512d-4110-8d80-8f421a2f614b admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:55.402285 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1061/2123] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:55 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:21:55.406445 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78ec1e-8753-40d3-a828-8ab974a097ea admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:55.417807 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78ec1e-8753-40d3-a828-8ab974a097ea admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:55.422532 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e906517-967d-4d1e-9264-335368ae886e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:55.423261 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e906517-967d-4d1e-9264-335368ae886e admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:55.423546 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e906517-967d-4d1e-9264-335368ae886e admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:55.423825 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e906517-967d-4d1e-9264-335368ae886e admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:55.424566 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e906517-967d-4d1e-9264-335368ae886e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:55.426176 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e906517-967d-4d1e-9264-335368ae886e admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:55.436975 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1063/2124] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:21:55.440879 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af397ef-512d-4110-8d80-8f421a2f614b admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:55.451442 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af397ef-512d-4110-8d80-8f421a2f614b admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:55.456751 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab7598-4b1a-47a1-9676-527062c538ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:55.458308 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab7598-4b1a-47a1-9676-527062c538ed admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:55.458446 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab7598-4b1a-47a1-9676-527062c538ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:55.458835 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab7598-4b1a-47a1-9676-527062c538ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:55.459620 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab7598-4b1a-47a1-9676-527062c538ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:55.461237 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab7598-4b1a-47a1-9676-527062c538ed admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:55.475005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1062/2125] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:55.476386 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e906517-967d-4d1e-9264-335368ae886e admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:55.486382 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e906517-967d-4d1e-9264-335368ae886e admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:55.491120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fff94-4272-4647-979a-9c61d05a800d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:55.492000 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fff94-4272-4647-979a-9c61d05a800d admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:55.492280 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fff94-4272-4647-979a-9c61d05a800d admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:55.492552 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fff94-4272-4647-979a-9c61d05a800d admin admin] PATH_INFO: `/v3/projects/afa7818cef814a438303af855c626458/users/40e76741c3694221b3a4d9a8cd1b05ac/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:55.507503 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fff94-4272-4647-979a-9c61d05a800d admin admin] RBAC: Authorizing `identity:create_grant(project_id=afa7818cef814a438303af855c626458, user_id=40e76741c3694221b3a4d9a8cd1b05ac, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:55.510189 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fff94-4272-4647-979a-9c61d05a800d admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:55.523404 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1064/2126] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:55 2022] PUT /identity/v3/projects/afa7818cef814a438303af855c626458/users/40e76741c3694221b3a4d9a8cd1b05ac/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:55.534970 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99620816-0751-42bf-b875-1cdf13454285 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:55.535269 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99620816-0751-42bf-b875-1cdf13454285 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:55.535552 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99620816-0751-42bf-b875-1cdf13454285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:55.561823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-99620816-0751-42bf-b875-1cdf13454285 None None] MFA Rules not processed for user `40e76741c3694221b3a4d9a8cd1b05ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:55.563069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-99620816-0751-42bf-b875-1cdf13454285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:55.625448 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1063/2127] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:55.630477 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fff94-4272-4647-979a-9c61d05a800d admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:55.649792 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:55.694233 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fff94-4272-4647-979a-9c61d05a800d admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:55.698901 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34abe1da-0661-4a8b-9d74-415730c6fcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:55.699565 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abe1da-0661-4a8b-9d74-415730c6fcbe admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:55.699846 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abe1da-0661-4a8b-9d74-415730c6fcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:55.700120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abe1da-0661-4a8b-9d74-415730c6fcbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:55.700819 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34abe1da-0661-4a8b-9d74-415730c6fcbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:55.702754 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34abe1da-0661-4a8b-9d74-415730c6fcbe admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:55.732304 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1065/2128] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:55 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:55.733792 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99620816-0751-42bf-b875-1cdf13454285 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:55.745144 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99620816-0751-42bf-b875-1cdf13454285 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:55.763327 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:55.803378 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489ac08-94b1-4225-99d7-554010a84a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:55.804050 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489ac08-94b1-4225-99d7-554010a84a03 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:55.804332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489ac08-94b1-4225-99d7-554010a84a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:55.804616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489ac08-94b1-4225-99d7-554010a84a03 admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:55.805319 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9489ac08-94b1-4225-99d7-554010a84a03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:55.807312 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9489ac08-94b1-4225-99d7-554010a84a03 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:55.826602 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1064/2129] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:55 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:55.830679 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34abe1da-0661-4a8b-9d74-415730c6fcbe admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:55.841444 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34abe1da-0661-4a8b-9d74-415730c6fcbe admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:55.846242 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1596c9-e1d2-4904-8142-a7b0e530c666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:55.846924 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1596c9-e1d2-4904-8142-a7b0e530c666 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:55.847206 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1596c9-e1d2-4904-8142-a7b0e530c666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:55.847481 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1596c9-e1d2-4904-8142-a7b0e530c666 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:55.848865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1596c9-e1d2-4904-8142-a7b0e530c666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:55.850459 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1596c9-e1d2-4904-8142-a7b0e530c666 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:55.860884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1066/2130] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:55.864933 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489ac08-94b1-4225-99d7-554010a84a03 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:55.874731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489ac08-94b1-4225-99d7-554010a84a03 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:55.879292 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b63d6-8af9-4f14-97f5-86d1047a3baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:55.880178 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b63d6-8af9-4f14-97f5-86d1047a3baa admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:55.880469 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b63d6-8af9-4f14-97f5-86d1047a3baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:55.880800 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b63d6-8af9-4f14-97f5-86d1047a3baa admin admin] PATH_INFO: `/v3/projects/ad3432eb44e44dc7ac7495b7f0370117/users/4b563f5287814e2fa8acf066ad30e256/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:55.896844 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b63d6-8af9-4f14-97f5-86d1047a3baa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad3432eb44e44dc7ac7495b7f0370117, user_id=4b563f5287814e2fa8acf066ad30e256, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:55.899540 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b63d6-8af9-4f14-97f5-86d1047a3baa admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:55.912796 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1065/2131] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:55 2022] PUT /identity/v3/projects/ad3432eb44e44dc7ac7495b7f0370117/users/4b563f5287814e2fa8acf066ad30e256/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:21:55.916648 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1596c9-e1d2-4904-8142-a7b0e530c666 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:55.926783 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1596c9-e1d2-4904-8142-a7b0e530c666 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:55.981969 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a081ff-239d-4988-84ea-3b6e1bc22c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:55.982612 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a081ff-239d-4988-84ea-3b6e1bc22c14 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:55.982927 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a081ff-239d-4988-84ea-3b6e1bc22c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:55.983201 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a081ff-239d-4988-84ea-3b6e1bc22c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:55.983913 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a081ff-239d-4988-84ea-3b6e1bc22c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:55.985499 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a081ff-239d-4988-84ea-3b6e1bc22c14 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:55.995210 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1067/2132] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:21:55.999716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b63d6-8af9-4f14-97f5-86d1047a3baa admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:56.016387 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b63d6-8af9-4f14-97f5-86d1047a3baa admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:56.021540 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e6ec9-d2d4-4473-be5c-88d44815a07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:56.022428 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e6ec9-d2d4-4473-be5c-88d44815a07d admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:56.022724 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e6ec9-d2d4-4473-be5c-88d44815a07d admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:56.022997 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e6ec9-d2d4-4473-be5c-88d44815a07d admin admin] PATH_INFO: `/v3/projects/ad3432eb44e44dc7ac7495b7f0370117/users/4b563f5287814e2fa8acf066ad30e256/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:56.024913 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e6ec9-d2d4-4473-be5c-88d44815a07d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad3432eb44e44dc7ac7495b7f0370117, user_id=4b563f5287814e2fa8acf066ad30e256, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:56.027629 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e6ec9-d2d4-4473-be5c-88d44815a07d admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:56.038981 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1066/2133] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:55 2022] PUT /identity/v3/projects/ad3432eb44e44dc7ac7495b7f0370117/users/4b563f5287814e2fa8acf066ad30e256/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:56.048947 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1232d-a352-49be-afed-b28fb7a6a2d5 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:56.049237 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1232d-a352-49be-afed-b28fb7a6a2d5 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:56.049514 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1232d-a352-49be-afed-b28fb7a6a2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:56.076185 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-5ee1232d-a352-49be-afed-b28fb7a6a2d5 None None] MFA Rules not processed for user `4b563f5287814e2fa8acf066ad30e256`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:56.077381 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-5ee1232d-a352-49be-afed-b28fb7a6a2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:56.143636 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1068/2134] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:21:56 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:21:56.155530 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e6ec9-d2d4-4473-be5c-88d44815a07d admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:56.157227 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-775e6ec9-d2d4-4473-be5c-88d44815a07d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:56.215340 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e6ec9-d2d4-4473-be5c-88d44815a07d admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:56.219276 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c182356-2c9b-420e-9df9-984241965b64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:56.219920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c182356-2c9b-420e-9df9-984241965b64 service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:56.220204 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c182356-2c9b-420e-9df9-984241965b64 service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:56.220480 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c182356-2c9b-420e-9df9-984241965b64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:56.278353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c182356-2c9b-420e-9df9-984241965b64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:56.280255 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c182356-2c9b-420e-9df9-984241965b64 service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:56.291923 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1067/2135] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:58.872260 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1232d-a352-49be-afed-b28fb7a6a2d5 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:58.881902 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1232d-a352-49be-afed-b28fb7a6a2d5 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:58.885445 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d242a-7703-407e-af4a-c2a9ab637595 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:58.886103 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d242a-7703-407e-af4a-c2a9ab637595 service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:58.886383 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d242a-7703-407e-af4a-c2a9ab637595 service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:58.886674 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d242a-7703-407e-af4a-c2a9ab637595 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:58.900635 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:58.950477 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d242a-7703-407e-af4a-c2a9ab637595 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:58.951963 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d242a-7703-407e-af4a-c2a9ab637595 service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:58.961392 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1069/2136] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:01.204440 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c182356-2c9b-420e-9df9-984241965b64 service cinder] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:01.218911 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c182356-2c9b-420e-9df9-984241965b64 service cinder] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:01.223119 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a82b4-2a94-4050-9578-e94e2d548373 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:01.224415 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a82b4-2a94-4050-9578-e94e2d548373 service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:01.224699 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a82b4-2a94-4050-9578-e94e2d548373 service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:01.224977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a82b4-2a94-4050-9578-e94e2d548373 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:01.234812 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a82b4-2a94-4050-9578-e94e2d548373 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:01.236350 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a82b4-2a94-4050-9578-e94e2d548373 service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:01.246019 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1068/2137] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:01 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:08.956918 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=22 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:11.242119 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=88,keystone:INSERT=5 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:11.632144 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d242a-7703-407e-af4a-c2a9ab637595 service cinder] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:11.633639 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-c87d242a-7703-407e-af4a-c2a9ab637595 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:11.716641 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d242a-7703-407e-af4a-c2a9ab637595 service cinder] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:11.721333 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72a62b-055b-45d9-93ec-7d507bc539c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:11.722243 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72a62b-055b-45d9-93ec-7d507bc539c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:11.722524 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72a62b-055b-45d9-93ec-7d507bc539c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:11.722826 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72a62b-055b-45d9-93ec-7d507bc539c8 admin admin] PATH_INFO: `/v3/users/c2c4a742ff244e298bdcdbc0c9ae5e48` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:11.724036 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72a62b-055b-45d9-93ec-7d507bc539c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2c4a742ff244e298bdcdbc0c9ae5e48)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:11.726538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72a62b-055b-45d9-93ec-7d507bc539c8 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:11.789359 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-9b72a62b-055b-45d9-93ec-7d507bc539c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2c4a742ff244e298bdcdbc0c9ae5e48'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:11.790088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-9b72a62b-055b-45d9-93ec-7d507bc539c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2c4a742ff244e298bdcdbc0c9ae5e48'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:11.803583 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-9b72a62b-055b-45d9-93ec-7d507bc539c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2c4a742ff244e298bdcdbc0c9ae5e48'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:11.804382 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-9b72a62b-055b-45d9-93ec-7d507bc539c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2c4a742ff244e298bdcdbc0c9ae5e48'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:11.812311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-9b72a62b-055b-45d9-93ec-7d507bc539c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2c4a742ff244e298bdcdbc0c9ae5e48'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:11.825882 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1070/2138] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:11 2022] DELETE /identity/v3/users/c2c4a742ff244e298bdcdbc0c9ae5e48 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:12.004812 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a82b4-2a94-4050-9578-e94e2d548373 service cinder] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:12.026594 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a82b4-2a94-4050-9578-e94e2d548373 service cinder] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:12.090248 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755704d-db7c-4d9b-a370-6f9d90324604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:12.091224 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755704d-db7c-4d9b-a370-6f9d90324604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:12.091581 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755704d-db7c-4d9b-a370-6f9d90324604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:12.091959 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755704d-db7c-4d9b-a370-6f9d90324604 admin admin] PATH_INFO: `/v3/projects/92e4aeb775da4e0399886af39bce2eb7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:12.093225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7755704d-db7c-4d9b-a370-6f9d90324604 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92e4aeb775da4e0399886af39bce2eb7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:12.095257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7755704d-db7c-4d9b-a370-6f9d90324604 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:12.146448 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-7755704d-db7c-4d9b-a370-6f9d90324604 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92e4aeb775da4e0399886af39bce2eb7', 'request_id': 'req-7755704d-db7c-4d9b-a370-6f9d90324604'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:12.154775 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-7755704d-db7c-4d9b-a370-6f9d90324604 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92e4aeb775da4e0399886af39bce2eb7', 'request_id': 'req-7755704d-db7c-4d9b-a370-6f9d90324604'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:12.160577 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-7755704d-db7c-4d9b-a370-6f9d90324604 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92e4aeb775da4e0399886af39bce2eb7', 'request_id': 'req-7755704d-db7c-4d9b-a370-6f9d90324604'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:12.174571 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-7755704d-db7c-4d9b-a370-6f9d90324604 admin admin] The token cache is being invalidate because project 92e4aeb775da4e0399886af39bce2eb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:12.174886 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-7755704d-db7c-4d9b-a370-6f9d90324604 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:12.175578 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-7755704d-db7c-4d9b-a370-6f9d90324604 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:12.177048 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1069/2139] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:12 2022] DELETE /identity/v3/projects/92e4aeb775da4e0399886af39bce2eb7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:12.182335 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e831c72-8369-451b-9c04-5018823172c3 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:12.182796 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e831c72-8369-451b-9c04-5018823172c3 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:12.183147 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e831c72-8369-451b-9c04-5018823172c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:12.204460 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-8e831c72-8369-451b-9c04-5018823172c3 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:12.205703 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-8e831c72-8369-451b-9c04-5018823172c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:12.265198 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1071/2140] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:22:12.274790 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6fc82-0e8e-4e17-8294-660c3f149029 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:12.275323 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6fc82-0e8e-4e17-8294-660c3f149029 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:12.275536 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6fc82-0e8e-4e17-8294-660c3f149029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:12.295355 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-05f6fc82-0e8e-4e17-8294-660c3f149029 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:12.296570 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-05f6fc82-0e8e-4e17-8294-660c3f149029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:12.306366 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1070/2141] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:12.310587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e831c72-8369-451b-9c04-5018823172c3 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:12.329569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e831c72-8369-451b-9c04-5018823172c3 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:12.334261 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075264b-208c-4cc1-922a-96e1c7400d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:12.334960 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075264b-208c-4cc1-922a-96e1c7400d43 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:12.335238 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075264b-208c-4cc1-922a-96e1c7400d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:12.335508 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075264b-208c-4cc1-922a-96e1c7400d43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:12.336269 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075264b-208c-4cc1-922a-96e1c7400d43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:22:12.336573 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075264b-208c-4cc1-922a-96e1c7400d43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:12.338272 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075264b-208c-4cc1-922a-96e1c7400d43 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:12.350096 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1072/2142] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:22:12.354801 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6fc82-0e8e-4e17-8294-660c3f149029 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:12.364360 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6fc82-0e8e-4e17-8294-660c3f149029 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:12.369917 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce09c09f-ee06-4ee3-b875-ea56a290df40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:12.370614 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09c09f-ee06-4ee3-b875-ea56a290df40 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:12.370986 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09c09f-ee06-4ee3-b875-ea56a290df40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:12.371390 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09c09f-ee06-4ee3-b875-ea56a290df40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:12.372092 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09c09f-ee06-4ee3-b875-ea56a290df40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:12.374023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09c09f-ee06-4ee3-b875-ea56a290df40 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:12.405595 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1071/2143] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:12 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:22:12.409667 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075264b-208c-4cc1-922a-96e1c7400d43 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:12.420310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075264b-208c-4cc1-922a-96e1c7400d43 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:12.423986 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:12.482754 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b403a-2422-4b45-8a8f-c2f78e4e36b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:12.483432 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b403a-2422-4b45-8a8f-c2f78e4e36b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:12.483717 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b403a-2422-4b45-8a8f-c2f78e4e36b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:12.483990 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b403a-2422-4b45-8a8f-c2f78e4e36b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:12.484676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b403a-2422-4b45-8a8f-c2f78e4e36b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:12.486796 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b403a-2422-4b45-8a8f-c2f78e4e36b0 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:12.510123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1073/2144] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:12 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:22:12.514175 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce09c09f-ee06-4ee3-b875-ea56a290df40 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:12.528089 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce09c09f-ee06-4ee3-b875-ea56a290df40 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:12.533040 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef5480-caa0-4eb1-846b-d3332e64b123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:12.533708 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef5480-caa0-4eb1-846b-d3332e64b123 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:12.533994 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef5480-caa0-4eb1-846b-d3332e64b123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:12.534620 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef5480-caa0-4eb1-846b-d3332e64b123 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:12.535381 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef5480-caa0-4eb1-846b-d3332e64b123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:12.536994 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef5480-caa0-4eb1-846b-d3332e64b123 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:12.547819 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1072/2145] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:22:12.551965 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b403a-2422-4b45-8a8f-c2f78e4e36b0 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:12.562591 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b403a-2422-4b45-8a8f-c2f78e4e36b0 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:12.567480 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffeddbd-f4e8-47ac-8133-2b4c5eeaef97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:12.568134 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffeddbd-f4e8-47ac-8133-2b4c5eeaef97 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:12.569129 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffeddbd-f4e8-47ac-8133-2b4c5eeaef97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:12.569444 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffeddbd-f4e8-47ac-8133-2b4c5eeaef97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:12.570221 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffeddbd-f4e8-47ac-8133-2b4c5eeaef97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:12.571890 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffeddbd-f4e8-47ac-8133-2b4c5eeaef97 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:12.582930 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1074/2146] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:12.587207 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef5480-caa0-4eb1-846b-d3332e64b123 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:12.597340 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef5480-caa0-4eb1-846b-d3332e64b123 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:12.602275 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e0a70-4ae2-4660-bc29-93b2db779e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:12.603185 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e0a70-4ae2-4660-bc29-93b2db779e3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:12.603466 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e0a70-4ae2-4660-bc29-93b2db779e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:12.603736 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e0a70-4ae2-4660-bc29-93b2db779e3e admin admin] PATH_INFO: `/v3/projects/d1772e35c9ca43d590f7738ac5163db3/users/c78b0769644d48aa9a9c03a9a1566dd0/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:12.619234 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e0a70-4ae2-4660-bc29-93b2db779e3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1772e35c9ca43d590f7738ac5163db3, user_id=c78b0769644d48aa9a9c03a9a1566dd0, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:12.622096 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e0a70-4ae2-4660-bc29-93b2db779e3e admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:12.635674 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1073/2147] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:12 2022] PUT /identity/v3/projects/d1772e35c9ca43d590f7738ac5163db3/users/c78b0769644d48aa9a9c03a9a1566dd0/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:22:12.640904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c5848-39d1-4c75-8766-0bf6e8ce47b8 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:12.641411 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c5848-39d1-4c75-8766-0bf6e8ce47b8 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:12.641506 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c5848-39d1-4c75-8766-0bf6e8ce47b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:12.660237 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-733c5848-39d1-4c75-8766-0bf6e8ce47b8 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:12.661435 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-733c5848-39d1-4c75-8766-0bf6e8ce47b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:12.730944 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1075/2148] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:12.744914 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e0a70-4ae2-4660-bc29-93b2db779e3e admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:12.747300 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-157e0a70-4ae2-4660-bc29-93b2db779e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:12.778052 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:12.807421 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e0a70-4ae2-4660-bc29-93b2db779e3e admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:12.811390 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036836c0-2279-42d6-9cbe-98f91df3e240 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:12.812071 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036836c0-2279-42d6-9cbe-98f91df3e240 service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:12.812363 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036836c0-2279-42d6-9cbe-98f91df3e240 service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:12.812626 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036836c0-2279-42d6-9cbe-98f91df3e240 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:12.821956 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036836c0-2279-42d6-9cbe-98f91df3e240 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:12.823433 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036836c0-2279-42d6-9cbe-98f91df3e240 service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:12.833154 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1074/2149] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:22:12.946373 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c5848-39d1-4c75-8766-0bf6e8ce47b8 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:12.947901 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-733c5848-39d1-4c75-8766-0bf6e8ce47b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:12.959811 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c5848-39d1-4c75-8766-0bf6e8ce47b8 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:12.964618 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c88d53-2312-4e4d-b8b2-8df8d80c300a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:12.965496 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c88d53-2312-4e4d-b8b2-8df8d80c300a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:12.965778 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c88d53-2312-4e4d-b8b2-8df8d80c300a admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:12.966052 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c88d53-2312-4e4d-b8b2-8df8d80c300a admin admin] PATH_INFO: `/v3/users/b697d377ed9f4461b4fc0d78bdaaaae8` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:12.967280 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c88d53-2312-4e4d-b8b2-8df8d80c300a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b697d377ed9f4461b4fc0d78bdaaaae8)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:12.969246 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c88d53-2312-4e4d-b8b2-8df8d80c300a admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:13.029422 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-f4c88d53-2312-4e4d-b8b2-8df8d80c300a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b697d377ed9f4461b4fc0d78bdaaaae8'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:13.030144 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-f4c88d53-2312-4e4d-b8b2-8df8d80c300a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b697d377ed9f4461b4fc0d78bdaaaae8'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:13.043712 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-f4c88d53-2312-4e4d-b8b2-8df8d80c300a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b697d377ed9f4461b4fc0d78bdaaaae8'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:13.044439 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-f4c88d53-2312-4e4d-b8b2-8df8d80c300a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b697d377ed9f4461b4fc0d78bdaaaae8'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:13.054463 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-f4c88d53-2312-4e4d-b8b2-8df8d80c300a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b697d377ed9f4461b4fc0d78bdaaaae8'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:13.073053 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:13.078272 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1076/2150] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:12 2022] DELETE /identity/v3/users/b697d377ed9f4461b4fc0d78bdaaaae8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:13.083419 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b9769-d910-4943-bb0d-8fe09e9c4ede None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:13.084712 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b9769-d910-4943-bb0d-8fe09e9c4ede None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:13.085126 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b9769-d910-4943-bb0d-8fe09e9c4ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:13.104981 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-a78b9769-d910-4943-bb0d-8fe09e9c4ede None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:13.106224 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-a78b9769-d910-4943-bb0d-8fe09e9c4ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:13.182345 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1075/2151] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:13.194950 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c88d53-2312-4e4d-b8b2-8df8d80c300a admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:13.196375 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-f4c88d53-2312-4e4d-b8b2-8df8d80c300a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:13.320543 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c88d53-2312-4e4d-b8b2-8df8d80c300a admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:13.328678 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c511c06-67df-4c90-a302-a8a460a67288 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:13.329473 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c511c06-67df-4c90-a302-a8a460a67288 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:13.329778 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c511c06-67df-4c90-a302-a8a460a67288 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:13.330040 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c511c06-67df-4c90-a302-a8a460a67288 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:13.346564 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c511c06-67df-4c90-a302-a8a460a67288 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:13.348661 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c511c06-67df-4c90-a302-a8a460a67288 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:13.369316 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1077/2152] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:13.828145 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b9769-d910-4943-bb0d-8fe09e9c4ede None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:13.831294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-a78b9769-d910-4943-bb0d-8fe09e9c4ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:13.846855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b9769-d910-4943-bb0d-8fe09e9c4ede None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:13.853645 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06d14c-8b6a-4323-9776-3569562d01c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:13.855312 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06d14c-8b6a-4323-9776-3569562d01c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:13.856072 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06d14c-8b6a-4323-9776-3569562d01c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:13.856349 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06d14c-8b6a-4323-9776-3569562d01c6 admin admin] PATH_INFO: `/v3/projects/94e3e63014d9416bb99e04de3b4f499b` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:13.858090 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06d14c-8b6a-4323-9776-3569562d01c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94e3e63014d9416bb99e04de3b4f499b)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:13.860686 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06d14c-8b6a-4323-9776-3569562d01c6 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:13.936371 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-fb06d14c-8b6a-4323-9776-3569562d01c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94e3e63014d9416bb99e04de3b4f499b', 'request_id': 'req-fb06d14c-8b6a-4323-9776-3569562d01c6'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:13.944066 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-fb06d14c-8b6a-4323-9776-3569562d01c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94e3e63014d9416bb99e04de3b4f499b', 'request_id': 'req-fb06d14c-8b6a-4323-9776-3569562d01c6'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:13.951254 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-fb06d14c-8b6a-4323-9776-3569562d01c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94e3e63014d9416bb99e04de3b4f499b', 'request_id': 'req-fb06d14c-8b6a-4323-9776-3569562d01c6'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:13.967398 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-fb06d14c-8b6a-4323-9776-3569562d01c6 admin admin] The token cache is being invalidate because project 94e3e63014d9416bb99e04de3b4f499b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:13.968166 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-fb06d14c-8b6a-4323-9776-3569562d01c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:13.969048 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-fb06d14c-8b6a-4323-9776-3569562d01c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:13.972519 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1076/2153] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:13 2022] DELETE /identity/v3/projects/94e3e63014d9416bb99e04de3b4f499b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:14.783737 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c511c06-67df-4c90-a302-a8a460a67288 service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:14.789387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-8c511c06-67df-4c90-a302-a8a460a67288 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:14.817843 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c511c06-67df-4c90-a302-a8a460a67288 service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:14.916014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9bc75-e5d4-4af1-8255-47e49eb4e339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:14.916898 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9bc75-e5d4-4af1-8255-47e49eb4e339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:14.917187 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9bc75-e5d4-4af1-8255-47e49eb4e339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:14.917466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9bc75-e5d4-4af1-8255-47e49eb4e339 admin admin] PATH_INFO: `/v3/users/24178e75912a43d5b76bd49adcb86545` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:14.918709 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9bc75-e5d4-4af1-8255-47e49eb4e339 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24178e75912a43d5b76bd49adcb86545)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:14.920683 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9bc75-e5d4-4af1-8255-47e49eb4e339 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:14.980362 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-35a9bc75-e5d4-4af1-8255-47e49eb4e339 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24178e75912a43d5b76bd49adcb86545'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:14.982155 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-35a9bc75-e5d4-4af1-8255-47e49eb4e339 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24178e75912a43d5b76bd49adcb86545'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:14.996427 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-35a9bc75-e5d4-4af1-8255-47e49eb4e339 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24178e75912a43d5b76bd49adcb86545'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:14.997330 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-35a9bc75-e5d4-4af1-8255-47e49eb4e339 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24178e75912a43d5b76bd49adcb86545'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:15.007518 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-35a9bc75-e5d4-4af1-8255-47e49eb4e339 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24178e75912a43d5b76bd49adcb86545'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:15.026277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1078/2154] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:14 2022] DELETE /identity/v3/users/24178e75912a43d5b76bd49adcb86545 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:15.034589 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c58612-7ff6-4580-a610-95490da159aa None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:15.035157 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c58612-7ff6-4580-a610-95490da159aa None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:15.035266 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c58612-7ff6-4580-a610-95490da159aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:15.086543 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-07c58612-7ff6-4580-a610-95490da159aa None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:15.088126 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-07c58612-7ff6-4580-a610-95490da159aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:15.167131 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:15.184029 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1077/2155] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:15.197022 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9bc75-e5d4-4af1-8255-47e49eb4e339 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:15.199471 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-35a9bc75-e5d4-4af1-8255-47e49eb4e339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:15.227238 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:15.279466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9bc75-e5d4-4af1-8255-47e49eb4e339 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:15.283135 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c4153-df11-4a2a-ab8d-fd108c759948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:15.283776 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c4153-df11-4a2a-ab8d-fd108c759948 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:15.284061 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c4153-df11-4a2a-ab8d-fd108c759948 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:15.284336 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c4153-df11-4a2a-ab8d-fd108c759948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:15.294499 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c4153-df11-4a2a-ab8d-fd108c759948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:15.295915 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c4153-df11-4a2a-ab8d-fd108c759948 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:15.305439 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1079/2156] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:15.803884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c58612-7ff6-4580-a610-95490da159aa None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:15.805520 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-07c58612-7ff6-4580-a610-95490da159aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:15.844726 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c58612-7ff6-4580-a610-95490da159aa None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:15.859053 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25987a87-6d66-4265-bccb-350ea52c6f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:15.860269 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25987a87-6d66-4265-bccb-350ea52c6f52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:15.860557 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25987a87-6d66-4265-bccb-350ea52c6f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:15.860845 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25987a87-6d66-4265-bccb-350ea52c6f52 admin admin] PATH_INFO: `/v3/projects/4af37c498fd6498d82b653b20a229d52` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:15.874813 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25987a87-6d66-4265-bccb-350ea52c6f52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4af37c498fd6498d82b653b20a229d52)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:15.883931 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25987a87-6d66-4265-bccb-350ea52c6f52 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:15.949334 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-25987a87-6d66-4265-bccb-350ea52c6f52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4af37c498fd6498d82b653b20a229d52', 'request_id': 'req-25987a87-6d66-4265-bccb-350ea52c6f52'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:15.961427 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-25987a87-6d66-4265-bccb-350ea52c6f52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4af37c498fd6498d82b653b20a229d52', 'request_id': 'req-25987a87-6d66-4265-bccb-350ea52c6f52'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:15.970602 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-25987a87-6d66-4265-bccb-350ea52c6f52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4af37c498fd6498d82b653b20a229d52', 'request_id': 'req-25987a87-6d66-4265-bccb-350ea52c6f52'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:15.988323 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-25987a87-6d66-4265-bccb-350ea52c6f52 admin admin] The token cache is being invalidate because project 4af37c498fd6498d82b653b20a229d52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:15.988685 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-25987a87-6d66-4265-bccb-350ea52c6f52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:15.989449 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-25987a87-6d66-4265-bccb-350ea52c6f52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:15.991238 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1078/2157] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:15 2022] DELETE /identity/v3/projects/4af37c498fd6498d82b653b20a229d52 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:15.995575 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c4153-df11-4a2a-ab8d-fd108c759948 service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:16.009003 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c4153-df11-4a2a-ab8d-fd108c759948 service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:16.135046 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d9716-a6ae-4103-9ffc-0063d643a82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:16.138953 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d9716-a6ae-4103-9ffc-0063d643a82f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:16.140089 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d9716-a6ae-4103-9ffc-0063d643a82f admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:16.141150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d9716-a6ae-4103-9ffc-0063d643a82f admin admin] PATH_INFO: `/v3/users/40e76741c3694221b3a4d9a8cd1b05ac` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:16.143751 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d9716-a6ae-4103-9ffc-0063d643a82f admin admin] RBAC: Authorizing `identity:delete_user(user_id=40e76741c3694221b3a4d9a8cd1b05ac)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:16.149256 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d9716-a6ae-4103-9ffc-0063d643a82f admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:16.262213 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-3c3d9716-a6ae-4103-9ffc-0063d643a82f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40e76741c3694221b3a4d9a8cd1b05ac'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:16.264138 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-3c3d9716-a6ae-4103-9ffc-0063d643a82f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40e76741c3694221b3a4d9a8cd1b05ac'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:16.287450 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-3c3d9716-a6ae-4103-9ffc-0063d643a82f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40e76741c3694221b3a4d9a8cd1b05ac'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:16.288217 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-3c3d9716-a6ae-4103-9ffc-0063d643a82f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40e76741c3694221b3a4d9a8cd1b05ac'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:16.300816 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-3c3d9716-a6ae-4103-9ffc-0063d643a82f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40e76741c3694221b3a4d9a8cd1b05ac'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:16.341758 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1080/2158] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:15 2022] DELETE /identity/v3/users/40e76741c3694221b3a4d9a8cd1b05ac => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:16.677191 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25987a87-6d66-4265-bccb-350ea52c6f52 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:16.679373 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-25987a87-6d66-4265-bccb-350ea52c6f52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:16.695451 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25987a87-6d66-4265-bccb-350ea52c6f52 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:16.783672 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78b444-c4da-4aca-bc83-88438cc449d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:16.784835 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78b444-c4da-4aca-bc83-88438cc449d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:16.785196 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78b444-c4da-4aca-bc83-88438cc449d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:16.786173 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78b444-c4da-4aca-bc83-88438cc449d1 admin admin] PATH_INFO: `/v3/projects/afa7818cef814a438303af855c626458` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:16.787758 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78b444-c4da-4aca-bc83-88438cc449d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afa7818cef814a438303af855c626458)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:16.789936 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78b444-c4da-4aca-bc83-88438cc449d1 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:16.855873 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-3f78b444-c4da-4aca-bc83-88438cc449d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afa7818cef814a438303af855c626458', 'request_id': 'req-3f78b444-c4da-4aca-bc83-88438cc449d1'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:16.862259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-3f78b444-c4da-4aca-bc83-88438cc449d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afa7818cef814a438303af855c626458', 'request_id': 'req-3f78b444-c4da-4aca-bc83-88438cc449d1'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:16.868314 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-3f78b444-c4da-4aca-bc83-88438cc449d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afa7818cef814a438303af855c626458', 'request_id': 'req-3f78b444-c4da-4aca-bc83-88438cc449d1'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:16.888185 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-3f78b444-c4da-4aca-bc83-88438cc449d1 admin admin] The token cache is being invalidate because project afa7818cef814a438303af855c626458 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:16.888482 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-3f78b444-c4da-4aca-bc83-88438cc449d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:16.889664 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-3f78b444-c4da-4aca-bc83-88438cc449d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:16.892250 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1079/2159] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:16 2022] DELETE /identity/v3/projects/afa7818cef814a438303af855c626458 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:16.895860 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d9716-a6ae-4103-9ffc-0063d643a82f admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:16.898033 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-3c3d9716-a6ae-4103-9ffc-0063d643a82f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:16.920753 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d9716-a6ae-4103-9ffc-0063d643a82f admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:16.985692 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:17.004666 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc86f98-c0e0-4b8b-9a2f-ee45e0479226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:17.005556 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc86f98-c0e0-4b8b-9a2f-ee45e0479226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:17.005889 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc86f98-c0e0-4b8b-9a2f-ee45e0479226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:17.006165 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc86f98-c0e0-4b8b-9a2f-ee45e0479226 admin admin] PATH_INFO: `/v3/users/4b563f5287814e2fa8acf066ad30e256` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:17.007418 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc86f98-c0e0-4b8b-9a2f-ee45e0479226 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b563f5287814e2fa8acf066ad30e256)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:17.009363 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc86f98-c0e0-4b8b-9a2f-ee45e0479226 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:17.079687 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-8bc86f98-c0e0-4b8b-9a2f-ee45e0479226 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b563f5287814e2fa8acf066ad30e256'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:17.080408 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-8bc86f98-c0e0-4b8b-9a2f-ee45e0479226 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b563f5287814e2fa8acf066ad30e256'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:17.096822 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-8bc86f98-c0e0-4b8b-9a2f-ee45e0479226 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b563f5287814e2fa8acf066ad30e256'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:17.098055 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-8bc86f98-c0e0-4b8b-9a2f-ee45e0479226 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b563f5287814e2fa8acf066ad30e256'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:17.108310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-8bc86f98-c0e0-4b8b-9a2f-ee45e0479226 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b563f5287814e2fa8acf066ad30e256'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:17.130413 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1081/2160] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:16 2022] DELETE /identity/v3/users/4b563f5287814e2fa8acf066ad30e256 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:17.643262 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78b444-c4da-4aca-bc83-88438cc449d1 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:17.644792 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-3f78b444-c4da-4aca-bc83-88438cc449d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:17.668794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78b444-c4da-4aca-bc83-88438cc449d1 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:17.673105 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:17.788620 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be12a9-c9f9-4520-a362-14d434fe0b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:17.789666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be12a9-c9f9-4520-a362-14d434fe0b8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:17.789957 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be12a9-c9f9-4520-a362-14d434fe0b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:17.790245 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be12a9-c9f9-4520-a362-14d434fe0b8e admin admin] PATH_INFO: `/v3/projects/ad3432eb44e44dc7ac7495b7f0370117` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:17.791521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be12a9-c9f9-4520-a362-14d434fe0b8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad3432eb44e44dc7ac7495b7f0370117)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:17.793478 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be12a9-c9f9-4520-a362-14d434fe0b8e admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:17.866993 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-96be12a9-c9f9-4520-a362-14d434fe0b8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad3432eb44e44dc7ac7495b7f0370117', 'request_id': 'req-96be12a9-c9f9-4520-a362-14d434fe0b8e'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:17.875703 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-96be12a9-c9f9-4520-a362-14d434fe0b8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad3432eb44e44dc7ac7495b7f0370117', 'request_id': 'req-96be12a9-c9f9-4520-a362-14d434fe0b8e'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:17.884488 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-96be12a9-c9f9-4520-a362-14d434fe0b8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad3432eb44e44dc7ac7495b7f0370117', 'request_id': 'req-96be12a9-c9f9-4520-a362-14d434fe0b8e'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:17.899718 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-96be12a9-c9f9-4520-a362-14d434fe0b8e admin admin] The token cache is being invalidate because project ad3432eb44e44dc7ac7495b7f0370117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:17.900219 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-96be12a9-c9f9-4520-a362-14d434fe0b8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:17.901021 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-96be12a9-c9f9-4520-a362-14d434fe0b8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:17.903617 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1080/2161] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:17 2022] DELETE /identity/v3/projects/ad3432eb44e44dc7ac7495b7f0370117 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:17.908358 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b890da-3029-4adf-9cc2-8f0a7fa35153 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:17.908757 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b890da-3029-4adf-9cc2-8f0a7fa35153 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:17.909177 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b890da-3029-4adf-9cc2-8f0a7fa35153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:17.933547 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-15b890da-3029-4adf-9cc2-8f0a7fa35153 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:17.935055 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-15b890da-3029-4adf-9cc2-8f0a7fa35153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:18.015964 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e62e80-f796-4f6d-be64-04d121b5501c None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:18.017133 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e62e80-f796-4f6d-be64-04d121b5501c None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:18.017133 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e62e80-f796-4f6d-be64-04d121b5501c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:18.039424 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-f1e62e80-f796-4f6d-be64-04d121b5501c None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:18.039712 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1082/2162] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:18.040150 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-f1e62e80-f796-4f6d-be64-04d121b5501c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:18.056337 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1081/2163] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:18.057752 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b890da-3029-4adf-9cc2-8f0a7fa35153 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:18.070115 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b890da-3029-4adf-9cc2-8f0a7fa35153 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:18.080685 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49431d-ca3a-4041-acb6-dbffc2682fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:18.081379 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49431d-ca3a-4041-acb6-dbffc2682fcf admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:18.081665 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49431d-ca3a-4041-acb6-dbffc2682fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:18.081941 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49431d-ca3a-4041-acb6-dbffc2682fcf admin admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:18.085638 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49431d-ca3a-4041-acb6-dbffc2682fcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:22:18.085967 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49431d-ca3a-4041-acb6-dbffc2682fcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:18.087653 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49431d-ca3a-4041-acb6-dbffc2682fcf admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:18.111192 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e62e80-f796-4f6d-be64-04d121b5501c None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:18.117910 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1083/2164] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:22:18.127489 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e62e80-f796-4f6d-be64-04d121b5501c None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:18.138297 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b0bc5-3cd0-4653-89e9-daa15c2234ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:18.139195 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b0bc5-3cd0-4653-89e9-daa15c2234ea admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:18.139939 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b0bc5-3cd0-4653-89e9-daa15c2234ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:18.140586 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b0bc5-3cd0-4653-89e9-daa15c2234ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:18.143049 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b0bc5-3cd0-4653-89e9-daa15c2234ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:18.147703 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b0bc5-3cd0-4653-89e9-daa15c2234ea admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:18.185210 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1082/2165] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:18 2022] POST /identity/v3/projects => generated 391 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:18.189261 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49431d-ca3a-4041-acb6-dbffc2682fcf admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:18.204242 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49431d-ca3a-4041-acb6-dbffc2682fcf admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:18.260870 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:18.296835 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9ad77-375b-461f-b633-41985ec9c62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:18.303220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9ad77-375b-461f-b633-41985ec9c62c admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:18.303220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9ad77-375b-461f-b633-41985ec9c62c admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:18.303220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9ad77-375b-461f-b633-41985ec9c62c admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:18.303220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9ad77-375b-461f-b633-41985ec9c62c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:18.304071 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9ad77-375b-461f-b633-41985ec9c62c admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:18.327104 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3fa4f-b8cb-4f91-9966-4a62714d02d8 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:18.327692 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3fa4f-b8cb-4f91-9966-4a62714d02d8 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:18.328134 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3fa4f-b8cb-4f91-9966-4a62714d02d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:18.339361 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1084/2166] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:18 2022] POST /identity/v3/users => generated 296 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:22:18.340538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9ad77-375b-461f-b633-41985ec9c62c admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:18.353464 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9ad77-375b-461f-b633-41985ec9c62c admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:18.358794 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ac2aa-ae8d-4165-861a-c02bad15cba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:18.359476 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ac2aa-ae8d-4165-861a-c02bad15cba7 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:18.359767 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ac2aa-ae8d-4165-861a-c02bad15cba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:18.360042 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ac2aa-ae8d-4165-861a-c02bad15cba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:18.360864 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ac2aa-ae8d-4165-861a-c02bad15cba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:18.362713 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ac2aa-ae8d-4165-861a-c02bad15cba7 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:18.372020 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-5fa3fa4f-b8cb-4f91-9966-4a62714d02d8 None None] MFA Rules not processed for user `c78b0769644d48aa9a9c03a9a1566dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:18.373695 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-5fa3fa4f-b8cb-4f91-9966-4a62714d02d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:18.378680 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1085/2167] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:18.381940 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ac2aa-ae8d-4165-861a-c02bad15cba7 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:18.395421 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ac2aa-ae8d-4165-861a-c02bad15cba7 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:18.402562 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d27ad-8f96-4766-91f7-3930c52e0b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:18.403283 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d27ad-8f96-4766-91f7-3930c52e0b22 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:18.408367 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d27ad-8f96-4766-91f7-3930c52e0b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:18.408726 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d27ad-8f96-4766-91f7-3930c52e0b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:18.409525 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d27ad-8f96-4766-91f7-3930c52e0b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:18.411234 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d27ad-8f96-4766-91f7-3930c52e0b22 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:18.430695 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1086/2168] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:22:18.433290 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d27ad-8f96-4766-91f7-3930c52e0b22 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:18.444075 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d27ad-8f96-4766-91f7-3930c52e0b22 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:18.448563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d5444-22e4-4012-b6a7-f562a896553c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:18.449468 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d5444-22e4-4012-b6a7-f562a896553c admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:18.449741 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d5444-22e4-4012-b6a7-f562a896553c admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:18.450015 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d5444-22e4-4012-b6a7-f562a896553c admin admin] PATH_INFO: `/v3/projects/921514d331704d378262792ab2028015/users/44a7e9a96eb94aa89214841464586de3/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:18.458424 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:18.474104 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1083/2169] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:18.485082 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d5444-22e4-4012-b6a7-f562a896553c admin admin] RBAC: Authorizing `identity:create_grant(project_id=921514d331704d378262792ab2028015, user_id=44a7e9a96eb94aa89214841464586de3, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:18.485327 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e11cc-e90a-4110-83c6-27f921b82f7e None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:18.485621 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e11cc-e90a-4110-83c6-27f921b82f7e None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:18.485899 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e11cc-e90a-4110-83c6-27f921b82f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:18.489976 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d5444-22e4-4012-b6a7-f562a896553c admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:18.531143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1087/2170] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:18 2022] PUT /identity/v3/projects/921514d331704d378262792ab2028015/users/44a7e9a96eb94aa89214841464586de3/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:22:18.532896 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95152c-99f3-4a4d-895b-1ab10667b020 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:18.533345 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95152c-99f3-4a4d-895b-1ab10667b020 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:18.533776 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95152c-99f3-4a4d-895b-1ab10667b020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:18.548127 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-4b3e11cc-e90a-4110-83c6-27f921b82f7e None None] MFA Rules not processed for user `c78b0769644d48aa9a9c03a9a1566dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:18.549627 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-4b3e11cc-e90a-4110-83c6-27f921b82f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:18.566822 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-ae95152c-99f3-4a4d-895b-1ab10667b020 None None] MFA Rules not processed for user `44a7e9a96eb94aa89214841464586de3`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:18.568157 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-ae95152c-99f3-4a4d-895b-1ab10667b020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:18.624048 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1084/2171] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:22:18.636418 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e11cc-e90a-4110-83c6-27f921b82f7e None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:18.637768 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-4b3e11cc-e90a-4110-83c6-27f921b82f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:18.659137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1088/2172] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:18.671518 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95152c-99f3-4a4d-895b-1ab10667b020 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:18.672945 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-ae95152c-99f3-4a4d-895b-1ab10667b020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:18.735880 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e11cc-e90a-4110-83c6-27f921b82f7e None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:18.742289 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30061d-140a-400f-9967-b9ef0a31cdd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:18.743061 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30061d-140a-400f-9967-b9ef0a31cdd0 service nova] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:18.743571 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30061d-140a-400f-9967-b9ef0a31cdd0 service nova] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:18.743862 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30061d-140a-400f-9967-b9ef0a31cdd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:18.748082 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95152c-99f3-4a4d-895b-1ab10667b020 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:18.754486 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc45c4-723f-4c1b-8e7f-bf719e03051b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:18.754707 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30061d-140a-400f-9967-b9ef0a31cdd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:18.755427 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc45c4-723f-4c1b-8e7f-bf719e03051b service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:18.756316 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc45c4-723f-4c1b-8e7f-bf719e03051b service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:18.756668 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc45c4-723f-4c1b-8e7f-bf719e03051b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:18.757350 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30061d-140a-400f-9967-b9ef0a31cdd0 service nova] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:18.767147 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc45c4-723f-4c1b-8e7f-bf719e03051b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:18.767669 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1085/2173] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:18.769041 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc45c4-723f-4c1b-8e7f-bf719e03051b service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:18.780665 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1089/2174] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:22:19.571902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c8b83-6d78-4403-995e-03ddfea3a9f2 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:19.572968 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c8b83-6d78-4403-995e-03ddfea3a9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:19.573535 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c8b83-6d78-4403-995e-03ddfea3a9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:19.599887 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-717c8b83-6d78-4403-995e-03ddfea3a9f2 None None] MFA Rules not processed for user `c78b0769644d48aa9a9c03a9a1566dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:19.600682 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-717c8b83-6d78-4403-995e-03ddfea3a9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:19.608301 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1086/2175] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:28.775774 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=85,keystone:INSERT=4 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:29.592403 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=63 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:30.491874 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc45c4-723f-4c1b-8e7f-bf719e03051b service cinder] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:30.493362 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-1ecc45c4-723f-4c1b-8e7f-bf719e03051b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:30.559799 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc45c4-723f-4c1b-8e7f-bf719e03051b service cinder] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:30.564386 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6db78f-42f7-46a8-a9cd-986cb4e1f65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:30.565237 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6db78f-42f7-46a8-a9cd-986cb4e1f65b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:30.565678 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6db78f-42f7-46a8-a9cd-986cb4e1f65b admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:30.565963 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6db78f-42f7-46a8-a9cd-986cb4e1f65b admin admin] PATH_INFO: `/v3/users/0ff04ad16b67452b9250f15e24d8c6cb` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:30.567259 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6db78f-42f7-46a8-a9cd-986cb4e1f65b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ff04ad16b67452b9250f15e24d8c6cb)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:30.570113 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6db78f-42f7-46a8-a9cd-986cb4e1f65b admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:30.617749 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-0f6db78f-42f7-46a8-a9cd-986cb4e1f65b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ff04ad16b67452b9250f15e24d8c6cb'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:30.618525 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-0f6db78f-42f7-46a8-a9cd-986cb4e1f65b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ff04ad16b67452b9250f15e24d8c6cb'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:30.635359 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-0f6db78f-42f7-46a8-a9cd-986cb4e1f65b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ff04ad16b67452b9250f15e24d8c6cb'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:30.636103 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-0f6db78f-42f7-46a8-a9cd-986cb4e1f65b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ff04ad16b67452b9250f15e24d8c6cb'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:30.643405 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-0f6db78f-42f7-46a8-a9cd-986cb4e1f65b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ff04ad16b67452b9250f15e24d8c6cb'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:30.657201 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1090/2176] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:30 2022] DELETE /identity/v3/users/0ff04ad16b67452b9250f15e24d8c6cb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:30.662289 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98234a92-41a4-467c-bcd3-9ccdc3f8853e None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:30.662894 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98234a92-41a4-467c-bcd3-9ccdc3f8853e None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:30.662894 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98234a92-41a4-467c-bcd3-9ccdc3f8853e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:30.680707 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-98234a92-41a4-467c-bcd3-9ccdc3f8853e None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:30.681903 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-98234a92-41a4-467c-bcd3-9ccdc3f8853e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:30.754429 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1087/2177] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:30.763865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6db78f-42f7-46a8-a9cd-986cb4e1f65b admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:30.765526 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-0f6db78f-42f7-46a8-a9cd-986cb4e1f65b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:30.833716 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6db78f-42f7-46a8-a9cd-986cb4e1f65b admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:30.837387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a00f7b-ee1f-4b73-9def-3488ae74834d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:30.838043 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a00f7b-ee1f-4b73-9def-3488ae74834d service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:30.838335 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a00f7b-ee1f-4b73-9def-3488ae74834d service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:30.838617 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a00f7b-ee1f-4b73-9def-3488ae74834d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:30.847862 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a00f7b-ee1f-4b73-9def-3488ae74834d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:30.849837 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a00f7b-ee1f-4b73-9def-3488ae74834d service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:30.859514 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1091/2178] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:31.130123 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98234a92-41a4-467c-bcd3-9ccdc3f8853e None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:31.131590 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-98234a92-41a4-467c-bcd3-9ccdc3f8853e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:31.143432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98234a92-41a4-467c-bcd3-9ccdc3f8853e None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:31.148779 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9de022-14ce-4627-a26a-cea240d156c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:31.149643 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9de022-14ce-4627-a26a-cea240d156c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:31.149919 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9de022-14ce-4627-a26a-cea240d156c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:31.150198 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9de022-14ce-4627-a26a-cea240d156c1 admin admin] PATH_INFO: `/v3/projects/a84633df41034a9481e96b5cb40f12e1` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:31.151422 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9de022-14ce-4627-a26a-cea240d156c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a84633df41034a9481e96b5cb40f12e1)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:31.153668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9de022-14ce-4627-a26a-cea240d156c1 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:31.207779 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-9d9de022-14ce-4627-a26a-cea240d156c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a84633df41034a9481e96b5cb40f12e1', 'request_id': 'req-9d9de022-14ce-4627-a26a-cea240d156c1'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:31.214981 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-9d9de022-14ce-4627-a26a-cea240d156c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a84633df41034a9481e96b5cb40f12e1', 'request_id': 'req-9d9de022-14ce-4627-a26a-cea240d156c1'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:31.220600 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-9d9de022-14ce-4627-a26a-cea240d156c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a84633df41034a9481e96b5cb40f12e1', 'request_id': 'req-9d9de022-14ce-4627-a26a-cea240d156c1'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:31.233461 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-9d9de022-14ce-4627-a26a-cea240d156c1 admin admin] The token cache is being invalidate because project a84633df41034a9481e96b5cb40f12e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:31.233771 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-9d9de022-14ce-4627-a26a-cea240d156c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:31.234385 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-9d9de022-14ce-4627-a26a-cea240d156c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:31.235937 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1088/2179] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:31 2022] DELETE /identity/v3/projects/a84633df41034a9481e96b5cb40f12e1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:31.239898 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a00f7b-ee1f-4b73-9def-3488ae74834d service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:31.249440 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a00f7b-ee1f-4b73-9def-3488ae74834d service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:31.267025 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:31.307042 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26199b23-4fff-46b9-af76-eba4da0bde8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:31.307909 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26199b23-4fff-46b9-af76-eba4da0bde8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:31.308188 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26199b23-4fff-46b9-af76-eba4da0bde8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:31.308460 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26199b23-4fff-46b9-af76-eba4da0bde8c admin admin] PATH_INFO: `/v3/users/63cb68fded03459ebe31bfa53819a626` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:31.309640 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26199b23-4fff-46b9-af76-eba4da0bde8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=63cb68fded03459ebe31bfa53819a626)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:31.311600 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26199b23-4fff-46b9-af76-eba4da0bde8c admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:31.362747 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-26199b23-4fff-46b9-af76-eba4da0bde8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63cb68fded03459ebe31bfa53819a626'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:31.363430 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-26199b23-4fff-46b9-af76-eba4da0bde8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63cb68fded03459ebe31bfa53819a626'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:31.379677 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-26199b23-4fff-46b9-af76-eba4da0bde8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63cb68fded03459ebe31bfa53819a626'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:31.379677 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-26199b23-4fff-46b9-af76-eba4da0bde8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63cb68fded03459ebe31bfa53819a626'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:31.385226 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-26199b23-4fff-46b9-af76-eba4da0bde8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63cb68fded03459ebe31bfa53819a626'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:31.400127 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1092/2180] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:31 2022] DELETE /identity/v3/users/63cb68fded03459ebe31bfa53819a626 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:31.675529 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9de022-14ce-4627-a26a-cea240d156c1 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:31.677251 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-9d9de022-14ce-4627-a26a-cea240d156c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:31.700786 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9de022-14ce-4627-a26a-cea240d156c1 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:31.758876 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3de0d7-de65-4126-8eb1-64f299f0e541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:31.759744 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3de0d7-de65-4126-8eb1-64f299f0e541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:31.760032 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3de0d7-de65-4126-8eb1-64f299f0e541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:31.760313 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3de0d7-de65-4126-8eb1-64f299f0e541 admin admin] PATH_INFO: `/v3/projects/009b04aed2c841a0b94decacc07acf83` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:31.761500 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3de0d7-de65-4126-8eb1-64f299f0e541 admin admin] RBAC: Authorizing `identity:delete_project(project_id=009b04aed2c841a0b94decacc07acf83)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:31.763463 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3de0d7-de65-4126-8eb1-64f299f0e541 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:31.797810 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:31.815119 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-9a3de0d7-de65-4126-8eb1-64f299f0e541 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '009b04aed2c841a0b94decacc07acf83', 'request_id': 'req-9a3de0d7-de65-4126-8eb1-64f299f0e541'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:31.821900 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-9a3de0d7-de65-4126-8eb1-64f299f0e541 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '009b04aed2c841a0b94decacc07acf83', 'request_id': 'req-9a3de0d7-de65-4126-8eb1-64f299f0e541'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:31.827456 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-9a3de0d7-de65-4126-8eb1-64f299f0e541 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '009b04aed2c841a0b94decacc07acf83', 'request_id': 'req-9a3de0d7-de65-4126-8eb1-64f299f0e541'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:31.839439 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-9a3de0d7-de65-4126-8eb1-64f299f0e541 admin admin] The token cache is being invalidate because project 009b04aed2c841a0b94decacc07acf83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:31.839728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-9a3de0d7-de65-4126-8eb1-64f299f0e541 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:31.840347 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-9a3de0d7-de65-4126-8eb1-64f299f0e541 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:31.842008 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1089/2181] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:31 2022] DELETE /identity/v3/projects/009b04aed2c841a0b94decacc07acf83 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:31.847452 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54019198-bcf7-4f2f-84b2-603f4ddd6788 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:31.847977 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54019198-bcf7-4f2f-84b2-603f4ddd6788 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:31.848070 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54019198-bcf7-4f2f-84b2-603f4ddd6788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:31.865923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-54019198-bcf7-4f2f-84b2-603f4ddd6788 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:31.867140 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-54019198-bcf7-4f2f-84b2-603f4ddd6788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:31.929171 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1093/2182] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:22:31.936993 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aabb09-14bb-434f-a96a-16214a9bbcb0 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:31.937281 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aabb09-14bb-434f-a96a-16214a9bbcb0 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:31.937559 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aabb09-14bb-434f-a96a-16214a9bbcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:31.957403 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-18aabb09-14bb-434f-a96a-16214a9bbcb0 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:31.958630 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-18aabb09-14bb-434f-a96a-16214a9bbcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:31.966532 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1090/2183] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:31.970836 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54019198-bcf7-4f2f-84b2-603f4ddd6788 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:31.980588 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54019198-bcf7-4f2f-84b2-603f4ddd6788 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:31.985424 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c54df-eb4d-474d-883f-34004c51a29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:31.986251 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c54df-eb4d-474d-883f-34004c51a29e admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:31.986610 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c54df-eb4d-474d-883f-34004c51a29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:31.987001 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c54df-eb4d-474d-883f-34004c51a29e admin admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:31.987742 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c54df-eb4d-474d-883f-34004c51a29e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:22:31.988057 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c54df-eb4d-474d-883f-34004c51a29e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:31.990215 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c54df-eb4d-474d-883f-34004c51a29e admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:32.002211 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1094/2184] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:22:32.007267 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aabb09-14bb-434f-a96a-16214a9bbcb0 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:32.018526 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aabb09-14bb-434f-a96a-16214a9bbcb0 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:32.023511 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32302fe5-d371-4c63-958c-3df6270f67e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:32.024175 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32302fe5-d371-4c63-958c-3df6270f67e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:32.024679 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32302fe5-d371-4c63-958c-3df6270f67e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:32.024959 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32302fe5-d371-4c63-958c-3df6270f67e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:32.025689 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32302fe5-d371-4c63-958c-3df6270f67e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:32.027648 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32302fe5-d371-4c63-958c-3df6270f67e5 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:32.054771 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1091/2185] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:32 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:32.059212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c54df-eb4d-474d-883f-34004c51a29e admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:32.071690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c54df-eb4d-474d-883f-34004c51a29e admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:32.097492 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:32.133193 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f1a96-3f11-4989-8c3a-3cc1b334dd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:32.133864 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f1a96-3f11-4989-8c3a-3cc1b334dd48 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:32.134227 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f1a96-3f11-4989-8c3a-3cc1b334dd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:32.134515 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f1a96-3f11-4989-8c3a-3cc1b334dd48 admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:32.135251 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f1a96-3f11-4989-8c3a-3cc1b334dd48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:32.137182 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f1a96-3f11-4989-8c3a-3cc1b334dd48 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:32.167161 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1095/2186] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:32 2022] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:32.171276 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32302fe5-d371-4c63-958c-3df6270f67e5 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:32.182132 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32302fe5-d371-4c63-958c-3df6270f67e5 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:32.186584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f294dd-99c1-44d9-a9c4-806689aad665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:32.187270 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f294dd-99c1-44d9-a9c4-806689aad665 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:32.187554 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f294dd-99c1-44d9-a9c4-806689aad665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:32.187835 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f294dd-99c1-44d9-a9c4-806689aad665 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:32.188556 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f294dd-99c1-44d9-a9c4-806689aad665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:32.190170 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f294dd-99c1-44d9-a9c4-806689aad665 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:32.200591 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1092/2187] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:32.204497 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f1a96-3f11-4989-8c3a-3cc1b334dd48 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:32.214984 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f1a96-3f11-4989-8c3a-3cc1b334dd48 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:32.220342 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01f58e-7e85-4b0d-aff9-b8a5366b6cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:32.221177 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01f58e-7e85-4b0d-aff9-b8a5366b6cbf admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:32.221411 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01f58e-7e85-4b0d-aff9-b8a5366b6cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:32.221675 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01f58e-7e85-4b0d-aff9-b8a5366b6cbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:32.222519 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01f58e-7e85-4b0d-aff9-b8a5366b6cbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:32.224861 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01f58e-7e85-4b0d-aff9-b8a5366b6cbf admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:32.236115 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1096/2188] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:32.240931 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f294dd-99c1-44d9-a9c4-806689aad665 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:32.250956 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f294dd-99c1-44d9-a9c4-806689aad665 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:32.255536 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bd789-91a6-4d8f-8fba-c182185cd8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:32.256501 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bd789-91a6-4d8f-8fba-c182185cd8a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:32.256680 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bd789-91a6-4d8f-8fba-c182185cd8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:32.256949 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bd789-91a6-4d8f-8fba-c182185cd8a7 admin admin] PATH_INFO: `/v3/projects/561d5877efa141ed9eed84a80c61b034/users/ca9bb6b2bf1e456095e5f5fd48d481c0/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:32.272235 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799bd789-91a6-4d8f-8fba-c182185cd8a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=561d5877efa141ed9eed84a80c61b034, user_id=ca9bb6b2bf1e456095e5f5fd48d481c0, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:32.274956 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799bd789-91a6-4d8f-8fba-c182185cd8a7 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:32.288634 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1093/2189] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:32 2022] PUT /identity/v3/projects/561d5877efa141ed9eed84a80c61b034/users/ca9bb6b2bf1e456095e5f5fd48d481c0/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:32.300051 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f50d6-b470-4b9f-8853-fcc03c6bc499 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:32.300345 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f50d6-b470-4b9f-8853-fcc03c6bc499 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:32.300627 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f50d6-b470-4b9f-8853-fcc03c6bc499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:32.327021 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-fc6f50d6-b470-4b9f-8853-fcc03c6bc499 None None] MFA Rules not processed for user `ca9bb6b2bf1e456095e5f5fd48d481c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:32.328235 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-fc6f50d6-b470-4b9f-8853-fcc03c6bc499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:32.393139 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1097/2190] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:32.397722 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bd789-91a6-4d8f-8fba-c182185cd8a7 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:32.463685 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bd789-91a6-4d8f-8fba-c182185cd8a7 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:32.468788 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5b1ff-a9b6-4fe6-81db-99044103c22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:32.469450 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5b1ff-a9b6-4fe6-81db-99044103c22b admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:32.469737 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5b1ff-a9b6-4fe6-81db-99044103c22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:32.470011 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5b1ff-a9b6-4fe6-81db-99044103c22b admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:32.470745 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5b1ff-a9b6-4fe6-81db-99044103c22b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:32.472675 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5b1ff-a9b6-4fe6-81db-99044103c22b admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:32.497745 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1094/2191] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:32 2022] POST /identity/v3/projects => generated 391 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:32.501908 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f50d6-b470-4b9f-8853-fcc03c6bc499 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:32.515734 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f50d6-b470-4b9f-8853-fcc03c6bc499 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:32.573367 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7246035-56b8-4fe3-9722-2941e9b09081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:32.574046 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7246035-56b8-4fe3-9722-2941e9b09081 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:32.574329 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7246035-56b8-4fe3-9722-2941e9b09081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:32.574608 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7246035-56b8-4fe3-9722-2941e9b09081 admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:32.575331 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7246035-56b8-4fe3-9722-2941e9b09081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:32.577245 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7246035-56b8-4fe3-9722-2941e9b09081 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:32.597473 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1098/2192] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:32 2022] POST /identity/v3/users => generated 302 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:22:32.601737 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5b1ff-a9b6-4fe6-81db-99044103c22b admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:32.615256 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5b1ff-a9b6-4fe6-81db-99044103c22b admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:32.619847 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f4c3d-ed59-44de-b71a-bf2794c67d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:32.620510 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f4c3d-ed59-44de-b71a-bf2794c67d81 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:32.620789 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f4c3d-ed59-44de-b71a-bf2794c67d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:32.621059 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f4c3d-ed59-44de-b71a-bf2794c67d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:32.621774 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f4c3d-ed59-44de-b71a-bf2794c67d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:32.623416 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f4c3d-ed59-44de-b71a-bf2794c67d81 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:32.636289 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1095/2193] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:32.640714 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7246035-56b8-4fe3-9722-2941e9b09081 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:32.650728 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7246035-56b8-4fe3-9722-2941e9b09081 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:32.655635 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345c1cb-cb42-402f-b06f-e60fbf66c637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:32.656516 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345c1cb-cb42-402f-b06f-e60fbf66c637 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:32.656803 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345c1cb-cb42-402f-b06f-e60fbf66c637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:32.657081 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345c1cb-cb42-402f-b06f-e60fbf66c637 admin admin] PATH_INFO: `/v3/projects/972780a28e3847c7bec3088e2b6c4170/users/c71772f51fc4463ebbf7e0c8f5e84e11/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:32.671767 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9345c1cb-cb42-402f-b06f-e60fbf66c637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=972780a28e3847c7bec3088e2b6c4170, user_id=c71772f51fc4463ebbf7e0c8f5e84e11, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:32.674556 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9345c1cb-cb42-402f-b06f-e60fbf66c637 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:32.688829 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1099/2194] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:32 2022] PUT /identity/v3/projects/972780a28e3847c7bec3088e2b6c4170/users/c71772f51fc4463ebbf7e0c8f5e84e11/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:32.693486 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f4c3d-ed59-44de-b71a-bf2794c67d81 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:32.703835 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f4c3d-ed59-44de-b71a-bf2794c67d81 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:32.726812 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:32.766900 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fae519-c87e-4172-a3d5-6ecd7aa389f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:32.767568 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fae519-c87e-4172-a3d5-6ecd7aa389f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:32.767852 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fae519-c87e-4172-a3d5-6ecd7aa389f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:32.768127 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fae519-c87e-4172-a3d5-6ecd7aa389f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:32.768844 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fae519-c87e-4172-a3d5-6ecd7aa389f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:32.770444 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fae519-c87e-4172-a3d5-6ecd7aa389f7 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:32.781298 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1096/2195] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:32.785562 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345c1cb-cb42-402f-b06f-e60fbf66c637 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:32.791125 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:32.797514 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345c1cb-cb42-402f-b06f-e60fbf66c637 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:32.802780 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1090ed-8792-4bd6-903a-b53d36b12a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:32.803653 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1090ed-8792-4bd6-903a-b53d36b12a12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:32.803933 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1090ed-8792-4bd6-903a-b53d36b12a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:32.804221 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1090ed-8792-4bd6-903a-b53d36b12a12 admin admin] PATH_INFO: `/v3/projects/972780a28e3847c7bec3088e2b6c4170/users/c71772f51fc4463ebbf7e0c8f5e84e11/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:32.806146 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1090ed-8792-4bd6-903a-b53d36b12a12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=972780a28e3847c7bec3088e2b6c4170, user_id=c71772f51fc4463ebbf7e0c8f5e84e11, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:32.808819 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1090ed-8792-4bd6-903a-b53d36b12a12 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:32.820121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1100/2196] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:32 2022] PUT /identity/v3/projects/972780a28e3847c7bec3088e2b6c4170/users/c71772f51fc4463ebbf7e0c8f5e84e11/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:32.830748 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c92235-71f4-450d-9185-9ceffb7edec5 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:32.831087 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c92235-71f4-450d-9185-9ceffb7edec5 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:32.831367 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c92235-71f4-450d-9185-9ceffb7edec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:32.857469 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-d9c92235-71f4-450d-9185-9ceffb7edec5 None None] MFA Rules not processed for user `c71772f51fc4463ebbf7e0c8f5e84e11`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:32.858699 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-d9c92235-71f4-450d-9185-9ceffb7edec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:32.932144 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1097/2197] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:32 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:32.943211 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1090ed-8792-4bd6-903a-b53d36b12a12 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:32.944632 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-6f1090ed-8792-4bd6-903a-b53d36b12a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:33.003098 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1090ed-8792-4bd6-903a-b53d36b12a12 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:33.006601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100cd28a-14b2-4412-a8d7-d8257860eb67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:33.007271 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cd28a-14b2-4412-a8d7-d8257860eb67 service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:33.007555 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cd28a-14b2-4412-a8d7-d8257860eb67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:33.007829 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cd28a-14b2-4412-a8d7-d8257860eb67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:33.016610 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100cd28a-14b2-4412-a8d7-d8257860eb67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:33.018059 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100cd28a-14b2-4412-a8d7-d8257860eb67 service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:33.027374 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1101/2198] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:32 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:33.074034 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c92235-71f4-450d-9185-9ceffb7edec5 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:33.075805 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-d9c92235-71f4-450d-9185-9ceffb7edec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:33.090350 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c92235-71f4-450d-9185-9ceffb7edec5 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:33.093933 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd797444-a59a-43cb-a6ac-960ae5eccf77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:33.094577 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd797444-a59a-43cb-a6ac-960ae5eccf77 service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:33.094919 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd797444-a59a-43cb-a6ac-960ae5eccf77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:33.095196 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd797444-a59a-43cb-a6ac-960ae5eccf77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:33.158796 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd797444-a59a-43cb-a6ac-960ae5eccf77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:33.160242 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd797444-a59a-43cb-a6ac-960ae5eccf77 service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:33.169780 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1098/2199] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:37.569227 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100cd28a-14b2-4412-a8d7-d8257860eb67 service cinder] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:37.639697 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100cd28a-14b2-4412-a8d7-d8257860eb67 service cinder] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:37.644474 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6ab2b-ee56-4a2d-959f-e0e0e60a09a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:37.645390 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6ab2b-ee56-4a2d-959f-e0e0e60a09a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:37.645676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6ab2b-ee56-4a2d-959f-e0e0e60a09a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:37.645952 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6ab2b-ee56-4a2d-959f-e0e0e60a09a8 admin admin] PATH_INFO: `/v3/users/ca9bb6b2bf1e456095e5f5fd48d481c0` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:37.648070 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed6ab2b-ee56-4a2d-959f-e0e0e60a09a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca9bb6b2bf1e456095e5f5fd48d481c0)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:37.649192 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed6ab2b-ee56-4a2d-959f-e0e0e60a09a8 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:37.714001 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-3ed6ab2b-ee56-4a2d-959f-e0e0e60a09a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca9bb6b2bf1e456095e5f5fd48d481c0'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:37.714712 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-3ed6ab2b-ee56-4a2d-959f-e0e0e60a09a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca9bb6b2bf1e456095e5f5fd48d481c0'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:37.734765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-3ed6ab2b-ee56-4a2d-959f-e0e0e60a09a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca9bb6b2bf1e456095e5f5fd48d481c0'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:37.735575 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-3ed6ab2b-ee56-4a2d-959f-e0e0e60a09a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca9bb6b2bf1e456095e5f5fd48d481c0'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:37.744639 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-3ed6ab2b-ee56-4a2d-959f-e0e0e60a09a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca9bb6b2bf1e456095e5f5fd48d481c0'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:37.758560 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1102/2200] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:37 2022] DELETE /identity/v3/users/ca9bb6b2bf1e456095e5f5fd48d481c0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:37.763264 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197be7c3-b66b-4d96-9e26-d9dbbe79f72d None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:37.763760 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197be7c3-b66b-4d96-9e26-d9dbbe79f72d None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:37.763864 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197be7c3-b66b-4d96-9e26-d9dbbe79f72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:37.782555 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-197be7c3-b66b-4d96-9e26-d9dbbe79f72d None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:37.783980 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-197be7c3-b66b-4d96-9e26-d9dbbe79f72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:37.840973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:37.868844 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1099/2201] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:37.881040 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6ab2b-ee56-4a2d-959f-e0e0e60a09a8 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:37.882911 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-3ed6ab2b-ee56-4a2d-959f-e0e0e60a09a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:37.909450 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:37.919249 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197be7c3-b66b-4d96-9e26-d9dbbe79f72d None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:37.921221 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-197be7c3-b66b-4d96-9e26-d9dbbe79f72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:37.959915 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197be7c3-b66b-4d96-9e26-d9dbbe79f72d None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:37.965858 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b6ef4-173d-4b96-9a53-51355d1f4a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:37.966706 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b6ef4-173d-4b96-9a53-51355d1f4a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:37.966993 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b6ef4-173d-4b96-9a53-51355d1f4a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:37.967270 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b6ef4-173d-4b96-9a53-51355d1f4a56 admin admin] PATH_INFO: `/v3/users/f62aee4ed2534ed9aeebb056b27fa613` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:37.968535 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b6ef4-173d-4b96-9a53-51355d1f4a56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f62aee4ed2534ed9aeebb056b27fa613)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:37.970834 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b6ef4-173d-4b96-9a53-51355d1f4a56 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:37.974343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6ab2b-ee56-4a2d-959f-e0e0e60a09a8 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:37.978237 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71cb1d-371b-48fe-8f56-01fcd51e0bc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:37.978917 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71cb1d-371b-48fe-8f56-01fcd51e0bc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:37.979204 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71cb1d-371b-48fe-8f56-01fcd51e0bc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:37.979478 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71cb1d-371b-48fe-8f56-01fcd51e0bc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:37.988697 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f71cb1d-371b-48fe-8f56-01fcd51e0bc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:37.990197 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f71cb1d-371b-48fe-8f56-01fcd51e0bc4 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:38.000254 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1103/2202] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:38.021116 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-c52b6ef4-173d-4b96-9a53-51355d1f4a56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f62aee4ed2534ed9aeebb056b27fa613'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:38.021786 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-c52b6ef4-173d-4b96-9a53-51355d1f4a56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f62aee4ed2534ed9aeebb056b27fa613'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:38.034297 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-c52b6ef4-173d-4b96-9a53-51355d1f4a56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f62aee4ed2534ed9aeebb056b27fa613'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:38.043424 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-c52b6ef4-173d-4b96-9a53-51355d1f4a56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f62aee4ed2534ed9aeebb056b27fa613'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:38.044080 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-c52b6ef4-173d-4b96-9a53-51355d1f4a56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f62aee4ed2534ed9aeebb056b27fa613'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:38.060065 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1100/2203] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:37 2022] DELETE /identity/v3/users/f62aee4ed2534ed9aeebb056b27fa613 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:38.064553 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7967b4-585b-4559-9b9e-7f0174f70175 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:38.064914 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7967b4-585b-4559-9b9e-7f0174f70175 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:38.065258 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7967b4-585b-4559-9b9e-7f0174f70175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:38.083855 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-bf7967b4-585b-4559-9b9e-7f0174f70175 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:38.085064 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-bf7967b4-585b-4559-9b9e-7f0174f70175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:38.154415 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1104/2204] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:38.164457 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b6ef4-173d-4b96-9a53-51355d1f4a56 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:38.165892 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-c52b6ef4-173d-4b96-9a53-51355d1f4a56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:38.224348 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b6ef4-173d-4b96-9a53-51355d1f4a56 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:38.227965 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146f44f-f312-4b5c-84f7-c444f043c46d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:38.228616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146f44f-f312-4b5c-84f7-c444f043c46d service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:38.228889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146f44f-f312-4b5c-84f7-c444f043c46d service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:38.229162 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146f44f-f312-4b5c-84f7-c444f043c46d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:38.242838 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146f44f-f312-4b5c-84f7-c444f043c46d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:38.244294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146f44f-f312-4b5c-84f7-c444f043c46d service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:38.253968 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1101/2205] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:38.282927 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7967b4-585b-4559-9b9e-7f0174f70175 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:38.284650 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-bf7967b4-585b-4559-9b9e-7f0174f70175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:38.299524 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7967b4-585b-4559-9b9e-7f0174f70175 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:38.305743 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a75a96-d08f-4bd6-8e0f-34cee2550f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:38.306655 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a75a96-d08f-4bd6-8e0f-34cee2550f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:38.306936 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a75a96-d08f-4bd6-8e0f-34cee2550f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:38.307212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a75a96-d08f-4bd6-8e0f-34cee2550f1a admin admin] PATH_INFO: `/v3/projects/561d5877efa141ed9eed84a80c61b034` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:38.308477 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a75a96-d08f-4bd6-8e0f-34cee2550f1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=561d5877efa141ed9eed84a80c61b034)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:38.310418 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a75a96-d08f-4bd6-8e0f-34cee2550f1a admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:38.362066 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-31a75a96-d08f-4bd6-8e0f-34cee2550f1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '561d5877efa141ed9eed84a80c61b034', 'request_id': 'req-31a75a96-d08f-4bd6-8e0f-34cee2550f1a'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:38.370451 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-31a75a96-d08f-4bd6-8e0f-34cee2550f1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '561d5877efa141ed9eed84a80c61b034', 'request_id': 'req-31a75a96-d08f-4bd6-8e0f-34cee2550f1a'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:38.377129 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-31a75a96-d08f-4bd6-8e0f-34cee2550f1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '561d5877efa141ed9eed84a80c61b034', 'request_id': 'req-31a75a96-d08f-4bd6-8e0f-34cee2550f1a'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:38.388352 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-31a75a96-d08f-4bd6-8e0f-34cee2550f1a admin admin] The token cache is being invalidate because project 561d5877efa141ed9eed84a80c61b034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:38.388634 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-31a75a96-d08f-4bd6-8e0f-34cee2550f1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:38.389292 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-31a75a96-d08f-4bd6-8e0f-34cee2550f1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:38.390912 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1105/2206] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:38 2022] DELETE /identity/v3/projects/561d5877efa141ed9eed84a80c61b034 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:38.394786 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146f44f-f312-4b5c-84f7-c444f043c46d service neutron] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:38.405882 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146f44f-f312-4b5c-84f7-c444f043c46d service neutron] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:38.473151 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45885ec1-8d2b-46cd-b0a2-e5c30387a2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:38.474025 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45885ec1-8d2b-46cd-b0a2-e5c30387a2c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:38.474302 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45885ec1-8d2b-46cd-b0a2-e5c30387a2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:38.474626 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45885ec1-8d2b-46cd-b0a2-e5c30387a2c1 admin admin] PATH_INFO: `/v3/users/c71772f51fc4463ebbf7e0c8f5e84e11` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:38.475796 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45885ec1-8d2b-46cd-b0a2-e5c30387a2c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c71772f51fc4463ebbf7e0c8f5e84e11)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:38.477740 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45885ec1-8d2b-46cd-b0a2-e5c30387a2c1 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:38.479484 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:38.532576 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-45885ec1-8d2b-46cd-b0a2-e5c30387a2c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c71772f51fc4463ebbf7e0c8f5e84e11'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:38.533245 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-45885ec1-8d2b-46cd-b0a2-e5c30387a2c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c71772f51fc4463ebbf7e0c8f5e84e11'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:38.545504 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-45885ec1-8d2b-46cd-b0a2-e5c30387a2c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c71772f51fc4463ebbf7e0c8f5e84e11'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:38.553037 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-45885ec1-8d2b-46cd-b0a2-e5c30387a2c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c71772f51fc4463ebbf7e0c8f5e84e11'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:38.553712 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-45885ec1-8d2b-46cd-b0a2-e5c30387a2c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c71772f51fc4463ebbf7e0c8f5e84e11'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:38.567800 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a75a96-d08f-4bd6-8e0f-34cee2550f1a admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:38.569306 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-31a75a96-d08f-4bd6-8e0f-34cee2550f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:38.571156 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1102/2207] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:38 2022] DELETE /identity/v3/users/c71772f51fc4463ebbf7e0c8f5e84e11 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:38.588067 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a75a96-d08f-4bd6-8e0f-34cee2550f1a admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:38.649120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:38.684962 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f69ba82-d452-4ac2-9f44-2ba0b2269d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:38.686789 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69ba82-d452-4ac2-9f44-2ba0b2269d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:38.687359 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69ba82-d452-4ac2-9f44-2ba0b2269d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:38.688095 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69ba82-d452-4ac2-9f44-2ba0b2269d5b admin admin] PATH_INFO: `/v3/projects/2d795d32687e4e17953001c361a2283a` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:38.689747 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f69ba82-d452-4ac2-9f44-2ba0b2269d5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d795d32687e4e17953001c361a2283a)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:38.691843 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f69ba82-d452-4ac2-9f44-2ba0b2269d5b admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:38.793603 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-8f69ba82-d452-4ac2-9f44-2ba0b2269d5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d795d32687e4e17953001c361a2283a', 'request_id': 'req-8f69ba82-d452-4ac2-9f44-2ba0b2269d5b'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:38.807713 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-8f69ba82-d452-4ac2-9f44-2ba0b2269d5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d795d32687e4e17953001c361a2283a', 'request_id': 'req-8f69ba82-d452-4ac2-9f44-2ba0b2269d5b'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:38.817094 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-8f69ba82-d452-4ac2-9f44-2ba0b2269d5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d795d32687e4e17953001c361a2283a', 'request_id': 'req-8f69ba82-d452-4ac2-9f44-2ba0b2269d5b'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:38.835510 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-8f69ba82-d452-4ac2-9f44-2ba0b2269d5b admin admin] The token cache is being invalidate because project 2d795d32687e4e17953001c361a2283a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:38.835781 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-8f69ba82-d452-4ac2-9f44-2ba0b2269d5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:38.836457 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-8f69ba82-d452-4ac2-9f44-2ba0b2269d5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:38.843379 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1106/2208] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:38 2022] DELETE /identity/v3/projects/2d795d32687e4e17953001c361a2283a => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:22:38.845114 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03f197-9aa7-4b4c-a7be-d7608e4d2388 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:38.845588 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03f197-9aa7-4b4c-a7be-d7608e4d2388 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:38.845688 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03f197-9aa7-4b4c-a7be-d7608e4d2388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:38.866011 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-ff03f197-9aa7-4b4c-a7be-d7608e4d2388 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:38.867498 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-ff03f197-9aa7-4b4c-a7be-d7608e4d2388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:38.945174 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1103/2209] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:38.953139 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b33b5-1ab2-4f55-8d07-6632e00a075e None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:38.953849 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b33b5-1ab2-4f55-8d07-6632e00a075e None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:38.955142 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b33b5-1ab2-4f55-8d07-6632e00a075e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:38.957046 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03f197-9aa7-4b4c-a7be-d7608e4d2388 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:38.959349 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-ff03f197-9aa7-4b4c-a7be-d7608e4d2388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:38.974815 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03f197-9aa7-4b4c-a7be-d7608e4d2388 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:38.984781 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a87f0-8dc6-4e06-afe9-37ed9e288458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:38.986339 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a87f0-8dc6-4e06-afe9-37ed9e288458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:38.986857 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a87f0-8dc6-4e06-afe9-37ed9e288458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:38.987195 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a87f0-8dc6-4e06-afe9-37ed9e288458 admin admin] PATH_INFO: `/v3/projects/972780a28e3847c7bec3088e2b6c4170` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:38.989968 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a87f0-8dc6-4e06-afe9-37ed9e288458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=972780a28e3847c7bec3088e2b6c4170)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:38.990964 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a87f0-8dc6-4e06-afe9-37ed9e288458 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:38.993888 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-8d1b33b5-1ab2-4f55-8d07-6632e00a075e None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:38.995157 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-8d1b33b5-1ab2-4f55-8d07-6632e00a075e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:39.023006 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1107/2210] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:22:39.028894 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b33b5-1ab2-4f55-8d07-6632e00a075e None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:39.044685 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b33b5-1ab2-4f55-8d07-6632e00a075e None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:39.052666 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad36e2-2ae8-441d-b3f3-34a9f504c0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:39.053372 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad36e2-2ae8-441d-b3f3-34a9f504c0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:39.053654 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad36e2-2ae8-441d-b3f3-34a9f504c0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:39.053928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad36e2-2ae8-441d-b3f3-34a9f504c0c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:39.055294 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad36e2-2ae8-441d-b3f3-34a9f504c0c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:22:39.055612 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad36e2-2ae8-441d-b3f3-34a9f504c0c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:39.058299 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad36e2-2ae8-441d-b3f3-34a9f504c0c3 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:39.064988 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a86a87f0-8dc6-4e06-afe9-37ed9e288458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '972780a28e3847c7bec3088e2b6c4170', 'request_id': 'req-a86a87f0-8dc6-4e06-afe9-37ed9e288458'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:39.076702 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a86a87f0-8dc6-4e06-afe9-37ed9e288458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '972780a28e3847c7bec3088e2b6c4170', 'request_id': 'req-a86a87f0-8dc6-4e06-afe9-37ed9e288458'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:39.076970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1108/2211] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:22:39.083706 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad36e2-2ae8-441d-b3f3-34a9f504c0c3 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:39.095460 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a86a87f0-8dc6-4e06-afe9-37ed9e288458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '972780a28e3847c7bec3088e2b6c4170', 'request_id': 'req-a86a87f0-8dc6-4e06-afe9-37ed9e288458'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:39.101596 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad36e2-2ae8-441d-b3f3-34a9f504c0c3 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:39.140691 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a86a87f0-8dc6-4e06-afe9-37ed9e288458 admin admin] The token cache is being invalidate because project 972780a28e3847c7bec3088e2b6c4170 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:39.140982 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a86a87f0-8dc6-4e06-afe9-37ed9e288458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:39.142800 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a86a87f0-8dc6-4e06-afe9-37ed9e288458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:39.146961 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1104/2212] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:38 2022] DELETE /identity/v3/projects/972780a28e3847c7bec3088e2b6c4170 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:39.153411 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a43e7-7c7b-4e9d-a7c0-13ebe00db832 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:39.153775 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a43e7-7c7b-4e9d-a7c0-13ebe00db832 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:39.155007 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a43e7-7c7b-4e9d-a7c0-13ebe00db832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:39.163579 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:39.195643 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-a66a43e7-7c7b-4e9d-a7c0-13ebe00db832 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:39.197364 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-a66a43e7-7c7b-4e9d-a7c0-13ebe00db832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:39.205462 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33509a-a2bd-4d18-8886-a51d810a83a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:39.206143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33509a-a2bd-4d18-8886-a51d810a83a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:39.206428 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33509a-a2bd-4d18-8886-a51d810a83a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:39.206862 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33509a-a2bd-4d18-8886-a51d810a83a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:39.207629 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33509a-a2bd-4d18-8886-a51d810a83a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:39.210557 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33509a-a2bd-4d18-8886-a51d810a83a4 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:39.251122 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1109/2213] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:39 2022] POST /identity/v3/projects => generated 367 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:22:39.255547 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33509a-a2bd-4d18-8886-a51d810a83a4 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:39.257649 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-4a33509a-a2bd-4d18-8886-a51d810a83a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:39.296086 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1105/2214] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:39.303998 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:39.305928 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28481d5d-0d4d-4e0d-9ed0-a07ef1975d01 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:39.306410 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28481d5d-0d4d-4e0d-9ed0-a07ef1975d01 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:39.306759 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28481d5d-0d4d-4e0d-9ed0-a07ef1975d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:39.326062 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-28481d5d-0d4d-4e0d-9ed0-a07ef1975d01 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:39.327391 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-28481d5d-0d4d-4e0d-9ed0-a07ef1975d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:39.342662 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33509a-a2bd-4d18-8886-a51d810a83a4 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:39.348914 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9404af7-98a9-4939-a7f1-e8a2acf43661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:39.349605 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9404af7-98a9-4939-a7f1-e8a2acf43661 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:39.349889 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9404af7-98a9-4939-a7f1-e8a2acf43661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:39.350162 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9404af7-98a9-4939-a7f1-e8a2acf43661 admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:39.351023 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9404af7-98a9-4939-a7f1-e8a2acf43661 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:39.352962 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9404af7-98a9-4939-a7f1-e8a2acf43661 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:39.374350 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1110/2215] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:39 2022] POST /identity/v3/users => generated 284 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:22:39.379639 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9404af7-98a9-4939-a7f1-e8a2acf43661 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:39.389950 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9404af7-98a9-4939-a7f1-e8a2acf43661 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:39.394730 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904c5e6-0626-4759-b2d0-8981ebcff95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:39.395928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904c5e6-0626-4759-b2d0-8981ebcff95a admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:39.396579 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904c5e6-0626-4759-b2d0-8981ebcff95a admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:39.396579 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904c5e6-0626-4759-b2d0-8981ebcff95a admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:39.397312 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904c5e6-0626-4759-b2d0-8981ebcff95a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:39.398951 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904c5e6-0626-4759-b2d0-8981ebcff95a admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:39.407350 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1106/2216] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:39.409901 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1111/2217] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:22:39.412084 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28481d5d-0d4d-4e0d-9ed0-a07ef1975d01 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:39.414166 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904c5e6-0626-4759-b2d0-8981ebcff95a admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:39.421342 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28481d5d-0d4d-4e0d-9ed0-a07ef1975d01 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:39.423819 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904c5e6-0626-4759-b2d0-8981ebcff95a admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:39.426340 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a84855-b0db-4ea6-81c1-bcdfa51b1e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:39.427394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a84855-b0db-4ea6-81c1-bcdfa51b1e1e admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:39.427394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a84855-b0db-4ea6-81c1-bcdfa51b1e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:39.427613 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a84855-b0db-4ea6-81c1-bcdfa51b1e1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:39.428321 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a84855-b0db-4ea6-81c1-bcdfa51b1e1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:22:39.428628 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a84855-b0db-4ea6-81c1-bcdfa51b1e1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:39.429435 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6bcfc-7247-4b55-baf5-f2f9c3a8fcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:39.432963 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6bcfc-7247-4b55-baf5-f2f9c3a8fcb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:39.432963 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6bcfc-7247-4b55-baf5-f2f9c3a8fcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:39.433245 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a84855-b0db-4ea6-81c1-bcdfa51b1e1e admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:39.433344 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6bcfc-7247-4b55-baf5-f2f9c3a8fcb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:39.433344 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d6bcfc-7247-4b55-baf5-f2f9c3a8fcb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:39.433344 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d6bcfc-7247-4b55-baf5-f2f9c3a8fcb0 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:39.448688 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1112/2218] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:22:39.448906 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1107/2219] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:22:39.449958 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6bcfc-7247-4b55-baf5-f2f9c3a8fcb0 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:39.450524 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a84855-b0db-4ea6-81c1-bcdfa51b1e1e admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:39.464909 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6bcfc-7247-4b55-baf5-f2f9c3a8fcb0 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:39.466108 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a84855-b0db-4ea6-81c1-bcdfa51b1e1e admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:39.470319 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c1ecb-e9b4-430d-ae7b-086571c86bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:39.471316 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c1ecb-e9b4-430d-ae7b-086571c86bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:39.471601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c1ecb-e9b4-430d-ae7b-086571c86bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:39.472385 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c1ecb-e9b4-430d-ae7b-086571c86bd6 admin admin] PATH_INFO: `/v3/projects/9bf20c09938648ee9b478fabe6f0202a/users/3bbd836b67ff4cf0b3787e2d0fff67c6/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:39.472493 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff7f32-55fc-4248-a0c0-132fa721b027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:39.472733 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff7f32-55fc-4248-a0c0-132fa721b027 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:39.473012 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff7f32-55fc-4248-a0c0-132fa721b027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:39.473867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff7f32-55fc-4248-a0c0-132fa721b027 admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:39.474567 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff7f32-55fc-4248-a0c0-132fa721b027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:39.477708 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff7f32-55fc-4248-a0c0-132fa721b027 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:39.487923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c1ecb-e9b4-430d-ae7b-086571c86bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bf20c09938648ee9b478fabe6f0202a, user_id=3bbd836b67ff4cf0b3787e2d0fff67c6, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:39.490681 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c1ecb-e9b4-430d-ae7b-086571c86bd6 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:39.505248 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1113/2220] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:39 2022] PUT /identity/v3/projects/9bf20c09938648ee9b478fabe6f0202a/users/3bbd836b67ff4cf0b3787e2d0fff67c6/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:22:39.508667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1108/2221] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:39 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:39.509680 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c1ecb-e9b4-430d-ae7b-086571c86bd6 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:39.517814 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843e9aa-3b18-4361-b5a0-a3f983b2dc98 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:39.518106 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843e9aa-3b18-4361-b5a0-a3f983b2dc98 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:39.518498 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843e9aa-3b18-4361-b5a0-a3f983b2dc98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:39.554166 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-4843e9aa-3b18-4361-b5a0-a3f983b2dc98 None None] MFA Rules not processed for user `3bbd836b67ff4cf0b3787e2d0fff67c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:39.555417 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-4843e9aa-3b18-4361-b5a0-a3f983b2dc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:39.575840 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c1ecb-e9b4-430d-ae7b-086571c86bd6 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:39.618221 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:39.624782 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1109/2222] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:39 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:22:39.636589 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843e9aa-3b18-4361-b5a0-a3f983b2dc98 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:39.638295 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-4843e9aa-3b18-4361-b5a0-a3f983b2dc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:39.644016 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e50a9-03be-47e0-9886-e5f97a1025bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:39.644779 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e50a9-03be-47e0-9886-e5f97a1025bb admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:39.645666 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e50a9-03be-47e0-9886-e5f97a1025bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:39.646049 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e50a9-03be-47e0-9886-e5f97a1025bb admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:39.646892 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e50a9-03be-47e0-9886-e5f97a1025bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:39.648789 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e50a9-03be-47e0-9886-e5f97a1025bb admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:39.673011 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1114/2223] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:39 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:22:39.675618 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e50a9-03be-47e0-9886-e5f97a1025bb admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:39.686003 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e50a9-03be-47e0-9886-e5f97a1025bb admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:39.690844 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7c07b-f8f4-4737-8daf-485aab7aa8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:39.691614 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7c07b-f8f4-4737-8daf-485aab7aa8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:39.692539 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7c07b-f8f4-4737-8daf-485aab7aa8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:39.692936 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7c07b-f8f4-4737-8daf-485aab7aa8e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:39.693797 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7c07b-f8f4-4737-8daf-485aab7aa8e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:39.695450 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7c07b-f8f4-4737-8daf-485aab7aa8e6 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:39.702202 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843e9aa-3b18-4361-b5a0-a3f983b2dc98 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:39.707188 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24dae32-3a83-40a5-9dd5-09a0d392b257 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09d603d756a9484bbf48cfd6d56bdb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:39.708560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dae32-3a83-40a5-9dd5-09a0d392b257 service glance] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:39.709097 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dae32-3a83-40a5-9dd5-09a0d392b257 service glance] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:39.709381 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dae32-3a83-40a5-9dd5-09a0d392b257 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:39.710674 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1115/2224] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:39.714426 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7c07b-f8f4-4737-8daf-485aab7aa8e6 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:39.719290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24dae32-3a83-40a5-9dd5-09a0d392b257 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:39.720711 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:39.720847 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24dae32-3a83-40a5-9dd5-09a0d392b257 service glance] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:39.730759 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1110/2225] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:39 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:22:39.734711 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7c07b-f8f4-4737-8daf-485aab7aa8e6 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:39.741705 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b0a23-59ca-4873-8662-1cb4d86e5fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:39.742562 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b0a23-59ca-4873-8662-1cb4d86e5fcd admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:39.742937 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b0a23-59ca-4873-8662-1cb4d86e5fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:39.743737 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b0a23-59ca-4873-8662-1cb4d86e5fcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:39.744342 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b0a23-59ca-4873-8662-1cb4d86e5fcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:39.746105 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b0a23-59ca-4873-8662-1cb4d86e5fcd admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:39.761904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1116/2226] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:39.765241 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24dae32-3a83-40a5-9dd5-09a0d392b257 service glance] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:39.781063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b0a23-59ca-4873-8662-1cb4d86e5fcd admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:39.783184 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24dae32-3a83-40a5-9dd5-09a0d392b257 service glance] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:39.788530 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c4db6a-6044-48c4-bc27-81f8aed53333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:39.789552 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-b35b0a23-59ca-4873-8662-1cb4d86e5fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:39.791004 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4db6a-6044-48c4-bc27-81f8aed53333 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:39.791222 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4db6a-6044-48c4-bc27-81f8aed53333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:39.791500 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4db6a-6044-48c4-bc27-81f8aed53333 admin admin] PATH_INFO: `/v3/projects/2131873a3a9d4d6290528e44a54de866/users/9bc094267e214559ac68abe834e13b30/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:39.814214 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b0a23-59ca-4873-8662-1cb4d86e5fcd admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:39.818779 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c4db6a-6044-48c4-bc27-81f8aed53333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2131873a3a9d4d6290528e44a54de866, user_id=9bc094267e214559ac68abe834e13b30, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:39.820113 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c01edc-18b4-40ab-a6c0-4f3e7a2155bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:39.821001 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c01edc-18b4-40ab-a6c0-4f3e7a2155bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:39.821344 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c01edc-18b4-40ab-a6c0-4f3e7a2155bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:39.821625 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c01edc-18b4-40ab-a6c0-4f3e7a2155bb admin admin] PATH_INFO: `/v3/users/44a7e9a96eb94aa89214841464586de3` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:39.821844 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c4db6a-6044-48c4-bc27-81f8aed53333 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:39.823049 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c01edc-18b4-40ab-a6c0-4f3e7a2155bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=44a7e9a96eb94aa89214841464586de3)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:39.825306 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c01edc-18b4-40ab-a6c0-4f3e7a2155bb admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:39.845357 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1111/2227] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:39 2022] PUT /identity/v3/projects/2131873a3a9d4d6290528e44a54de866/users/9bc094267e214559ac68abe834e13b30/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:39.856894 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f09521-fb35-4c5b-9034-96a5c4f2224d None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:39.857314 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f09521-fb35-4c5b-9034-96a5c4f2224d None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:39.857776 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f09521-fb35-4c5b-9034-96a5c4f2224d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:39.905046 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-d6f09521-fb35-4c5b-9034-96a5c4f2224d None None] MFA Rules not processed for user `9bc094267e214559ac68abe834e13b30`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:39.906566 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-d6f09521-fb35-4c5b-9034-96a5c4f2224d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:39.908576 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-20c01edc-18b4-40ab-a6c0-4f3e7a2155bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44a7e9a96eb94aa89214841464586de3'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:39.909976 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-20c01edc-18b4-40ab-a6c0-4f3e7a2155bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44a7e9a96eb94aa89214841464586de3'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:39.924662 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-20c01edc-18b4-40ab-a6c0-4f3e7a2155bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44a7e9a96eb94aa89214841464586de3'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:39.925556 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-20c01edc-18b4-40ab-a6c0-4f3e7a2155bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44a7e9a96eb94aa89214841464586de3'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:39.935328 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-20c01edc-18b4-40ab-a6c0-4f3e7a2155bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44a7e9a96eb94aa89214841464586de3'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:39.951891 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1117/2228] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:39 2022] DELETE /identity/v3/users/44a7e9a96eb94aa89214841464586de3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:22:39.956279 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43629b68-0723-46ad-80d8-dd8d6870d701 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:39.956580 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43629b68-0723-46ad-80d8-dd8d6870d701 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:39.956865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43629b68-0723-46ad-80d8-dd8d6870d701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:39.977776 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-43629b68-0723-46ad-80d8-dd8d6870d701 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:39.979014 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-43629b68-0723-46ad-80d8-dd8d6870d701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:39.988403 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1112/2229] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:22:39.993025 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f09521-fb35-4c5b-9034-96a5c4f2224d None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:39.994779 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-d6f09521-fb35-4c5b-9034-96a5c4f2224d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:40.059344 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1118/2230] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:22:40.069822 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43629b68-0723-46ad-80d8-dd8d6870d701 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:40.072265 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-43629b68-0723-46ad-80d8-dd8d6870d701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:40.075728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f09521-fb35-4c5b-9034-96a5c4f2224d None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:40.081903 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b884e1-7929-4c94-b2f4-5cb50193fdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:40.082617 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b884e1-7929-4c94-b2f4-5cb50193fdb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:40.082936 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b884e1-7929-4c94-b2f4-5cb50193fdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:40.084084 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b884e1-7929-4c94-b2f4-5cb50193fdb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:40.084521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b884e1-7929-4c94-b2f4-5cb50193fdb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:40.086916 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b884e1-7929-4c94-b2f4-5cb50193fdb1 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:40.098913 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:40.123760 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1113/2231] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:39 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:22:40.127803 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b884e1-7929-4c94-b2f4-5cb50193fdb1 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:40.150778 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43629b68-0723-46ad-80d8-dd8d6870d701 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:40.173694 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:40.216859 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a7a9b-6a76-4b94-a9e3-cf61f3b2131a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:40.218028 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a7a9b-6a76-4b94-a9e3-cf61f3b2131a service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:40.218145 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a7a9b-6a76-4b94-a9e3-cf61f3b2131a service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:40.218473 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a7a9b-6a76-4b94-a9e3-cf61f3b2131a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:40.264549 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b884e1-7929-4c94-b2f4-5cb50193fdb1 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:40.275763 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a92ab4-9986-4ea1-b166-8359d2b86084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:40.276455 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a92ab4-9986-4ea1-b166-8359d2b86084 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:40.276853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a92ab4-9986-4ea1-b166-8359d2b86084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:40.277280 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a92ab4-9986-4ea1-b166-8359d2b86084 admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:40.278502 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a92ab4-9986-4ea1-b166-8359d2b86084 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:40.281086 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a92ab4-9986-4ea1-b166-8359d2b86084 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:40.294513 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a7a9b-6a76-4b94-a9e3-cf61f3b2131a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:40.297254 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a7a9b-6a76-4b94-a9e3-cf61f3b2131a service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:40.310134 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1119/2232] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:40.310613 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1114/2233] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:40 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:40.315146 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a7a9b-6a76-4b94-a9e3-cf61f3b2131a service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:40.326986 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a7a9b-6a76-4b94-a9e3-cf61f3b2131a service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:40.336654 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8640725-f1aa-40f2-8ac2-86cc5f047033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:40.337498 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8640725-f1aa-40f2-8ac2-86cc5f047033 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:40.337851 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8640725-f1aa-40f2-8ac2-86cc5f047033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:40.338130 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8640725-f1aa-40f2-8ac2-86cc5f047033 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:40.338887 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8640725-f1aa-40f2-8ac2-86cc5f047033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:40.341142 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8640725-f1aa-40f2-8ac2-86cc5f047033 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:40.351618 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1120/2234] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:22:40.355699 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a92ab4-9986-4ea1-b166-8359d2b86084 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:40.369228 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a92ab4-9986-4ea1-b166-8359d2b86084 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:40.373977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae145b98-bffe-4759-94cb-34b2f000b894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:40.374663 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae145b98-bffe-4759-94cb-34b2f000b894 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:40.374957 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae145b98-bffe-4759-94cb-34b2f000b894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:40.375297 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae145b98-bffe-4759-94cb-34b2f000b894 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:40.376070 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae145b98-bffe-4759-94cb-34b2f000b894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:40.377724 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae145b98-bffe-4759-94cb-34b2f000b894 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:40.389185 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1115/2235] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:22:40.393144 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8640725-f1aa-40f2-8ac2-86cc5f047033 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:40.403629 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8640725-f1aa-40f2-8ac2-86cc5f047033 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:40.408897 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df5806-4e40-4bf3-865d-ead2d3aa58c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:40.409786 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df5806-4e40-4bf3-865d-ead2d3aa58c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:40.410077 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df5806-4e40-4bf3-865d-ead2d3aa58c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:40.410353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df5806-4e40-4bf3-865d-ead2d3aa58c1 admin admin] PATH_INFO: `/v3/projects/c7ff1c8630c9439989f35e195eb0791e/users/ca5dd7d0d0024ed6b1b07c778b9683ed/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:40.427755 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df5806-4e40-4bf3-865d-ead2d3aa58c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7ff1c8630c9439989f35e195eb0791e, user_id=ca5dd7d0d0024ed6b1b07c778b9683ed, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:40.430737 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df5806-4e40-4bf3-865d-ead2d3aa58c1 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:40.445659 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1121/2236] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:40 2022] PUT /identity/v3/projects/c7ff1c8630c9439989f35e195eb0791e/users/ca5dd7d0d0024ed6b1b07c778b9683ed/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:40.456228 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45469e7-f955-46b6-9794-637694665d2d None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:40.456518 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45469e7-f955-46b6-9794-637694665d2d None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:40.456801 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45469e7-f955-46b6-9794-637694665d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:40.494777 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-e45469e7-f955-46b6-9794-637694665d2d None None] MFA Rules not processed for user `ca5dd7d0d0024ed6b1b07c778b9683ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:40.495991 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-e45469e7-f955-46b6-9794-637694665d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:40.570492 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1116/2237] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:40.574863 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df5806-4e40-4bf3-865d-ead2d3aa58c1 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:40.639093 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df5806-4e40-4bf3-865d-ead2d3aa58c1 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:40.643851 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300bd9f-2edb-4bf7-84d3-4feb286fdcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:40.644510 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300bd9f-2edb-4bf7-84d3-4feb286fdcc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:40.644795 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300bd9f-2edb-4bf7-84d3-4feb286fdcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:40.645098 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300bd9f-2edb-4bf7-84d3-4feb286fdcc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:40.645799 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9300bd9f-2edb-4bf7-84d3-4feb286fdcc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:40.647752 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9300bd9f-2edb-4bf7-84d3-4feb286fdcc0 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:40.666276 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45469e7-f955-46b6-9794-637694665d2d None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:40.667892 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-e45469e7-f955-46b6-9794-637694665d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:40.679898 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1122/2238] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:40 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:40.683718 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300bd9f-2edb-4bf7-84d3-4feb286fdcc0 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:40.695744 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45469e7-f955-46b6-9794-637694665d2d None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:40.716151 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:40.772735 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300bd9f-2edb-4bf7-84d3-4feb286fdcc0 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:40.777559 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106bb8a-15cb-4fca-8781-8886e83a27fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:40.778236 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf68573-bd51-4ba8-bbfb-38e8097adb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:40.778498 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106bb8a-15cb-4fca-8781-8886e83a27fc admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:40.778818 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106bb8a-15cb-4fca-8781-8886e83a27fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:40.779098 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106bb8a-15cb-4fca-8781-8886e83a27fc admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:40.779411 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf68573-bd51-4ba8-bbfb-38e8097adb50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:40.779756 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf68573-bd51-4ba8-bbfb-38e8097adb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:40.779846 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e106bb8a-15cb-4fca-8781-8886e83a27fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:40.780136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf68573-bd51-4ba8-bbfb-38e8097adb50 admin admin] PATH_INFO: `/v3/projects/921514d331704d378262792ab2028015` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:40.781422 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf68573-bd51-4ba8-bbfb-38e8097adb50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=921514d331704d378262792ab2028015)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:40.781711 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e106bb8a-15cb-4fca-8781-8886e83a27fc admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:40.783527 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf68573-bd51-4ba8-bbfb-38e8097adb50 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:40.785065 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:40.805758 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1123/2239] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:40 2022] POST /identity/v3/users => generated 295 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:22:40.810059 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106bb8a-15cb-4fca-8781-8886e83a27fc admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:40.821620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106bb8a-15cb-4fca-8781-8886e83a27fc admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:40.827343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094234f-b814-4c19-b77a-d4f96b496d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:40.828004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094234f-b814-4c19-b77a-d4f96b496d41 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:40.828296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094234f-b814-4c19-b77a-d4f96b496d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:40.828665 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094234f-b814-4c19-b77a-d4f96b496d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:40.829392 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094234f-b814-4c19-b77a-d4f96b496d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:40.831043 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094234f-b814-4c19-b77a-d4f96b496d41 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:40.837332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-dbf68573-bd51-4ba8-bbfb-38e8097adb50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '921514d331704d378262792ab2028015', 'request_id': 'req-dbf68573-bd51-4ba8-bbfb-38e8097adb50'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:40.842229 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1124/2240] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:22:40.843847 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-dbf68573-bd51-4ba8-bbfb-38e8097adb50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '921514d331704d378262792ab2028015', 'request_id': 'req-dbf68573-bd51-4ba8-bbfb-38e8097adb50'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:40.846618 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094234f-b814-4c19-b77a-d4f96b496d41 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:40.850449 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-dbf68573-bd51-4ba8-bbfb-38e8097adb50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '921514d331704d378262792ab2028015', 'request_id': 'req-dbf68573-bd51-4ba8-bbfb-38e8097adb50'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:40.858103 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094234f-b814-4c19-b77a-d4f96b496d41 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:40.864462 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-dbf68573-bd51-4ba8-bbfb-38e8097adb50 admin admin] The token cache is being invalidate because project 921514d331704d378262792ab2028015 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:40.864838 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-dbf68573-bd51-4ba8-bbfb-38e8097adb50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:40.865583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-dbf68573-bd51-4ba8-bbfb-38e8097adb50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:40.867424 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1117/2241] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:40 2022] DELETE /identity/v3/projects/921514d331704d378262792ab2028015 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:40.872528 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451244f7-2e40-41b0-b129-20e6d3c18cf7 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:40.872820 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451244f7-2e40-41b0-b129-20e6d3c18cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:40.873098 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451244f7-2e40-41b0-b129-20e6d3c18cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:40.892909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-451244f7-2e40-41b0-b129-20e6d3c18cf7 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:40.894234 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-451244f7-2e40-41b0-b129-20e6d3c18cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:40.949431 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96bea9-108f-4203-99b8-98ac07851b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:40.950837 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96bea9-108f-4203-99b8-98ac07851b64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:40.951422 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96bea9-108f-4203-99b8-98ac07851b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:40.952075 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96bea9-108f-4203-99b8-98ac07851b64 admin admin] PATH_INFO: `/v3/projects/b25220c25f73482e81d76840011953db/users/da4737dc770e491d87d18a1c0c8d7267/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:40.970199 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e96bea9-108f-4203-99b8-98ac07851b64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b25220c25f73482e81d76840011953db, user_id=da4737dc770e491d87d18a1c0c8d7267, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:40.973029 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e96bea9-108f-4203-99b8-98ac07851b64 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:40.984158 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1118/2242] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:22:40.986330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca372e-99b2-459b-9cb8-b12918d1f589 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:40.986823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca372e-99b2-459b-9cb8-b12918d1f589 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:40.987157 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca372e-99b2-459b-9cb8-b12918d1f589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:40.997416 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1125/2243] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:40 2022] PUT /identity/v3/projects/b25220c25f73482e81d76840011953db/users/da4737dc770e491d87d18a1c0c8d7267/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:41.002679 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96bea9-108f-4203-99b8-98ac07851b64 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:41.005266 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-4e96bea9-108f-4203-99b8-98ac07851b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:41.008492 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-a9ca372e-99b2-459b-9cb8-b12918d1f589 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:41.009861 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-a9ca372e-99b2-459b-9cb8-b12918d1f589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:41.094503 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1119/2244] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:41.095019 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96bea9-108f-4203-99b8-98ac07851b64 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:41.096358 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca372e-99b2-459b-9cb8-b12918d1f589 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:41.101241 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83740a9d-f6e9-4de9-851d-9139f5455f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:41.102030 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83740a9d-f6e9-4de9-851d-9139f5455f79 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:41.102962 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83740a9d-f6e9-4de9-851d-9139f5455f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:41.103256 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83740a9d-f6e9-4de9-851d-9139f5455f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:41.104012 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83740a9d-f6e9-4de9-851d-9139f5455f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:41.105830 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83740a9d-f6e9-4de9-851d-9139f5455f79 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:41.105933 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca372e-99b2-459b-9cb8-b12918d1f589 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:41.111731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a006d51-00ec-4f9a-85fa-35b005de305c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:41.112400 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a006d51-00ec-4f9a-85fa-35b005de305c admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:41.113186 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a006d51-00ec-4f9a-85fa-35b005de305c admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:41.113568 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a006d51-00ec-4f9a-85fa-35b005de305c admin admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:41.114321 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a006d51-00ec-4f9a-85fa-35b005de305c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:22:41.114953 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a006d51-00ec-4f9a-85fa-35b005de305c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:41.116835 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a006d51-00ec-4f9a-85fa-35b005de305c admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:41.119192 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1126/2245] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:22:41.122535 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83740a9d-f6e9-4de9-851d-9139f5455f79 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:41.134836 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83740a9d-f6e9-4de9-851d-9139f5455f79 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:41.135375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1120/2246] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:22:41.139360 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a006d51-00ec-4f9a-85fa-35b005de305c admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:41.143176 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb0af2-1713-458f-b0c4-ece57d7e7884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:41.144083 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb0af2-1713-458f-b0c4-ece57d7e7884 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:41.144364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb0af2-1713-458f-b0c4-ece57d7e7884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:41.144665 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb0af2-1713-458f-b0c4-ece57d7e7884 admin admin] PATH_INFO: `/v3/projects/b25220c25f73482e81d76840011953db/users/da4737dc770e491d87d18a1c0c8d7267/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:41.147587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb0af2-1713-458f-b0c4-ece57d7e7884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b25220c25f73482e81d76840011953db, user_id=da4737dc770e491d87d18a1c0c8d7267, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:41.150276 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb0af2-1713-458f-b0c4-ece57d7e7884 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:41.159034 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a006d51-00ec-4f9a-85fa-35b005de305c admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:41.166705 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1127/2247] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:41 2022] PUT /identity/v3/projects/b25220c25f73482e81d76840011953db/users/da4737dc770e491d87d18a1c0c8d7267/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:41.173631 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:41.175178 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfc83a-fb4c-4cb1-af40-332dc6052dd6 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:41.175666 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfc83a-fb4c-4cb1-af40-332dc6052dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:41.176123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfc83a-fb4c-4cb1-af40-332dc6052dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:41.186576 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:41.216834 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-2adfc83a-fb4c-4cb1-af40-332dc6052dd6 None None] MFA Rules not processed for user `da4737dc770e491d87d18a1c0c8d7267`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:41.218189 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-2adfc83a-fb4c-4cb1-af40-332dc6052dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:41.223635 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c0bb5-8e5d-4d9c-95db-b3c9cef37576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:41.224314 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c0bb5-8e5d-4d9c-95db-b3c9cef37576 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:41.224615 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c0bb5-8e5d-4d9c-95db-b3c9cef37576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:41.224908 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c0bb5-8e5d-4d9c-95db-b3c9cef37576 admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:41.225598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c0bb5-8e5d-4d9c-95db-b3c9cef37576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:41.227561 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c0bb5-8e5d-4d9c-95db-b3c9cef37576 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:41.258936 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1121/2248] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:41 2022] POST /identity/v3/projects => generated 399 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:22:41.259979 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c0bb5-8e5d-4d9c-95db-b3c9cef37576 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:41.303857 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1128/2249] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:22:41.316094 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfc83a-fb4c-4cb1-af40-332dc6052dd6 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:41.318449 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-2adfc83a-fb4c-4cb1-af40-332dc6052dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:41.334586 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c0bb5-8e5d-4d9c-95db-b3c9cef37576 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:41.339415 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6ec40-ff4f-4a62-9b67-a28c463d6e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:41.340089 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6ec40-ff4f-4a62-9b67-a28c463d6e14 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:41.340388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6ec40-ff4f-4a62-9b67-a28c463d6e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:41.340660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6ec40-ff4f-4a62-9b67-a28c463d6e14 admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:41.341352 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6ec40-ff4f-4a62-9b67-a28c463d6e14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:41.343327 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6ec40-ff4f-4a62-9b67-a28c463d6e14 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:41.362907 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1122/2250] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:41 2022] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:22:41.366870 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6ec40-ff4f-4a62-9b67-a28c463d6e14 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:41.376396 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6ec40-ff4f-4a62-9b67-a28c463d6e14 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:41.381483 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfc83a-fb4c-4cb1-af40-332dc6052dd6 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:41.381684 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8ea0f-25a7-4ee2-91b8-ac99086e6875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:41.382343 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8ea0f-25a7-4ee2-91b8-ac99086e6875 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:41.382628 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8ea0f-25a7-4ee2-91b8-ac99086e6875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:41.382986 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8ea0f-25a7-4ee2-91b8-ac99086e6875 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:41.383647 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8ea0f-25a7-4ee2-91b8-ac99086e6875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:41.385434 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8ea0f-25a7-4ee2-91b8-ac99086e6875 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:41.397373 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1123/2251] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:22:41.401265 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8ea0f-25a7-4ee2-91b8-ac99086e6875 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:41.412590 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8ea0f-25a7-4ee2-91b8-ac99086e6875 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:41.417631 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82a592-d841-425e-b381-9292b61b8f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:41.418454 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82a592-d841-425e-b381-9292b61b8f1f admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:41.418773 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82a592-d841-425e-b381-9292b61b8f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:41.419060 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82a592-d841-425e-b381-9292b61b8f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:41.419789 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b82a592-d841-425e-b381-9292b61b8f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:41.421533 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b82a592-d841-425e-b381-9292b61b8f1f admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:41.432700 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1124/2252] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:22:41.433570 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3021a-4dba-4f33-8cc4-9cb9a282a45e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:41.434233 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3021a-4dba-4f33-8cc4-9cb9a282a45e service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:41.434516 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3021a-4dba-4f33-8cc4-9cb9a282a45e service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:41.434828 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3021a-4dba-4f33-8cc4-9cb9a282a45e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:41.436856 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82a592-d841-425e-b381-9292b61b8f1f admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:41.446778 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82a592-d841-425e-b381-9292b61b8f1f admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:41.452984 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997b8af-9fe6-4721-a214-4d05ef70bd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:41.453880 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997b8af-9fe6-4721-a214-4d05ef70bd9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:41.454301 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997b8af-9fe6-4721-a214-4d05ef70bd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:41.454578 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997b8af-9fe6-4721-a214-4d05ef70bd9e admin admin] PATH_INFO: `/v3/projects/7e2bd275335d42c7a2dfa99518bd23c7/users/b18730b4e1f04e6f97820bf80d13ad62/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:41.472578 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997b8af-9fe6-4721-a214-4d05ef70bd9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e2bd275335d42c7a2dfa99518bd23c7, user_id=b18730b4e1f04e6f97820bf80d13ad62, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:41.476177 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997b8af-9fe6-4721-a214-4d05ef70bd9e admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:41.499046 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1125/2253] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:41 2022] PUT /identity/v3/projects/7e2bd275335d42c7a2dfa99518bd23c7/users/b18730b4e1f04e6f97820bf80d13ad62/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:22:41.511274 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc49c7-18d9-4707-9aaa-dd87e9ce19bc None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:41.512440 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc49c7-18d9-4707-9aaa-dd87e9ce19bc None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:41.512440 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc49c7-18d9-4707-9aaa-dd87e9ce19bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:41.544981 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:41.548929 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3021a-4dba-4f33-8cc4-9cb9a282a45e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:41.549430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-6fbc49c7-18d9-4707-9aaa-dd87e9ce19bc None None] MFA Rules not processed for user `b18730b4e1f04e6f97820bf80d13ad62`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:41.550551 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3021a-4dba-4f33-8cc4-9cb9a282a45e service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:41.550782 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-6fbc49c7-18d9-4707-9aaa-dd87e9ce19bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:41.562528 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1129/2254] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:41 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:22:41.592030 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:41.605863 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3021a-4dba-4f33-8cc4-9cb9a282a45e service cinder] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:41.608260 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-1fa3021a-4dba-4f33-8cc4-9cb9a282a45e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:41.620588 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3021a-4dba-4f33-8cc4-9cb9a282a45e service cinder] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:41.631323 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1126/2255] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:22:41.644090 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc49c7-18d9-4707-9aaa-dd87e9ce19bc None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:41.681072 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50302393-fa0f-48fa-b0bd-8af96d198901 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:41.681881 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50302393-fa0f-48fa-b0bd-8af96d198901 service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:41.682265 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50302393-fa0f-48fa-b0bd-8af96d198901 service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:41.682619 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50302393-fa0f-48fa-b0bd-8af96d198901 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:41.684556 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-50302393-fa0f-48fa-b0bd-8af96d198901 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:41.711521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc49c7-18d9-4707-9aaa-dd87e9ce19bc None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:41.715526 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c36fd-fde4-4534-b1f6-e6db1dabbf16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:41.716170 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c36fd-fde4-4534-b1f6-e6db1dabbf16 service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:41.716454 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c36fd-fde4-4534-b1f6-e6db1dabbf16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:41.716728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c36fd-fde4-4534-b1f6-e6db1dabbf16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:41.730626 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c36fd-fde4-4534-b1f6-e6db1dabbf16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:41.730626 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c36fd-fde4-4534-b1f6-e6db1dabbf16 service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:41.738266 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1127/2256] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:41 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:22:41.753618 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50302393-fa0f-48fa-b0bd-8af96d198901 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:41.755289 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50302393-fa0f-48fa-b0bd-8af96d198901 service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:41.764811 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1130/2257] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:22:48.936535 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c36fd-fde4-4534-b1f6-e6db1dabbf16 service cinder] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:49.047436 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c36fd-fde4-4534-b1f6-e6db1dabbf16 service cinder] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:49.052079 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb2f97-94c2-42b3-a270-4c64473ca356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:49.052940 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb2f97-94c2-42b3-a270-4c64473ca356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:49.053221 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb2f97-94c2-42b3-a270-4c64473ca356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:49.053493 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb2f97-94c2-42b3-a270-4c64473ca356 admin admin] PATH_INFO: `/v3/users/9bc094267e214559ac68abe834e13b30` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:49.054705 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb2f97-94c2-42b3-a270-4c64473ca356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bc094267e214559ac68abe834e13b30)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:49.056630 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb2f97-94c2-42b3-a270-4c64473ca356 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:49.096994 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:49.104222 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-03cb2f97-94c2-42b3-a270-4c64473ca356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bc094267e214559ac68abe834e13b30'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:49.105188 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-03cb2f97-94c2-42b3-a270-4c64473ca356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bc094267e214559ac68abe834e13b30'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:49.117000 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-03cb2f97-94c2-42b3-a270-4c64473ca356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bc094267e214559ac68abe834e13b30'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:49.124625 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-03cb2f97-94c2-42b3-a270-4c64473ca356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bc094267e214559ac68abe834e13b30'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:49.125390 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-03cb2f97-94c2-42b3-a270-4c64473ca356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bc094267e214559ac68abe834e13b30'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:49.137953 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1128/2258] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:48 2022] DELETE /identity/v3/users/9bc094267e214559ac68abe834e13b30 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:49.142478 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840feb5e-76a6-441a-b3fc-c569263c02eb None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:49.142966 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840feb5e-76a6-441a-b3fc-c569263c02eb None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:49.143129 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840feb5e-76a6-441a-b3fc-c569263c02eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:49.190502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-840feb5e-76a6-441a-b3fc-c569263c02eb None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:49.191762 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-840feb5e-76a6-441a-b3fc-c569263c02eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:49.248891 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1131/2259] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:49.258351 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb2f97-94c2-42b3-a270-4c64473ca356 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:49.259813 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-03cb2f97-94c2-42b3-a270-4c64473ca356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:49.361823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb2f97-94c2-42b3-a270-4c64473ca356 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:49.365533 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bea389-c933-4762-92fc-9296fd2a2d9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:49.366237 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bea389-c933-4762-92fc-9296fd2a2d9b service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:49.366516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bea389-c933-4762-92fc-9296fd2a2d9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:49.366816 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bea389-c933-4762-92fc-9296fd2a2d9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:49.376411 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bea389-c933-4762-92fc-9296fd2a2d9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:49.377834 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bea389-c933-4762-92fc-9296fd2a2d9b service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:49.389527 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1129/2260] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:49.670731 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840feb5e-76a6-441a-b3fc-c569263c02eb None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:49.672208 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-840feb5e-76a6-441a-b3fc-c569263c02eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:49.688200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840feb5e-76a6-441a-b3fc-c569263c02eb None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:49.699955 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16779586-5594-42e8-91a1-e92c0865c060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:49.700261 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16779586-5594-42e8-91a1-e92c0865c060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:49.700546 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16779586-5594-42e8-91a1-e92c0865c060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:49.700827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16779586-5594-42e8-91a1-e92c0865c060 admin admin] PATH_INFO: `/v3/projects/2131873a3a9d4d6290528e44a54de866` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:49.703002 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16779586-5594-42e8-91a1-e92c0865c060 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2131873a3a9d4d6290528e44a54de866)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:49.704943 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16779586-5594-42e8-91a1-e92c0865c060 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:49.741550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:49.775694 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-16779586-5594-42e8-91a1-e92c0865c060 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2131873a3a9d4d6290528e44a54de866', 'request_id': 'req-16779586-5594-42e8-91a1-e92c0865c060'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:49.786985 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-16779586-5594-42e8-91a1-e92c0865c060 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2131873a3a9d4d6290528e44a54de866', 'request_id': 'req-16779586-5594-42e8-91a1-e92c0865c060'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:49.794763 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-16779586-5594-42e8-91a1-e92c0865c060 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2131873a3a9d4d6290528e44a54de866', 'request_id': 'req-16779586-5594-42e8-91a1-e92c0865c060'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:49.808230 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-16779586-5594-42e8-91a1-e92c0865c060 admin admin] The token cache is being invalidate because project 2131873a3a9d4d6290528e44a54de866 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:49.808634 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-16779586-5594-42e8-91a1-e92c0865c060 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:49.809366 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-16779586-5594-42e8-91a1-e92c0865c060 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:49.811172 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1132/2261] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:49 2022] DELETE /identity/v3/projects/2131873a3a9d4d6290528e44a54de866 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:49.815461 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bea389-c933-4762-92fc-9296fd2a2d9b service neutron] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:49.828670 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bea389-c933-4762-92fc-9296fd2a2d9b service neutron] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:49.903953 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d271c7-6411-4025-831d-58d94b54aa77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:49.904987 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d271c7-6411-4025-831d-58d94b54aa77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:49.906669 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d271c7-6411-4025-831d-58d94b54aa77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:49.906669 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d271c7-6411-4025-831d-58d94b54aa77 admin admin] PATH_INFO: `/v3/users/ca5dd7d0d0024ed6b1b07c778b9683ed` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:49.907033 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d271c7-6411-4025-831d-58d94b54aa77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca5dd7d0d0024ed6b1b07c778b9683ed)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:49.908861 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d271c7-6411-4025-831d-58d94b54aa77 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:49.937711 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:49.959368 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-c8d271c7-6411-4025-831d-58d94b54aa77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca5dd7d0d0024ed6b1b07c778b9683ed'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:49.959987 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-c8d271c7-6411-4025-831d-58d94b54aa77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca5dd7d0d0024ed6b1b07c778b9683ed'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:49.972068 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-c8d271c7-6411-4025-831d-58d94b54aa77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca5dd7d0d0024ed6b1b07c778b9683ed'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:49.979723 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-c8d271c7-6411-4025-831d-58d94b54aa77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca5dd7d0d0024ed6b1b07c778b9683ed'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:49.980437 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-c8d271c7-6411-4025-831d-58d94b54aa77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca5dd7d0d0024ed6b1b07c778b9683ed'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:49.992688 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1130/2262] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:49 2022] DELETE /identity/v3/users/ca5dd7d0d0024ed6b1b07c778b9683ed => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:50.265749 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16779586-5594-42e8-91a1-e92c0865c060 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:50.267249 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-16779586-5594-42e8-91a1-e92c0865c060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:50.283866 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16779586-5594-42e8-91a1-e92c0865c060 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:50.342065 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19d2c5-63a4-4eef-9c92-277d9f97b763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:50.342963 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19d2c5-63a4-4eef-9c92-277d9f97b763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:50.343248 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19d2c5-63a4-4eef-9c92-277d9f97b763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:50.343523 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19d2c5-63a4-4eef-9c92-277d9f97b763 admin admin] PATH_INFO: `/v3/projects/c7ff1c8630c9439989f35e195eb0791e` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:50.344694 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19d2c5-63a4-4eef-9c92-277d9f97b763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7ff1c8630c9439989f35e195eb0791e)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:50.346611 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19d2c5-63a4-4eef-9c92-277d9f97b763 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:50.391578 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-4d19d2c5-63a4-4eef-9c92-277d9f97b763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7ff1c8630c9439989f35e195eb0791e', 'request_id': 'req-4d19d2c5-63a4-4eef-9c92-277d9f97b763'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:50.399868 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-4d19d2c5-63a4-4eef-9c92-277d9f97b763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7ff1c8630c9439989f35e195eb0791e', 'request_id': 'req-4d19d2c5-63a4-4eef-9c92-277d9f97b763'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:50.406320 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-4d19d2c5-63a4-4eef-9c92-277d9f97b763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7ff1c8630c9439989f35e195eb0791e', 'request_id': 'req-4d19d2c5-63a4-4eef-9c92-277d9f97b763'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:50.417238 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-4d19d2c5-63a4-4eef-9c92-277d9f97b763 admin admin] The token cache is being invalidate because project c7ff1c8630c9439989f35e195eb0791e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:50.417521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-4d19d2c5-63a4-4eef-9c92-277d9f97b763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:50.418150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-4d19d2c5-63a4-4eef-9c92-277d9f97b763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:50.419703 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1133/2263] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:50 2022] DELETE /identity/v3/projects/c7ff1c8630c9439989f35e195eb0791e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:50.423861 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d271c7-6411-4025-831d-58d94b54aa77 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:50.425252 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-c8d271c7-6411-4025-831d-58d94b54aa77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:50.440981 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d271c7-6411-4025-831d-58d94b54aa77 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:50.501453 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837231a-2b63-4eb6-b141-e483ee4ed839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:50.502357 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837231a-2b63-4eb6-b141-e483ee4ed839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:50.502680 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837231a-2b63-4eb6-b141-e483ee4ed839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:50.502941 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837231a-2b63-4eb6-b141-e483ee4ed839 admin admin] PATH_INFO: `/v3/users/da4737dc770e491d87d18a1c0c8d7267` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:50.504191 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837231a-2b63-4eb6-b141-e483ee4ed839 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da4737dc770e491d87d18a1c0c8d7267)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:50.506134 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837231a-2b63-4eb6-b141-e483ee4ed839 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:50.554754 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a837231a-2b63-4eb6-b141-e483ee4ed839 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da4737dc770e491d87d18a1c0c8d7267'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:50.555415 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a837231a-2b63-4eb6-b141-e483ee4ed839 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da4737dc770e491d87d18a1c0c8d7267'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:50.567270 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a837231a-2b63-4eb6-b141-e483ee4ed839 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da4737dc770e491d87d18a1c0c8d7267'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:50.575591 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a837231a-2b63-4eb6-b141-e483ee4ed839 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da4737dc770e491d87d18a1c0c8d7267'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:50.576455 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a837231a-2b63-4eb6-b141-e483ee4ed839 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da4737dc770e491d87d18a1c0c8d7267'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:50.591604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1131/2264] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:50 2022] DELETE /identity/v3/users/da4737dc770e491d87d18a1c0c8d7267 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:22:50.874434 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19d2c5-63a4-4eef-9c92-277d9f97b763 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:50.875955 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-4d19d2c5-63a4-4eef-9c92-277d9f97b763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:50.889710 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19d2c5-63a4-4eef-9c92-277d9f97b763 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:50.944047 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:50.945688 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837231a-2b63-4eb6-b141-e483ee4ed839 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:50.947229 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-a837231a-2b63-4eb6-b141-e483ee4ed839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:50.978588 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4111a2-36f2-453e-bb61-bc3be73f1228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:50.980001 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:50.980279 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4111a2-36f2-453e-bb61-bc3be73f1228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:50.980572 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4111a2-36f2-453e-bb61-bc3be73f1228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:50.980853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4111a2-36f2-453e-bb61-bc3be73f1228 admin admin] PATH_INFO: `/v3/projects/b25220c25f73482e81d76840011953db` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:50.982601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4111a2-36f2-453e-bb61-bc3be73f1228 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b25220c25f73482e81d76840011953db)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:50.985036 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4111a2-36f2-453e-bb61-bc3be73f1228 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:51.024597 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837231a-2b63-4eb6-b141-e483ee4ed839 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:51.042440 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-fc4111a2-36f2-453e-bb61-bc3be73f1228 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b25220c25f73482e81d76840011953db', 'request_id': 'req-fc4111a2-36f2-453e-bb61-bc3be73f1228'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:51.053038 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-fc4111a2-36f2-453e-bb61-bc3be73f1228 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b25220c25f73482e81d76840011953db', 'request_id': 'req-fc4111a2-36f2-453e-bb61-bc3be73f1228'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:51.059902 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-fc4111a2-36f2-453e-bb61-bc3be73f1228 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b25220c25f73482e81d76840011953db', 'request_id': 'req-fc4111a2-36f2-453e-bb61-bc3be73f1228'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:51.083856 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-fc4111a2-36f2-453e-bb61-bc3be73f1228 admin admin] The token cache is being invalidate because project b25220c25f73482e81d76840011953db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:51.083856 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-fc4111a2-36f2-453e-bb61-bc3be73f1228 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:51.084720 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-fc4111a2-36f2-453e-bb61-bc3be73f1228 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:51.086618 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1134/2265] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:50 2022] DELETE /identity/v3/projects/b25220c25f73482e81d76840011953db => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:51.092239 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd2c92-64a9-476c-95a2-9f3cfd0961de None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:51.092532 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd2c92-64a9-476c-95a2-9f3cfd0961de None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:51.092817 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd2c92-64a9-476c-95a2-9f3cfd0961de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:51.105130 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d24e9b-65dc-40b7-8e69-d79d1612c078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:51.106089 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d24e9b-65dc-40b7-8e69-d79d1612c078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:51.106439 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d24e9b-65dc-40b7-8e69-d79d1612c078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:51.107375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d24e9b-65dc-40b7-8e69-d79d1612c078 admin admin] PATH_INFO: `/v3/users/b18730b4e1f04e6f97820bf80d13ad62` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:51.108056 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d24e9b-65dc-40b7-8e69-d79d1612c078 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b18730b4e1f04e6f97820bf80d13ad62)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:51.110107 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d24e9b-65dc-40b7-8e69-d79d1612c078 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:51.138995 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-fdfd2c92-64a9-476c-95a2-9f3cfd0961de None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:51.140400 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-fdfd2c92-64a9-476c-95a2-9f3cfd0961de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:51.149522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1135/2266] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:22:51.157897 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea69c4-92e1-445a-89b9-74a43ab42494 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:51.158193 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea69c4-92e1-445a-89b9-74a43ab42494 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:51.158470 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea69c4-92e1-445a-89b9-74a43ab42494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:51.169074 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-61d24e9b-65dc-40b7-8e69-d79d1612c078 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b18730b4e1f04e6f97820bf80d13ad62'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:51.170153 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-61d24e9b-65dc-40b7-8e69-d79d1612c078 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b18730b4e1f04e6f97820bf80d13ad62'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:51.181500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-4bea69c4-92e1-445a-89b9-74a43ab42494 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:51.183037 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-4bea69c4-92e1-445a-89b9-74a43ab42494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:51.189947 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-61d24e9b-65dc-40b7-8e69-d79d1612c078 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b18730b4e1f04e6f97820bf80d13ad62'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:51.192788 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1136/2267] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:22:51.197285 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea69c4-92e1-445a-89b9-74a43ab42494 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:51.198859 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-61d24e9b-65dc-40b7-8e69-d79d1612c078 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b18730b4e1f04e6f97820bf80d13ad62'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:51.199519 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-61d24e9b-65dc-40b7-8e69-d79d1612c078 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b18730b4e1f04e6f97820bf80d13ad62'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:51.207174 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea69c4-92e1-445a-89b9-74a43ab42494 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:51.212122 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb21bd7-391f-4ef1-bc02-3c1cc322fa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:51.212991 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb21bd7-391f-4ef1-bc02-3c1cc322fa65 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:51.213279 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb21bd7-391f-4ef1-bc02-3c1cc322fa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:51.213824 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1132/2268] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:50 2022] DELETE /identity/v3/users/b18730b4e1f04e6f97820bf80d13ad62 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:22:51.217156 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb21bd7-391f-4ef1-bc02-3c1cc322fa65 admin admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:51.218043 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb21bd7-391f-4ef1-bc02-3c1cc322fa65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:22:51.218353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb21bd7-391f-4ef1-bc02-3c1cc322fa65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:51.218810 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d8dfa-67a4-4e13-b7f2-3f351359c681 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:51.219570 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d8dfa-67a4-4e13-b7f2-3f351359c681 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:51.219861 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d8dfa-67a4-4e13-b7f2-3f351359c681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:51.220133 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb21bd7-391f-4ef1-bc02-3c1cc322fa65 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:51.238110 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1137/2269] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:22:51.240143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb21bd7-391f-4ef1-bc02-3c1cc322fa65 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:51.244583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-609d8dfa-67a4-4e13-b7f2-3f351359c681 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:51.245777 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-609d8dfa-67a4-4e13-b7f2-3f351359c681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:51.250767 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb21bd7-391f-4ef1-bc02-3c1cc322fa65 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:51.303380 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:51.315161 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95be244-837c-4a32-ba28-e0ac76f049ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:51.315994 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95be244-837c-4a32-ba28-e0ac76f049ee admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:51.316383 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95be244-837c-4a32-ba28-e0ac76f049ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:51.316803 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95be244-837c-4a32-ba28-e0ac76f049ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:51.317569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95be244-837c-4a32-ba28-e0ac76f049ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:51.319551 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95be244-837c-4a32-ba28-e0ac76f049ee admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:51.330615 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1133/2270] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:22:51.357042 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1138/2271] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:51 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:22:51.359215 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d8dfa-67a4-4e13-b7f2-3f351359c681 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:51.361642 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-609d8dfa-67a4-4e13-b7f2-3f351359c681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:51.367593 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95be244-837c-4a32-ba28-e0ac76f049ee admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:51.387259 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:51.445493 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d8dfa-67a4-4e13-b7f2-3f351359c681 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:51.465213 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95be244-837c-4a32-ba28-e0ac76f049ee admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:51.471857 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba47d49-5854-4b74-bbab-a3de3ec6549c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:51.472621 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba47d49-5854-4b74-bbab-a3de3ec6549c admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:51.473597 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba47d49-5854-4b74-bbab-a3de3ec6549c admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:51.473888 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba47d49-5854-4b74-bbab-a3de3ec6549c admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:51.474592 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba47d49-5854-4b74-bbab-a3de3ec6549c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:51.476577 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba47d49-5854-4b74-bbab-a3de3ec6549c admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:51.502663 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1139/2272] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:51 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:51.503791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b60c89-f92e-4331-a91f-4b97ea5d3c35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:51.504597 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b60c89-f92e-4331-a91f-4b97ea5d3c35 service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:51.504931 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b60c89-f92e-4331-a91f-4b97ea5d3c35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:51.505235 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b60c89-f92e-4331-a91f-4b97ea5d3c35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:51.505851 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba47d49-5854-4b74-bbab-a3de3ec6549c admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:51.515066 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b60c89-f92e-4331-a91f-4b97ea5d3c35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:51.516520 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b60c89-f92e-4331-a91f-4b97ea5d3c35 service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:51.517906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba47d49-5854-4b74-bbab-a3de3ec6549c admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:51.523454 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc35180-18e1-482c-aaf8-b4de03752beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:51.526072 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc35180-18e1-482c-aaf8-b4de03752beb admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:51.526484 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc35180-18e1-482c-aaf8-b4de03752beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:51.526863 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc35180-18e1-482c-aaf8-b4de03752beb admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:51.528003 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc35180-18e1-482c-aaf8-b4de03752beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:51.529691 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc35180-18e1-482c-aaf8-b4de03752beb admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:51.537185 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1134/2273] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:22:51.542491 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1140/2274] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:51.546359 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b60c89-f92e-4331-a91f-4b97ea5d3c35 service neutron] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:51.557146 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b60c89-f92e-4331-a91f-4b97ea5d3c35 service neutron] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:51.564209 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea0d90-2bbb-4757-ae65-00db0bf3496e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:51.564891 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea0d90-2bbb-4757-ae65-00db0bf3496e admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:51.565183 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea0d90-2bbb-4757-ae65-00db0bf3496e admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:51.565444 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea0d90-2bbb-4757-ae65-00db0bf3496e admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:51.566184 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea0d90-2bbb-4757-ae65-00db0bf3496e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:51.567882 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea0d90-2bbb-4757-ae65-00db0bf3496e admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:51.582826 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1135/2275] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:22:51.583589 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc35180-18e1-482c-aaf8-b4de03752beb admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:51.595070 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc35180-18e1-482c-aaf8-b4de03752beb admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:51.599741 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05a8c9-9990-4f2c-95c4-d83f82e9d78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:51.600639 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05a8c9-9990-4f2c-95c4-d83f82e9d78f admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:51.600925 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05a8c9-9990-4f2c-95c4-d83f82e9d78f admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:51.601203 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05a8c9-9990-4f2c-95c4-d83f82e9d78f admin admin] PATH_INFO: `/v3/projects/0a317a226f0e4a76b15aa4c54a74468f/users/9a659c6815154775bd47c7eec4fb42da/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:51.616708 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05a8c9-9990-4f2c-95c4-d83f82e9d78f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a317a226f0e4a76b15aa4c54a74468f, user_id=9a659c6815154775bd47c7eec4fb42da, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:51.619456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05a8c9-9990-4f2c-95c4-d83f82e9d78f admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:51.634520 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1141/2276] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:51 2022] PUT /identity/v3/projects/0a317a226f0e4a76b15aa4c54a74468f/users/9a659c6815154775bd47c7eec4fb42da/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:51.647605 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26059257-edbb-44a9-bd64-6c83799ac24c None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:51.647899 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26059257-edbb-44a9-bd64-6c83799ac24c None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:51.648185 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26059257-edbb-44a9-bd64-6c83799ac24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:51.676206 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-26059257-edbb-44a9-bd64-6c83799ac24c None None] MFA Rules not processed for user `9a659c6815154775bd47c7eec4fb42da`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:51.677504 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-26059257-edbb-44a9-bd64-6c83799ac24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:51.747698 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1136/2277] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:51.752098 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05a8c9-9990-4f2c-95c4-d83f82e9d78f admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:51.819598 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05a8c9-9990-4f2c-95c4-d83f82e9d78f admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:51.825121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ee29e-4abf-4b55-9872-21e5447546c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:51.825874 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ee29e-4abf-4b55-9872-21e5447546c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:51.826233 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ee29e-4abf-4b55-9872-21e5447546c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:51.826578 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ee29e-4abf-4b55-9872-21e5447546c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:51.827396 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ee29e-4abf-4b55-9872-21e5447546c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:51.829674 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ee29e-4abf-4b55-9872-21e5447546c5 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:51.878017 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1142/2278] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:51 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:22:51.878600 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26059257-edbb-44a9-bd64-6c83799ac24c None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:51.889889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26059257-edbb-44a9-bd64-6c83799ac24c None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:51.919503 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:51.959109 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f89e11-b4c1-4b32-9566-1af92e7ba8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:51.960812 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f89e11-b4c1-4b32-9566-1af92e7ba8e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:51.960949 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f89e11-b4c1-4b32-9566-1af92e7ba8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:51.961621 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f89e11-b4c1-4b32-9566-1af92e7ba8e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:51.963070 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f89e11-b4c1-4b32-9566-1af92e7ba8e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:51.965770 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f89e11-b4c1-4b32-9566-1af92e7ba8e6 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:51.994187 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1137/2279] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:51 2022] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:51.995658 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ee29e-4abf-4b55-9872-21e5447546c5 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:52.007593 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ee29e-4abf-4b55-9872-21e5447546c5 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:52.015847 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e9eb9-f00e-47cb-b851-e8f23dacd976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:52.016757 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e9eb9-f00e-47cb-b851-e8f23dacd976 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:52.016992 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e9eb9-f00e-47cb-b851-e8f23dacd976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:52.017343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e9eb9-f00e-47cb-b851-e8f23dacd976 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:52.018146 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e9eb9-f00e-47cb-b851-e8f23dacd976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:52.020593 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e9eb9-f00e-47cb-b851-e8f23dacd976 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:52.033754 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1143/2280] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:52.034885 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f89e11-b4c1-4b32-9566-1af92e7ba8e6 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:52.038872 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e9eb9-f00e-47cb-b851-e8f23dacd976 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:52.038959 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-47f89e11-b4c1-4b32-9566-1af92e7ba8e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:52.051036 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e9eb9-f00e-47cb-b851-e8f23dacd976 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:52.055825 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f89e11-b4c1-4b32-9566-1af92e7ba8e6 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:52.060570 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e982c3-93a5-4d80-bbce-6b496770f639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:52.061454 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e982c3-93a5-4d80-bbce-6b496770f639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:52.061740 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e982c3-93a5-4d80-bbce-6b496770f639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:52.062022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e982c3-93a5-4d80-bbce-6b496770f639 admin admin] PATH_INFO: `/v3/projects/7e2bd275335d42c7a2dfa99518bd23c7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:52.063357 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d8968-b9c9-495e-ba1c-a08f58c75b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:52.063502 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e982c3-93a5-4d80-bbce-6b496770f639 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e2bd275335d42c7a2dfa99518bd23c7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:52.064337 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d8968-b9c9-495e-ba1c-a08f58c75b1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:52.064711 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d8968-b9c9-495e-ba1c-a08f58c75b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:52.065231 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d8968-b9c9-495e-ba1c-a08f58c75b1d admin admin] PATH_INFO: `/v3/projects/1ab4068c537a4fc69b58e4c76348445c/users/72813b786a09451c8532f44b0fe885d5/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:52.065363 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e982c3-93a5-4d80-bbce-6b496770f639 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:52.084700 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d8968-b9c9-495e-ba1c-a08f58c75b1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ab4068c537a4fc69b58e4c76348445c, user_id=72813b786a09451c8532f44b0fe885d5, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:52.087692 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d8968-b9c9-495e-ba1c-a08f58c75b1d admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:52.102450 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1144/2281] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:52 2022] PUT /identity/v3/projects/1ab4068c537a4fc69b58e4c76348445c/users/72813b786a09451c8532f44b0fe885d5/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:52.106568 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d8968-b9c9-495e-ba1c-a08f58c75b1d admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:52.119743 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-b8e982c3-93a5-4d80-bbce-6b496770f639 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e2bd275335d42c7a2dfa99518bd23c7', 'request_id': 'req-b8e982c3-93a5-4d80-bbce-6b496770f639'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:52.124629 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:52.126400 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-b8e982c3-93a5-4d80-bbce-6b496770f639 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e2bd275335d42c7a2dfa99518bd23c7', 'request_id': 'req-b8e982c3-93a5-4d80-bbce-6b496770f639'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:52.133513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-b8e982c3-93a5-4d80-bbce-6b496770f639 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e2bd275335d42c7a2dfa99518bd23c7', 'request_id': 'req-b8e982c3-93a5-4d80-bbce-6b496770f639'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:52.146351 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-b8e982c3-93a5-4d80-bbce-6b496770f639 admin admin] The token cache is being invalidate because project 7e2bd275335d42c7a2dfa99518bd23c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:52.146659 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-b8e982c3-93a5-4d80-bbce-6b496770f639 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:52.147414 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-b8e982c3-93a5-4d80-bbce-6b496770f639 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:52.148988 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1138/2282] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:52 2022] DELETE /identity/v3/projects/7e2bd275335d42c7a2dfa99518bd23c7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:22:52.154591 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a2d9f-9ecf-43ab-b890-a4b7cd3583a6 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:52.154939 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a2d9f-9ecf-43ab-b890-a4b7cd3583a6 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:52.155546 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a2d9f-9ecf-43ab-b890-a4b7cd3583a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:52.175526 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-e47a2d9f-9ecf-43ab-b890-a4b7cd3583a6 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:52.176156 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d8968-b9c9-495e-ba1c-a08f58c75b1d admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:52.177424 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-e47a2d9f-9ecf-43ab-b890-a4b7cd3583a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:52.236765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18fb3e-2092-48c2-bffc-0cccdb2b8418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:52.237556 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18fb3e-2092-48c2-bffc-0cccdb2b8418 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:52.237909 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18fb3e-2092-48c2-bffc-0cccdb2b8418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:52.238277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18fb3e-2092-48c2-bffc-0cccdb2b8418 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:52.239107 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18fb3e-2092-48c2-bffc-0cccdb2b8418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:52.240830 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18fb3e-2092-48c2-bffc-0cccdb2b8418 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:52.241366 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1139/2283] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:22:52.249182 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b8988-b84b-4fce-8e51-00db67ad710d None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:52.249477 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b8988-b84b-4fce-8e51-00db67ad710d None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:52.249913 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b8988-b84b-4fce-8e51-00db67ad710d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:52.252855 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1145/2284] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:52.256844 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18fb3e-2092-48c2-bffc-0cccdb2b8418 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:52.258649 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-fd18fb3e-2092-48c2-bffc-0cccdb2b8418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:52.267735 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-836b8988-b84b-4fce-8e51-00db67ad710d None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:52.268942 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-836b8988-b84b-4fce-8e51-00db67ad710d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:52.271482 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18fb3e-2092-48c2-bffc-0cccdb2b8418 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:52.276240 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faaee08-8794-4b26-ba84-a323a4ed7333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:52.277109 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faaee08-8794-4b26-ba84-a323a4ed7333 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:52.277392 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1140/2285] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:22:52.277531 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faaee08-8794-4b26-ba84-a323a4ed7333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:52.277907 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faaee08-8794-4b26-ba84-a323a4ed7333 admin admin] PATH_INFO: `/v3/projects/1ab4068c537a4fc69b58e4c76348445c/users/72813b786a09451c8532f44b0fe885d5/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:52.279943 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faaee08-8794-4b26-ba84-a323a4ed7333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ab4068c537a4fc69b58e4c76348445c, user_id=72813b786a09451c8532f44b0fe885d5, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:52.281628 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b8988-b84b-4fce-8e51-00db67ad710d None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:52.282616 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faaee08-8794-4b26-ba84-a323a4ed7333 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:52.291576 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b8988-b84b-4fce-8e51-00db67ad710d None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:52.294041 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1146/2286] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:52 2022] PUT /identity/v3/projects/1ab4068c537a4fc69b58e4c76348445c/users/72813b786a09451c8532f44b0fe885d5/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:22:52.327443 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:52.366557 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f90c26-1f71-4d00-9857-cc587a351ded None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:52.367174 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f90c26-1f71-4d00-9857-cc587a351ded None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:52.367174 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f90c26-1f71-4d00-9857-cc587a351ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:52.370445 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074de1f-684b-45c2-8f5a-b9f93761f4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:52.374969 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074de1f-684b-45c2-8f5a-b9f93761f4ae admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:52.375414 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074de1f-684b-45c2-8f5a-b9f93761f4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:52.375802 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074de1f-684b-45c2-8f5a-b9f93761f4ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:52.376660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074de1f-684b-45c2-8f5a-b9f93761f4ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:22:52.377075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074de1f-684b-45c2-8f5a-b9f93761f4ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:52.379501 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074de1f-684b-45c2-8f5a-b9f93761f4ae admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:52.392002 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1141/2287] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:22:52.396708 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074de1f-684b-45c2-8f5a-b9f93761f4ae admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:52.399003 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-95f90c26-1f71-4d00-9857-cc587a351ded None None] MFA Rules not processed for user `72813b786a09451c8532f44b0fe885d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:52.400304 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-95f90c26-1f71-4d00-9857-cc587a351ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:52.406657 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074de1f-684b-45c2-8f5a-b9f93761f4ae admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:52.411851 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd39e6c-00c9-423a-b7b6-4d6a6c8ba716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:52.412507 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd39e6c-00c9-423a-b7b6-4d6a6c8ba716 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:52.412797 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd39e6c-00c9-423a-b7b6-4d6a6c8ba716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:52.413069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd39e6c-00c9-423a-b7b6-4d6a6c8ba716 admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:52.413765 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd39e6c-00c9-423a-b7b6-4d6a6c8ba716 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:52.415744 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd39e6c-00c9-423a-b7b6-4d6a6c8ba716 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:52.443493 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1142/2288] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:52 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:22:52.447390 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd39e6c-00c9-423a-b7b6-4d6a6c8ba716 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:52.479938 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1147/2289] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:22:52.491800 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f90c26-1f71-4d00-9857-cc587a351ded None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:52.493417 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-95f90c26-1f71-4d00-9857-cc587a351ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:52.520807 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd39e6c-00c9-423a-b7b6-4d6a6c8ba716 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:52.525959 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653de1d-63c7-4994-afbc-8998aba412d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:52.526631 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653de1d-63c7-4994-afbc-8998aba412d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:52.526940 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653de1d-63c7-4994-afbc-8998aba412d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:52.527387 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653de1d-63c7-4994-afbc-8998aba412d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:52.528299 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653de1d-63c7-4994-afbc-8998aba412d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:52.530675 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653de1d-63c7-4994-afbc-8998aba412d5 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:52.534527 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:52.561404 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1143/2290] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:52 2022] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:52.565454 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f90c26-1f71-4d00-9857-cc587a351ded None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:52.565617 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653de1d-63c7-4994-afbc-8998aba412d5 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:52.577293 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653de1d-63c7-4994-afbc-8998aba412d5 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:52.582807 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f036fc6-24d8-4993-8e64-46884b9188e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:52.583407 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f036fc6-24d8-4993-8e64-46884b9188e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:52.583693 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f036fc6-24d8-4993-8e64-46884b9188e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:52.583970 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f036fc6-24d8-4993-8e64-46884b9188e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:52.584697 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f036fc6-24d8-4993-8e64-46884b9188e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:52.586431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f036fc6-24d8-4993-8e64-46884b9188e8 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:52.597443 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1144/2291] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:22:52.601590 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f036fc6-24d8-4993-8e64-46884b9188e8 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:52.614215 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f036fc6-24d8-4993-8e64-46884b9188e8 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:52.620850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b5c3b-2696-4a9b-a7d6-d210da352ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:52.621578 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b5c3b-2696-4a9b-a7d6-d210da352ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:52.621867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b5c3b-2696-4a9b-a7d6-d210da352ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:52.622143 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b5c3b-2696-4a9b-a7d6-d210da352ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:52.623080 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b5c3b-2696-4a9b-a7d6-d210da352ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:52.624823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b5c3b-2696-4a9b-a7d6-d210da352ef1 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:52.642705 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c668a9-bb8e-49cb-ba21-e11a7b2a8d7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:52.642705 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c668a9-bb8e-49cb-ba21-e11a7b2a8d7a service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:52.643333 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1145/2292] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:52.643424 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c668a9-bb8e-49cb-ba21-e11a7b2a8d7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:52.643424 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c668a9-bb8e-49cb-ba21-e11a7b2a8d7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:52.646778 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-80c668a9-bb8e-49cb-ba21-e11a7b2a8d7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:52.649350 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b5c3b-2696-4a9b-a7d6-d210da352ef1 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:52.659488 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b5c3b-2696-4a9b-a7d6-d210da352ef1 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:52.665716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6211199-df8f-48ff-8900-f672348dd323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:52.666759 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6211199-df8f-48ff-8900-f672348dd323 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:52.667039 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6211199-df8f-48ff-8900-f672348dd323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:52.667316 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6211199-df8f-48ff-8900-f672348dd323 admin admin] PATH_INFO: `/v3/projects/74e6d0f5f9924604a213c60cac93349a/users/60b67f91d3e14fc4922d94b97b0ee1f5/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:52.685220 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6211199-df8f-48ff-8900-f672348dd323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74e6d0f5f9924604a213c60cac93349a, user_id=60b67f91d3e14fc4922d94b97b0ee1f5, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:52.685623 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6211199-df8f-48ff-8900-f672348dd323 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:52.699828 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1146/2293] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:52 2022] PUT /identity/v3/projects/74e6d0f5f9924604a213c60cac93349a/users/60b67f91d3e14fc4922d94b97b0ee1f5/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:22:52.704722 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90fd19-62f7-4ac5-8f98-ba18ed3aa364 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:52.705035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90fd19-62f7-4ac5-8f98-ba18ed3aa364 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:52.705310 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90fd19-62f7-4ac5-8f98-ba18ed3aa364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:52.711637 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c668a9-bb8e-49cb-ba21-e11a7b2a8d7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:52.713088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c668a9-bb8e-49cb-ba21-e11a7b2a8d7a service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:52.722013 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1148/2294] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:52.727766 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-0d90fd19-62f7-4ac5-8f98-ba18ed3aa364 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:52.729815 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-0d90fd19-62f7-4ac5-8f98-ba18ed3aa364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:52.775918 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:52.794111 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1147/2295] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:22:52.803153 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c668a9-bb8e-49cb-ba21-e11a7b2a8d7a service cinder] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:52.804599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-80c668a9-bb8e-49cb-ba21-e11a7b2a8d7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:52.865235 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c668a9-bb8e-49cb-ba21-e11a7b2a8d7a service cinder] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:52.925788 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2ea9e-511f-4499-8f5b-5327e900436c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:52.926485 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2ea9e-511f-4499-8f5b-5327e900436c service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:52.926812 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2ea9e-511f-4499-8f5b-5327e900436c service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:52.927094 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2ea9e-511f-4499-8f5b-5327e900436c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:52.938061 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2ea9e-511f-4499-8f5b-5327e900436c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:52.939542 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2ea9e-511f-4499-8f5b-5327e900436c service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:52.945680 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:52.951155 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1149/2296] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:57.423136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90fd19-62f7-4ac5-8f98-ba18ed3aa364 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:57.532244 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90fd19-62f7-4ac5-8f98-ba18ed3aa364 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:57.542821 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf9962-8511-4ff2-8a1c-f79a960f439c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:57.543667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf9962-8511-4ff2-8a1c-f79a960f439c service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:57.543957 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf9962-8511-4ff2-8a1c-f79a960f439c service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:57.544239 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf9962-8511-4ff2-8a1c-f79a960f439c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:57.623331 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa5061-dc20-4607-b260-8b0ab8204421 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:57.624291 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa5061-dc20-4607-b260-8b0ab8204421 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:57.624885 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa5061-dc20-4607-b260-8b0ab8204421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:57.645027 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf9962-8511-4ff2-8a1c-f79a960f439c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:57.655885 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf9962-8511-4ff2-8a1c-f79a960f439c service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:57.687045 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1148/2297] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:57.697339 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-e7fa5061-dc20-4607-b260-8b0ab8204421 None None] MFA Rules not processed for user `60b67f91d3e14fc4922d94b97b0ee1f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:57.699761 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-e7fa5061-dc20-4607-b260-8b0ab8204421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:57.872504 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1150/2298] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:22:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:57.882869 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf9962-8511-4ff2-8a1c-f79a960f439c service cinder] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:57.897200 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf9962-8511-4ff2-8a1c-f79a960f439c service cinder] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:57.903783 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2223f88-f7ba-4e96-9d9e-7d75a3a95253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:57.904395 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2223f88-f7ba-4e96-9d9e-7d75a3a95253 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:57.904682 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2223f88-f7ba-4e96-9d9e-7d75a3a95253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:57.904964 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2223f88-f7ba-4e96-9d9e-7d75a3a95253 admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:57.905672 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2223f88-f7ba-4e96-9d9e-7d75a3a95253 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:57.908083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2223f88-f7ba-4e96-9d9e-7d75a3a95253 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:57.981546 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1149/2299] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:57 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:57.982553 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa5061-dc20-4607-b260-8b0ab8204421 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:57.997578 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa5061-dc20-4607-b260-8b0ab8204421 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:58.094915 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3badf2f0-48e9-4977-8e59-73e9c6ba90eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:58.095664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badf2f0-48e9-4977-8e59-73e9c6ba90eb admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:58.095952 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badf2f0-48e9-4977-8e59-73e9c6ba90eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:58.096268 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badf2f0-48e9-4977-8e59-73e9c6ba90eb admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:58.097050 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3badf2f0-48e9-4977-8e59-73e9c6ba90eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:58.100039 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3badf2f0-48e9-4977-8e59-73e9c6ba90eb admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:58.158063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1151/2300] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:57 2022] POST /identity/v3/users => generated 295 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:58.159760 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2223f88-f7ba-4e96-9d9e-7d75a3a95253 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:58.179107 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2223f88-f7ba-4e96-9d9e-7d75a3a95253 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:58.194190 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e89bc9-442e-467f-92d6-16ece59fa9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:58.198681 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e89bc9-442e-467f-92d6-16ece59fa9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:58.198681 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e89bc9-442e-467f-92d6-16ece59fa9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:58.198681 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e89bc9-442e-467f-92d6-16ece59fa9b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:58.198681 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e89bc9-442e-467f-92d6-16ece59fa9b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:58.198681 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e89bc9-442e-467f-92d6-16ece59fa9b5 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:58.218141 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1150/2301] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:58.223151 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3badf2f0-48e9-4977-8e59-73e9c6ba90eb admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:58.241491 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3badf2f0-48e9-4977-8e59-73e9c6ba90eb admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:58.246990 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc165e2-2637-4216-882c-3cde3411ac26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:58.248157 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc165e2-2637-4216-882c-3cde3411ac26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:58.248533 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc165e2-2637-4216-882c-3cde3411ac26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:58.248817 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc165e2-2637-4216-882c-3cde3411ac26 admin admin] PATH_INFO: `/v3/projects/ad8f698b475e470f9c35a258fb132228/users/fb128cfb3a0642f79610144328a0e366/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:58.279573 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc165e2-2637-4216-882c-3cde3411ac26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad8f698b475e470f9c35a258fb132228, user_id=fb128cfb3a0642f79610144328a0e366, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:58.287922 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc165e2-2637-4216-882c-3cde3411ac26 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:58.322800 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1152/2302] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:58 2022] PUT /identity/v3/projects/ad8f698b475e470f9c35a258fb132228/users/fb128cfb3a0642f79610144328a0e366/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:58.324168 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e89bc9-442e-467f-92d6-16ece59fa9b5 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:58.339238 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e89bc9-442e-467f-92d6-16ece59fa9b5 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:58.413991 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa8193-04db-4968-8071-7041d63696f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:58.415976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa8193-04db-4968-8071-7041d63696f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:58.416358 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa8193-04db-4968-8071-7041d63696f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:58.416737 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa8193-04db-4968-8071-7041d63696f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:58.417584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa8193-04db-4968-8071-7041d63696f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:58.419394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa8193-04db-4968-8071-7041d63696f0 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:58.436808 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1151/2303] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:58.437821 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc165e2-2637-4216-882c-3cde3411ac26 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:58.452719 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc165e2-2637-4216-882c-3cde3411ac26 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:58.461515 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8e551-e72a-4d30-8dd0-06b73a13524a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:58.462523 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8e551-e72a-4d30-8dd0-06b73a13524a admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:58.462976 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8e551-e72a-4d30-8dd0-06b73a13524a admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:58.463864 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8e551-e72a-4d30-8dd0-06b73a13524a admin admin] PATH_INFO: `/v3/projects/ad8f698b475e470f9c35a258fb132228/users/fb128cfb3a0642f79610144328a0e366/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:58.466116 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8e551-e72a-4d30-8dd0-06b73a13524a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad8f698b475e470f9c35a258fb132228, user_id=fb128cfb3a0642f79610144328a0e366, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:58.469214 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8e551-e72a-4d30-8dd0-06b73a13524a admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:58.483375 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1153/2304] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:58 2022] PUT /identity/v3/projects/ad8f698b475e470f9c35a258fb132228/users/fb128cfb3a0642f79610144328a0e366/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:23:03.088999 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa8193-04db-4968-8071-7041d63696f0 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:03.094242 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:23:03.101475 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa8193-04db-4968-8071-7041d63696f0 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:03.177641 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45b52b-9ca2-4f56-9a92-fac47b71a732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:03.178656 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45b52b-9ca2-4f56-9a92-fac47b71a732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:03.179011 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45b52b-9ca2-4f56-9a92-fac47b71a732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:03.179393 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45b52b-9ca2-4f56-9a92-fac47b71a732 admin admin] PATH_INFO: `/v3/users/9a659c6815154775bd47c7eec4fb42da` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:03.180724 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45b52b-9ca2-4f56-9a92-fac47b71a732 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a659c6815154775bd47c7eec4fb42da)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:03.182873 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45b52b-9ca2-4f56-9a92-fac47b71a732 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:03.238671 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-fa45b52b-9ca2-4f56-9a92-fac47b71a732 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a659c6815154775bd47c7eec4fb42da'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:03.239141 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-fa45b52b-9ca2-4f56-9a92-fac47b71a732 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a659c6815154775bd47c7eec4fb42da'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:03.254895 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-fa45b52b-9ca2-4f56-9a92-fac47b71a732 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a659c6815154775bd47c7eec4fb42da'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:03.264596 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-fa45b52b-9ca2-4f56-9a92-fac47b71a732 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a659c6815154775bd47c7eec4fb42da'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:03.265367 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-fa45b52b-9ca2-4f56-9a92-fac47b71a732 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a659c6815154775bd47c7eec4fb42da'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:03.281103 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1152/2305] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:23:03 2022] DELETE /identity/v3/users/9a659c6815154775bd47c7eec4fb42da => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:23:03.287273 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8ce56-4ba7-474b-add8-060e2b86ae2e None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:03.288154 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8ce56-4ba7-474b-add8-060e2b86ae2e None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:03.288441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8ce56-4ba7-474b-add8-060e2b86ae2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:03.314078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-bfe8ce56-4ba7-474b-add8-060e2b86ae2e None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:23:03.315584 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-bfe8ce56-4ba7-474b-add8-060e2b86ae2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:03.364696 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:23:03.396217 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1154/2306] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:23:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:23:03.405741 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45b52b-9ca2-4f56-9a92-fac47b71a732 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:03.407207 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-fa45b52b-9ca2-4f56-9a92-fac47b71a732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:03.545899 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45b52b-9ca2-4f56-9a92-fac47b71a732 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:03.559279 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a4e3c-1956-4380-82d2-b1b8551b5bc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:03.559966 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a4e3c-1956-4380-82d2-b1b8551b5bc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:03.560258 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a4e3c-1956-4380-82d2-b1b8551b5bc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:03.560564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a4e3c-1956-4380-82d2-b1b8551b5bc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:03.577179 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a4e3c-1956-4380-82d2-b1b8551b5bc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:03.579639 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a4e3c-1956-4380-82d2-b1b8551b5bc7 service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:03.595993 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1153/2307] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:23:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:23:04.050698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c1848-db4e-4e03-98a3-3efa5f9546df None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:04.051017 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c1848-db4e-4e03-98a3-3efa5f9546df None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:04.051301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c1848-db4e-4e03-98a3-3efa5f9546df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:04.053868 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a4e3c-1956-4380-82d2-b1b8551b5bc7 service neutron] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:04.055343 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-8f1a4e3c-1956-4380-82d2-b1b8551b5bc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:04.083028 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a4e3c-1956-4380-82d2-b1b8551b5bc7 service neutron] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:04.088320 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbec0ea-1136-4e93-b292-b8079473daf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:04.089200 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbec0ea-1136-4e93-b292-b8079473daf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:04.089753 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbec0ea-1136-4e93-b292-b8079473daf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:04.089753 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbec0ea-1136-4e93-b292-b8079473daf6 admin admin] PATH_INFO: `/v3/projects/0a317a226f0e4a76b15aa4c54a74468f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:04.092036 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbec0ea-1136-4e93-b292-b8079473daf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a317a226f0e4a76b15aa4c54a74468f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:04.093132 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-e60c1848-db4e-4e03-98a3-3efa5f9546df None None] MFA Rules not processed for user `fb128cfb3a0642f79610144328a0e366`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:23:04.094070 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbec0ea-1136-4e93-b292-b8079473daf6 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:04.094422 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-e60c1848-db4e-4e03-98a3-3efa5f9546df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:04.144505 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:23:04.200095 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-adbec0ea-1136-4e93-b292-b8079473daf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a317a226f0e4a76b15aa4c54a74468f', 'request_id': 'req-adbec0ea-1136-4e93-b292-b8079473daf6'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:04.212358 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-adbec0ea-1136-4e93-b292-b8079473daf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a317a226f0e4a76b15aa4c54a74468f', 'request_id': 'req-adbec0ea-1136-4e93-b292-b8079473daf6'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:04.219025 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-adbec0ea-1136-4e93-b292-b8079473daf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a317a226f0e4a76b15aa4c54a74468f', 'request_id': 'req-adbec0ea-1136-4e93-b292-b8079473daf6'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:04.246686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1155/2308] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:23:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:23:04.262737 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-adbec0ea-1136-4e93-b292-b8079473daf6 admin admin] The token cache is being invalidate because project 0a317a226f0e4a76b15aa4c54a74468f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:23:04.263189 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c1848-db4e-4e03-98a3-3efa5f9546df None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:04.263524 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-adbec0ea-1136-4e93-b292-b8079473daf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:04.265253 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-e60c1848-db4e-4e03-98a3-3efa5f9546df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:04.265572 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-adbec0ea-1136-4e93-b292-b8079473daf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:04.274464 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1154/2309] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:23:04 2022] DELETE /identity/v3/projects/0a317a226f0e4a76b15aa4c54a74468f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:23:04.275595 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbec0ea-1136-4e93-b292-b8079473daf6 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:04.279967 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-adbec0ea-1136-4e93-b292-b8079473daf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:04.410601 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbec0ea-1136-4e93-b292-b8079473daf6 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:04.426230 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c1848-db4e-4e03-98a3-3efa5f9546df None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:04.432268 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf28b7-6ce8-4131-93cd-1fd8d43e21af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:04.433456 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf28b7-6ce8-4131-93cd-1fd8d43e21af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:04.433938 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf28b7-6ce8-4131-93cd-1fd8d43e21af admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:04.434418 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf28b7-6ce8-4131-93cd-1fd8d43e21af admin admin] PATH_INFO: `/v3/users/72813b786a09451c8532f44b0fe885d5` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:04.435724 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badf28b7-6ce8-4131-93cd-1fd8d43e21af admin admin] RBAC: Authorizing `identity:delete_user(user_id=72813b786a09451c8532f44b0fe885d5)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:04.437719 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badf28b7-6ce8-4131-93cd-1fd8d43e21af admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:04.506515 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-badf28b7-6ce8-4131-93cd-1fd8d43e21af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72813b786a09451c8532f44b0fe885d5'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:04.508221 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-badf28b7-6ce8-4131-93cd-1fd8d43e21af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72813b786a09451c8532f44b0fe885d5'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:04.519478 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:23:04.532363 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-badf28b7-6ce8-4131-93cd-1fd8d43e21af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72813b786a09451c8532f44b0fe885d5'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:04.537954 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3e2cf-4e25-4c54-bddd-bf1f1bccbd55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:04.538629 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3e2cf-4e25-4c54-bddd-bf1f1bccbd55 service nova] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:04.539012 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3e2cf-4e25-4c54-bddd-bf1f1bccbd55 service nova] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:04.539281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3e2cf-4e25-4c54-bddd-bf1f1bccbd55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:04.541659 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-79b3e2cf-4e25-4c54-bddd-bf1f1bccbd55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:04.543653 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-badf28b7-6ce8-4131-93cd-1fd8d43e21af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72813b786a09451c8532f44b0fe885d5'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:04.544492 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-badf28b7-6ce8-4131-93cd-1fd8d43e21af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72813b786a09451c8532f44b0fe885d5'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:04.569579 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1155/2310] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:23:04 2022] DELETE /identity/v3/users/72813b786a09451c8532f44b0fe885d5 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:23:04.634470 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3e2cf-4e25-4c54-bddd-bf1f1bccbd55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:04.636335 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3e2cf-4e25-4c54-bddd-bf1f1bccbd55 service nova] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:04.648656 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1156/2311] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:23:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:23:05.111640 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf28b7-6ce8-4131-93cd-1fd8d43e21af admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:05.116965 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-badf28b7-6ce8-4131-93cd-1fd8d43e21af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:05.167088 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:23:05.230590 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf28b7-6ce8-4131-93cd-1fd8d43e21af admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:05.237172 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeddee9-2795-4fa4-9c2d-8901458e7329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:05.238187 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeddee9-2795-4fa4-9c2d-8901458e7329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:05.238622 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeddee9-2795-4fa4-9c2d-8901458e7329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:05.238929 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeddee9-2795-4fa4-9c2d-8901458e7329 admin admin] PATH_INFO: `/v3/projects/1ab4068c537a4fc69b58e4c76348445c` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:05.240141 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeddee9-2795-4fa4-9c2d-8901458e7329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ab4068c537a4fc69b58e4c76348445c)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:05.242139 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeddee9-2795-4fa4-9c2d-8901458e7329 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:05.304858 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-baeddee9-2795-4fa4-9c2d-8901458e7329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ab4068c537a4fc69b58e4c76348445c', 'request_id': 'req-baeddee9-2795-4fa4-9c2d-8901458e7329'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:05.311566 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-baeddee9-2795-4fa4-9c2d-8901458e7329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ab4068c537a4fc69b58e4c76348445c', 'request_id': 'req-baeddee9-2795-4fa4-9c2d-8901458e7329'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:05.318616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-baeddee9-2795-4fa4-9c2d-8901458e7329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ab4068c537a4fc69b58e4c76348445c', 'request_id': 'req-baeddee9-2795-4fa4-9c2d-8901458e7329'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:05.334128 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-baeddee9-2795-4fa4-9c2d-8901458e7329 admin admin] The token cache is being invalidate because project 1ab4068c537a4fc69b58e4c76348445c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:23:05.334789 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-baeddee9-2795-4fa4-9c2d-8901458e7329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:05.335690 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-baeddee9-2795-4fa4-9c2d-8901458e7329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:05.337586 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1156/2312] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:23:05 2022] DELETE /identity/v3/projects/1ab4068c537a4fc69b58e4c76348445c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:23:05.344888 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d203d-aa0e-4443-8ad8-2537bf45134a None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:05.345201 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d203d-aa0e-4443-8ad8-2537bf45134a None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:05.345450 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d203d-aa0e-4443-8ad8-2537bf45134a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:05.391148 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-d69d203d-aa0e-4443-8ad8-2537bf45134a None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:23:05.392379 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-d69d203d-aa0e-4443-8ad8-2537bf45134a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:05.472382 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1157/2313] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:23:05.482435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388142e8-60b4-449b-9103-6de1d9527172 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:05.482435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388142e8-60b4-449b-9103-6de1d9527172 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:05.482435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388142e8-60b4-449b-9103-6de1d9527172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:05.506791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-388142e8-60b4-449b-9103-6de1d9527172 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:23:05.508009 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-388142e8-60b4-449b-9103-6de1d9527172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:05.516721 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1157/2314] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:23:05.521537 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d203d-aa0e-4443-8ad8-2537bf45134a None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:05.533612 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d203d-aa0e-4443-8ad8-2537bf45134a None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:05.541884 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3e0be-7cc5-4feb-bc09-ac61e62ae6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:05.542895 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3e0be-7cc5-4feb-bc09-ac61e62ae6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:05.543664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3e0be-7cc5-4feb-bc09-ac61e62ae6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:05.544308 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3e0be-7cc5-4feb-bc09-ac61e62ae6a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:05.545443 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3e0be-7cc5-4feb-bc09-ac61e62ae6a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:23:05.545951 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3e0be-7cc5-4feb-bc09-ac61e62ae6a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:05.548724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3e0be-7cc5-4feb-bc09-ac61e62ae6a9 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:05.570528 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1158/2315] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:23:05.571881 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388142e8-60b4-449b-9103-6de1d9527172 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:05.582884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388142e8-60b4-449b-9103-6de1d9527172 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:05.587984 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610aeee-6122-4799-b1ef-d8b23c672fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:05.588789 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610aeee-6122-4799-b1ef-d8b23c672fc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:05.589085 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610aeee-6122-4799-b1ef-d8b23c672fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:05.589403 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610aeee-6122-4799-b1ef-d8b23c672fc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:05.592074 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6610aeee-6122-4799-b1ef-d8b23c672fc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:05.592977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6610aeee-6122-4799-b1ef-d8b23c672fc9 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:05.631961 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1158/2316] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:23:05 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:23:05.636495 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3e0be-7cc5-4feb-bc09-ac61e62ae6a9 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:05.647675 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3e0be-7cc5-4feb-bc09-ac61e62ae6a9 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:05.724189 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3054ed-4ecc-47e4-9994-78eecea13e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:05.725247 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3054ed-4ecc-47e4-9994-78eecea13e2d admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:05.725564 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3054ed-4ecc-47e4-9994-78eecea13e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:05.725900 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3054ed-4ecc-47e4-9994-78eecea13e2d admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:05.726630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3054ed-4ecc-47e4-9994-78eecea13e2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:05.728900 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3054ed-4ecc-47e4-9994-78eecea13e2d admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:05.754152 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1159/2317] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:23:05 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:23:05.758229 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610aeee-6122-4799-b1ef-d8b23c672fc9 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:05.771022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610aeee-6122-4799-b1ef-d8b23c672fc9 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:05.776308 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5c525-55c6-48e1-a204-c7a750f6b814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:05.777002 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5c525-55c6-48e1-a204-c7a750f6b814 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:05.778666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5c525-55c6-48e1-a204-c7a750f6b814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:05.778997 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5c525-55c6-48e1-a204-c7a750f6b814 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:05.780227 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d5c525-55c6-48e1-a204-c7a750f6b814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:05.781828 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d5c525-55c6-48e1-a204-c7a750f6b814 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:05.795493 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1159/2318] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:23:05.799674 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3054ed-4ecc-47e4-9994-78eecea13e2d admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:05.811433 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3054ed-4ecc-47e4-9994-78eecea13e2d admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:05.817687 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabd950-361c-4717-af48-0609dde6eed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:05.818079 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabd950-361c-4717-af48-0609dde6eed0 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:05.818515 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabd950-361c-4717-af48-0609dde6eed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:05.818835 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabd950-361c-4717-af48-0609dde6eed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:05.819574 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabd950-361c-4717-af48-0609dde6eed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:05.821302 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabd950-361c-4717-af48-0609dde6eed0 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:05.826947 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:23:05.833317 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1160/2319] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:23:05.837977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5c525-55c6-48e1-a204-c7a750f6b814 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:05.849389 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5c525-55c6-48e1-a204-c7a750f6b814 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:05.858024 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91023b6a-a618-4577-a04b-6128cb2adce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:05.859474 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91023b6a-a618-4577-a04b-6128cb2adce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:05.859763 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91023b6a-a618-4577-a04b-6128cb2adce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:05.860039 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91023b6a-a618-4577-a04b-6128cb2adce7 admin admin] PATH_INFO: `/v3/projects/5d31a670dc34423f84ef1b277ba849c7/users/df29529955b64979afa1c495da5fc580/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:05.881655 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91023b6a-a618-4577-a04b-6128cb2adce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d31a670dc34423f84ef1b277ba849c7, user_id=df29529955b64979afa1c495da5fc580, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:05.884457 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91023b6a-a618-4577-a04b-6128cb2adce7 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:05.905782 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1160/2320] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:23:05 2022] PUT /identity/v3/projects/5d31a670dc34423f84ef1b277ba849c7/users/df29529955b64979afa1c495da5fc580/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:23:05.922600 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75cce8-cbcd-41a1-ad5c-f333b0b92c50 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:05.922600 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75cce8-cbcd-41a1-ad5c-f333b0b92c50 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:05.922600 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75cce8-cbcd-41a1-ad5c-f333b0b92c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:05.951410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-1e75cce8-cbcd-41a1-ad5c-f333b0b92c50 None None] MFA Rules not processed for user `df29529955b64979afa1c495da5fc580`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:23:05.952801 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-1e75cce8-cbcd-41a1-ad5c-f333b0b92c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:06.070139 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1161/2321] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:23:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:23:06.092096 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91023b6a-a618-4577-a04b-6128cb2adce7 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:06.094237 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-91023b6a-a618-4577-a04b-6128cb2adce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:06.184154 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91023b6a-a618-4577-a04b-6128cb2adce7 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:06.204950 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84a0ec-1a7b-4310-bb08-50643aeae8d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:06.205617 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84a0ec-1a7b-4310-bb08-50643aeae8d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:06.205896 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84a0ec-1a7b-4310-bb08-50643aeae8d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:06.206286 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84a0ec-1a7b-4310-bb08-50643aeae8d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:06.213472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:23:06.217226 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84a0ec-1a7b-4310-bb08-50643aeae8d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:06.219409 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84a0ec-1a7b-4310-bb08-50643aeae8d5 service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:06.238951 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1161/2322] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:23:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:23:06.271941 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75cce8-cbcd-41a1-ad5c-f333b0b92c50 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:06.391911 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75cce8-cbcd-41a1-ad5c-f333b0b92c50 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:06.397612 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e471619-8b16-412b-8391-93e732dd56c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:06.399656 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e471619-8b16-412b-8391-93e732dd56c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:06.400122 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e471619-8b16-412b-8391-93e732dd56c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:06.400575 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e471619-8b16-412b-8391-93e732dd56c2 admin admin] PATH_INFO: `/v3/users/df29529955b64979afa1c495da5fc580` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:06.402015 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e471619-8b16-412b-8391-93e732dd56c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df29529955b64979afa1c495da5fc580)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:06.404543 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e471619-8b16-412b-8391-93e732dd56c2 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:06.511513 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-8e471619-8b16-412b-8391-93e732dd56c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df29529955b64979afa1c495da5fc580'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:06.512376 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-8e471619-8b16-412b-8391-93e732dd56c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df29529955b64979afa1c495da5fc580'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:06.536139 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-8e471619-8b16-412b-8391-93e732dd56c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df29529955b64979afa1c495da5fc580'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:06.536968 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-8e471619-8b16-412b-8391-93e732dd56c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df29529955b64979afa1c495da5fc580'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:06.550425 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-8e471619-8b16-412b-8391-93e732dd56c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df29529955b64979afa1c495da5fc580'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:06.572278 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1162/2323] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:23:06 2022] DELETE /identity/v3/users/df29529955b64979afa1c495da5fc580 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:23:06.574172 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdd1f5-a3dc-4b00-8e7c-857f83e0f776 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:06.574729 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdd1f5-a3dc-4b00-8e7c-857f83e0f776 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:06.575194 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdd1f5-a3dc-4b00-8e7c-857f83e0f776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:06.594725 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-f4fdd1f5-a3dc-4b00-8e7c-857f83e0f776 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:23:06.596585 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-f4fdd1f5-a3dc-4b00-8e7c-857f83e0f776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:06.675663 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1162/2324] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:23:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:23:06.686470 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e471619-8b16-412b-8391-93e732dd56c2 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:06.688114 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-8e471619-8b16-412b-8391-93e732dd56c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:06.699777 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:23:06.778226 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e471619-8b16-412b-8391-93e732dd56c2 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:06.783054 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81083f8e-e1a7-48f2-a13e-d74d2e0bb647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:06.783720 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81083f8e-e1a7-48f2-a13e-d74d2e0bb647 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:06.784007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81083f8e-e1a7-48f2-a13e-d74d2e0bb647 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:06.784505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81083f8e-e1a7-48f2-a13e-d74d2e0bb647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:06.794801 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81083f8e-e1a7-48f2-a13e-d74d2e0bb647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:06.796280 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81083f8e-e1a7-48f2-a13e-d74d2e0bb647 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:06.808724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1163/2325] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:23:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:23:07.139501 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdd1f5-a3dc-4b00-8e7c-857f83e0f776 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:07.141148 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-f4fdd1f5-a3dc-4b00-8e7c-857f83e0f776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:07.156849 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdd1f5-a3dc-4b00-8e7c-857f83e0f776 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:07.163529 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25decc78-a941-42d9-8a78-dc215e21ae87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:07.164740 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25decc78-a941-42d9-8a78-dc215e21ae87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:07.165334 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25decc78-a941-42d9-8a78-dc215e21ae87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:07.165805 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25decc78-a941-42d9-8a78-dc215e21ae87 admin admin] PATH_INFO: `/v3/projects/5d31a670dc34423f84ef1b277ba849c7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:07.167234 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25decc78-a941-42d9-8a78-dc215e21ae87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d31a670dc34423f84ef1b277ba849c7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:07.171137 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25decc78-a941-42d9-8a78-dc215e21ae87 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:07.230903 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-25decc78-a941-42d9-8a78-dc215e21ae87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d31a670dc34423f84ef1b277ba849c7', 'request_id': 'req-25decc78-a941-42d9-8a78-dc215e21ae87'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:07.237264 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-25decc78-a941-42d9-8a78-dc215e21ae87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d31a670dc34423f84ef1b277ba849c7', 'request_id': 'req-25decc78-a941-42d9-8a78-dc215e21ae87'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:07.243071 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-25decc78-a941-42d9-8a78-dc215e21ae87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d31a670dc34423f84ef1b277ba849c7', 'request_id': 'req-25decc78-a941-42d9-8a78-dc215e21ae87'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:07.259519 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-25decc78-a941-42d9-8a78-dc215e21ae87 admin admin] The token cache is being invalidate because project 5d31a670dc34423f84ef1b277ba849c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:23:07.260061 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-25decc78-a941-42d9-8a78-dc215e21ae87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:07.260700 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-25decc78-a941-42d9-8a78-dc215e21ae87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:07.262286 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1163/2326] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:23:07 2022] DELETE /identity/v3/projects/5d31a670dc34423f84ef1b277ba849c7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:23:16.802530 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=22 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:23:17.255377 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=56,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:23:55.090893 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81083f8e-e1a7-48f2-a13e-d74d2e0bb647 service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:55.092531 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-81083f8e-e1a7-48f2-a13e-d74d2e0bb647 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:55.200398 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81083f8e-e1a7-48f2-a13e-d74d2e0bb647 service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:55.294982 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db89a1-9cb4-46ed-81c7-95db5d59b095 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57c8b894e74c709ea389ed462184fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:55.295567 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db89a1-9cb4-46ed-81c7-95db5d59b095 service placement] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:55.296663 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db89a1-9cb4-46ed-81c7-95db5d59b095 service placement] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:55.296663 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db89a1-9cb4-46ed-81c7-95db5d59b095 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:55.300441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-f2db89a1-9cb4-46ed-81c7-95db5d59b095 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:55.314195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db89a1-9cb4-46ed-81c7-95db5d59b095 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:55.316530 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db89a1-9cb4-46ed-81c7-95db5d59b095 service placement] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:55.327698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1164/2327] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:23:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:23:56.062365 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb351802-2321-41aa-be60-2cf3ac51a94e None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:56.062913 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb351802-2321-41aa-be60-2cf3ac51a94e None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:56.062913 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb351802-2321-41aa-be60-2cf3ac51a94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:56.081019 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-fb351802-2321-41aa-be60-2cf3ac51a94e None None] MFA Rules not processed for user `026de546e4f448b3b5258cafedf8bf78`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:23:56.082241 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-fb351802-2321-41aa-be60-2cf3ac51a94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:56.136622 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1164/2328] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:23:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:23:57.094147 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d047f-823d-441a-924c-134a53d6bade None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:57.094603 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d047f-823d-441a-924c-134a53d6bade None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:57.094721 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d047f-823d-441a-924c-134a53d6bade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:57.155382 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-e41d047f-823d-441a-924c-134a53d6bade None None] MFA Rules not processed for user `2891b5a315b64f228f665e024b641629`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:23:57.156583 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-e41d047f-823d-441a-924c-134a53d6bade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:57.191035 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:23:57.232035 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1165/2329] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Jun 29 12:23:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:23:57.275784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb351802-2321-41aa-be60-2cf3ac51a94e None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:57.277799 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-fb351802-2321-41aa-be60-2cf3ac51a94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:57.374430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb351802-2321-41aa-be60-2cf3ac51a94e None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:57.379613 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d9d2a-c27a-43e3-bf8d-140665f975f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11efdbeeaa5c428aa344f7f0f5b061ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:57.380266 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d9d2a-c27a-43e3-bf8d-140665f975f9 service swift] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:57.380723 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d9d2a-c27a-43e3-bf8d-140665f975f9 service swift] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:57.380971 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d9d2a-c27a-43e3-bf8d-140665f975f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:57.406395 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d9d2a-c27a-43e3-bf8d-140665f975f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:57.408062 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d9d2a-c27a-43e3-bf8d-140665f975f9 service swift] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:57.424100 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1165/2330] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Jun 29 12:23:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 12:24:07.228427 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=14 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:24:07.419745 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=66 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:24:14.607419 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cde6e6-b73d-4563-bb65-bd4b7dc36bd1 None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:14.608008 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cde6e6-b73d-4563-bb65-bd4b7dc36bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:14.608008 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cde6e6-b73d-4563-bb65-bd4b7dc36bd1 None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:14.609510 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1166/2331] 10.222.0.13 () {54 vars in 921 bytes} [Wed Jun 29 12:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:24:14.616874 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb47ecd-172a-4e6b-9ea4-04757482ab62 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:14.617435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb47ecd-172a-4e6b-9ea4-04757482ab62 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:14.617435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb47ecd-172a-4e6b-9ea4-04757482ab62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:14.676251 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-4cb47ecd-172a-4e6b-9ea4-04757482ab62 None None] MFA Rules not processed for user `3fbcf547421b42e4b520f9246326bff8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:24:14.677512 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-4cb47ecd-172a-4e6b-9ea4-04757482ab62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:14.772266 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1166/2332] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Jun 29 12:24:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:24:14.784246 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cde6e6-b73d-4563-bb65-bd4b7dc36bd1 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:14.785932 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-f6cde6e6-b73d-4563-bb65-bd4b7dc36bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:14.879011 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cde6e6-b73d-4563-bb65-bd4b7dc36bd1 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:14.883689 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946e95a-f45b-4f8f-b954-14a47b3c1145 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09d603d756a9484bbf48cfd6d56bdb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:14.884342 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946e95a-f45b-4f8f-b954-14a47b3c1145 service glance] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:14.884627 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946e95a-f45b-4f8f-b954-14a47b3c1145 service glance] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:14.884906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946e95a-f45b-4f8f-b954-14a47b3c1145 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:14.895253 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946e95a-f45b-4f8f-b954-14a47b3c1145 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:14.896716 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946e95a-f45b-4f8f-b954-14a47b3c1145 service glance] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:14.909003 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1167/2333] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:24:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:24:15.008970 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df34f2-ad2c-4c09-97b5-4af8292c139b None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:15.009361 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df34f2-ad2c-4c09-97b5-4af8292c139b None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:15.009723 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df34f2-ad2c-4c09-97b5-4af8292c139b None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:15.011248 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1167/2334] 10.222.0.13 () {54 vars in 921 bytes} [Wed Jun 29 12:24:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:24:15.016503 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0c428-7b93-49f5-8350-29b1168a3658 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:15.016872 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0c428-7b93-49f5-8350-29b1168a3658 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:15.017324 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0c428-7b93-49f5-8350-29b1168a3658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:15.037499 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-d3d0c428-7b93-49f5-8350-29b1168a3658 None None] MFA Rules not processed for user `50f5cc247f6b445f81fc3715d7bce92d`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:24:15.038881 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-d3d0c428-7b93-49f5-8350-29b1168a3658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:15.098814 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1168/2335] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Jun 29 12:24:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:24:15.115456 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df34f2-ad2c-4c09-97b5-4af8292c139b None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:15.117333 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-97df34f2-ad2c-4c09-97b5-4af8292c139b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:15.133727 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df34f2-ad2c-4c09-97b5-4af8292c139b None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:15.137575 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c3409-f531-474c-9d9d-f690ac5195ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:15.139393 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c3409-f531-474c-9d9d-f690ac5195ca service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:15.139393 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c3409-f531-474c-9d9d-f690ac5195ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:15.139393 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c3409-f531-474c-9d9d-f690ac5195ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:15.147932 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c3409-f531-474c-9d9d-f690ac5195ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:15.149755 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c3409-f531-474c-9d9d-f690ac5195ca service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:15.162603 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1168/2336] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:24:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:24:15.270440 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c551e92-be93-4f20-a029-297e81efbe0a None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:15.270781 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c551e92-be93-4f20-a029-297e81efbe0a None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:15.271050 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c551e92-be93-4f20-a029-297e81efbe0a None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:15.273437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1169/2337] 10.222.0.13 () {54 vars in 921 bytes} [Wed Jun 29 12:24:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:24:15.281525 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cbb2e-de8a-4bc7-b03b-b8993b7bd691 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:15.281815 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cbb2e-de8a-4bc7-b03b-b8993b7bd691 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:15.282096 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cbb2e-de8a-4bc7-b03b-b8993b7bd691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:15.314269 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-3c5cbb2e-de8a-4bc7-b03b-b8993b7bd691 None None] MFA Rules not processed for user `3fbcf547421b42e4b520f9246326bff8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:24:15.316671 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-3c5cbb2e-de8a-4bc7-b03b-b8993b7bd691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:15.327226 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1169/2338] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Jun 29 12:24:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:24:15.339135 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c551e92-be93-4f20-a029-297e81efbe0a None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:15.340886 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-6c551e92-be93-4f20-a029-297e81efbe0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:15.389301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c551e92-be93-4f20-a029-297e81efbe0a None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:15.394378 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37275b8e-6150-4e96-974a-6bf670a765f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:15.395284 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37275b8e-6150-4e96-974a-6bf670a765f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:15.405011 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37275b8e-6150-4e96-974a-6bf670a765f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:15.405647 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37275b8e-6150-4e96-974a-6bf670a765f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:15.427328 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37275b8e-6150-4e96-974a-6bf670a765f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:15.429417 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37275b8e-6150-4e96-974a-6bf670a765f3 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:15.443181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1170/2339] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:24:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:24:25.304064 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=55 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:24:25.436928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=64 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:25:27.246374 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cbb2e-de8a-4bc7-b03b-b8993b7bd691 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:25:27.256018 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cbb2e-de8a-4bc7-b03b-b8993b7bd691 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:25:27.259577 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbca864-6aa4-42f8-be6f-c42ca559ce39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:25:27.260271 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbca864-6aa4-42f8-be6f-c42ca559ce39 service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:27.260584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbca864-6aa4-42f8-be6f-c42ca559ce39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:27.260855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbca864-6aa4-42f8-be6f-c42ca559ce39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:27.262621 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-fdbca864-6aa4-42f8-be6f-c42ca559ce39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:25:27.277845 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbca864-6aa4-42f8-be6f-c42ca559ce39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:25:27.279318 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbca864-6aa4-42f8-be6f-c42ca559ce39 service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:25:27.291346 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1170/2340] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:25:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:25:37.286228 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=6 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:25:37.697042 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37275b8e-6150-4e96-974a-6bf670a765f3 service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:25:37.698602 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-37275b8e-6150-4e96-974a-6bf670a765f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:25:37.713802 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37275b8e-6150-4e96-974a-6bf670a765f3 service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:25:37.720007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce001d-8107-434e-8395-113ac58426cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:25:37.720693 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce001d-8107-434e-8395-113ac58426cc service nova] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:37.725228 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce001d-8107-434e-8395-113ac58426cc service nova] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:37.725228 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce001d-8107-434e-8395-113ac58426cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:37.728585 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-b3ce001d-8107-434e-8395-113ac58426cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:25:37.740357 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce001d-8107-434e-8395-113ac58426cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:25:37.741948 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce001d-8107-434e-8395-113ac58426cc service nova] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:25:37.751379 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1171/2341] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:25:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:25:37.778552 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbca864-6aa4-42f8-be6f-c42ca559ce39 service neutron] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:25:37.780335 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-fdbca864-6aa4-42f8-be6f-c42ca559ce39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:25:37.794741 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbca864-6aa4-42f8-be6f-c42ca559ce39 service neutron] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:25:37.801354 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01dfda9-5cf8-4c35-816e-cfcdd46dcdf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:25:37.802007 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dfda9-5cf8-4c35-816e-cfcdd46dcdf6 service nova] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:37.802287 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dfda9-5cf8-4c35-816e-cfcdd46dcdf6 service nova] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:37.802559 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dfda9-5cf8-4c35-816e-cfcdd46dcdf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:37.805918 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-c01dfda9-5cf8-4c35-816e-cfcdd46dcdf6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:25:37.864372 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01dfda9-5cf8-4c35-816e-cfcdd46dcdf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:25:37.865960 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01dfda9-5cf8-4c35-816e-cfcdd46dcdf6 service nova] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:25:37.874887 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1171/2342] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:25:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:25:47.746760 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=6 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:25:47.870740 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=28 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:26:35.955305 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce001d-8107-434e-8395-113ac58426cc service nova] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:26:35.956724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-b3ce001d-8107-434e-8395-113ac58426cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:26:36.038080 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce001d-8107-434e-8395-113ac58426cc service nova] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:26:36.041702 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbcdc7-3113-4fb0-a604-5aca71edd2a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:26:36.042341 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbcdc7-3113-4fb0-a604-5aca71edd2a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:26:36.042793 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbcdc7-3113-4fb0-a604-5aca71edd2a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:26:36.043173 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbcdc7-3113-4fb0-a604-5aca71edd2a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:26:36.044969 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-adbbcdc7-3113-4fb0-a604-5aca71edd2a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:26:36.049110 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01dfda9-5cf8-4c35-816e-cfcdd46dcdf6 service nova] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:26:36.058164 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01dfda9-5cf8-4c35-816e-cfcdd46dcdf6 service nova] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:26:36.061669 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3495f9-771e-476b-9add-8c6d3d77478d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:26:36.062305 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3495f9-771e-476b-9add-8c6d3d77478d service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:26:36.062583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3495f9-771e-476b-9add-8c6d3d77478d service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:26:36.062885 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3495f9-771e-476b-9add-8c6d3d77478d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:26:36.064604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-7c3495f9-771e-476b-9add-8c6d3d77478d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:26:36.074121 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3495f9-771e-476b-9add-8c6d3d77478d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:26:36.075570 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3495f9-771e-476b-9add-8c6d3d77478d service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:26:36.084149 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1172/2343] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:26:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:26:36.105362 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbbcdc7-3113-4fb0-a604-5aca71edd2a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:26:36.106877 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbbcdc7-3113-4fb0-a604-5aca71edd2a2 service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:26:36.115797 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1172/2344] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:26:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:26:46.080328 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=6 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:26:46.111580 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=57 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:27:19.651528 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3495f9-771e-476b-9add-8c6d3d77478d service neutron] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:19.661246 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3495f9-771e-476b-9add-8c6d3d77478d service neutron] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:19.668493 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e33a2-ed3f-4c47-b113-4785c61bd039 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:19.669660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e33a2-ed3f-4c47-b113-4785c61bd039 service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:19.670352 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e33a2-ed3f-4c47-b113-4785c61bd039 service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:19.670743 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e33a2-ed3f-4c47-b113-4785c61bd039 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:19.672643 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-001e33a2-ed3f-4c47-b113-4785c61bd039 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:19.742433 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e33a2-ed3f-4c47-b113-4785c61bd039 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:19.743917 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e33a2-ed3f-4c47-b113-4785c61bd039 service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:19.757824 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1173/2345] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:27:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:27:29.749587 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=28 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:27:39.834352 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbcdc7-3113-4fb0-a604-5aca71edd2a2 service cinder] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:39.843852 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbcdc7-3113-4fb0-a604-5aca71edd2a2 service cinder] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:39.847441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4e5c5-c5ce-43d8-8e63-971359d6c369 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:39.848088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4e5c5-c5ce-43d8-8e63-971359d6c369 service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:39.850542 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4e5c5-c5ce-43d8-8e63-971359d6c369 service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:39.850945 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4e5c5-c5ce-43d8-8e63-971359d6c369 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:39.853098 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-59b4e5c5-c5ce-43d8-8e63-971359d6c369 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:39.912193 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4e5c5-c5ce-43d8-8e63-971359d6c369 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:39.913630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4e5c5-c5ce-43d8-8e63-971359d6c369 service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:39.922583 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1173/2346] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:27:39 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:27:49.918467 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=28 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:04.867562 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e33a2-ed3f-4c47-b113-4785c61bd039 service cinder] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:04.876375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e33a2-ed3f-4c47-b113-4785c61bd039 service cinder] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:04.879925 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0304a7-e18e-4366-b091-27ba2ae5b3e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:04.880556 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0304a7-e18e-4366-b091-27ba2ae5b3e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:04.880838 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0304a7-e18e-4366-b091-27ba2ae5b3e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:04.881111 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0304a7-e18e-4366-b091-27ba2ae5b3e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:04.882866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-5b0304a7-e18e-4366-b091-27ba2ae5b3e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:04.939594 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0304a7-e18e-4366-b091-27ba2ae5b3e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:04.941023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0304a7-e18e-4366-b091-27ba2ae5b3e0 service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:04.950290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1174/2347] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:28:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:28:14.945671 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=28 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:29:05.204846 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4e5c5-c5ce-43d8-8e63-971359d6c369 service cinder] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:29:05.214176 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4e5c5-c5ce-43d8-8e63-971359d6c369 service cinder] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:29:05.217741 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cf7c7-7bdc-4c3f-a953-e2f8fea90125 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:29:05.218375 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cf7c7-7bdc-4c3f-a953-e2f8fea90125 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:29:05.218685 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cf7c7-7bdc-4c3f-a953-e2f8fea90125 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:29:05.218964 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cf7c7-7bdc-4c3f-a953-e2f8fea90125 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:29:05.220712 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-1b6cf7c7-7bdc-4c3f-a953-e2f8fea90125 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:29:05.234228 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cf7c7-7bdc-4c3f-a953-e2f8fea90125 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:29:05.235685 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cf7c7-7bdc-4c3f-a953-e2f8fea90125 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:29:05.246980 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1174/2348] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:29:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:29:15.241638 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=6 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:29:36.339927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0304a7-e18e-4366-b091-27ba2ae5b3e0 service cinder] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:29:36.341311 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-5b0304a7-e18e-4366-b091-27ba2ae5b3e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:29:36.355981 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0304a7-e18e-4366-b091-27ba2ae5b3e0 service cinder] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:29:36.362268 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b57ad-36b8-4354-8f1d-320de4a6bd4d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57c8b894e74c709ea389ed462184fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:29:36.363436 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b57ad-36b8-4354-8f1d-320de4a6bd4d service placement] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:29:36.363921 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b57ad-36b8-4354-8f1d-320de4a6bd4d service placement] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:29:36.364381 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b57ad-36b8-4354-8f1d-320de4a6bd4d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:29:36.376511 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b57ad-36b8-4354-8f1d-320de4a6bd4d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:29:36.378112 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b57ad-36b8-4354-8f1d-320de4a6bd4d service placement] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:29:36.388419 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1175/2349] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:29:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:29:46.384173 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=6 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:30:15.087269 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d594c-c7a3-403c-b8e8-2d902b703b6e None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:15.087796 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d594c-c7a3-403c-b8e8-2d902b703b6e None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:15.087980 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d594c-c7a3-403c-b8e8-2d902b703b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:15.105505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-b91d594c-c7a3-403c-b8e8-2d902b703b6e None None] MFA Rules not processed for user `2891b5a315b64f228f665e024b641629`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:30:15.106742 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-b91d594c-c7a3-403c-b8e8-2d902b703b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:15.114860 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1175/2350] 10.222.0.13 () {58 vars in 967 bytes} [Wed Jun 29 12:30:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:30:15.182707 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b57ad-36b8-4354-8f1d-320de4a6bd4d service placement] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:15.195671 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b57ad-36b8-4354-8f1d-320de4a6bd4d service placement] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:15.202091 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7abac-49c9-4875-8218-72dac92396de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11efdbeeaa5c428aa344f7f0f5b061ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:15.202873 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7abac-49c9-4875-8218-72dac92396de service swift] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:15.203231 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7abac-49c9-4875-8218-72dac92396de service swift] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:15.203582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7abac-49c9-4875-8218-72dac92396de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:15.213975 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7abac-49c9-4875-8218-72dac92396de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:15.215997 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7abac-49c9-4875-8218-72dac92396de service swift] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:15.224723 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1176/2351] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Jun 29 12:30:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 29 12:30:16.641867 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d594c-c7a3-403c-b8e8-2d902b703b6e None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:16.675196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d594c-c7a3-403c-b8e8-2d902b703b6e None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:16.704223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbfdf1c-deaf-4bf3-9efd-dd84bf40eee3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:16.705277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfdf1c-deaf-4bf3-9efd-dd84bf40eee3 service nova] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:16.706763 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfdf1c-deaf-4bf3-9efd-dd84bf40eee3 service nova] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:16.707471 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfdf1c-deaf-4bf3-9efd-dd84bf40eee3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:16.711007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-5cbfdf1c-deaf-4bf3-9efd-dd84bf40eee3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:16.743840 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbfdf1c-deaf-4bf3-9efd-dd84bf40eee3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:16.747055 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbfdf1c-deaf-4bf3-9efd-dd84bf40eee3 service nova] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:16.783659 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2f723-d2b9-4117-bf1b-79300996ea54 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:16.784581 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2f723-d2b9-4117-bf1b-79300996ea54 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:16.786278 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2f723-d2b9-4117-bf1b-79300996ea54 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:16.794697 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1177/2352] 10.222.0.13 () {54 vars in 912 bytes} [Wed Jun 29 12:30:16 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:30:16.802324 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1176/2353] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:30:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:30:16.814403 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d984b4-59fa-49ec-a4cb-36b5b5899343 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:16.814960 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d984b4-59fa-49ec-a4cb-36b5b5899343 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:16.815467 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d984b4-59fa-49ec-a4cb-36b5b5899343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:16.865133 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-f6d984b4-59fa-49ec-a4cb-36b5b5899343 None None] MFA Rules not processed for user `cd57c8b894e74c709ea389ed462184fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:30:16.867312 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-f6d984b4-59fa-49ec-a4cb-36b5b5899343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:16.879166 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1178/2354] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Jun 29 12:30:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:30:16.924690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbfdf1c-deaf-4bf3-9efd-dd84bf40eee3 service nova] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:16.948420 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbfdf1c-deaf-4bf3-9efd-dd84bf40eee3 service nova] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:16.964252 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94156f18-4a7e-426c-b870-dea9b0950396 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57c8b894e74c709ea389ed462184fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:16.966034 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94156f18-4a7e-426c-b870-dea9b0950396 service placement] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:16.967127 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94156f18-4a7e-426c-b870-dea9b0950396 service placement] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:16.973393 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94156f18-4a7e-426c-b870-dea9b0950396 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:17.003581 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94156f18-4a7e-426c-b870-dea9b0950396 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:17.010535 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94156f18-4a7e-426c-b870-dea9b0950396 service placement] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:17.032239 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1177/2355] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:30:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:30:19.933317 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef6cd1-4142-4af8-a245-ad8f4d14a1c7 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:19.933871 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef6cd1-4142-4af8-a245-ad8f4d14a1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:19.933871 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef6cd1-4142-4af8-a245-ad8f4d14a1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:19.958750 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-41ef6cd1-4142-4af8-a245-ad8f4d14a1c7 None None] MFA Rules not processed for user `00a1e1a5b2044f2bb37bb4bd52f3afb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:30:19.958750 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-41ef6cd1-4142-4af8-a245-ad8f4d14a1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:19.970013 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1179/2356] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:30:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:30:20.332215 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94156f18-4a7e-426c-b870-dea9b0950396 service placement] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:20.344562 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94156f18-4a7e-426c-b870-dea9b0950396 service placement] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:20.348864 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87c1be-9016-4f31-a373-5f3d5ae2d2e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:20.349617 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87c1be-9016-4f31-a373-5f3d5ae2d2e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:20.350847 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87c1be-9016-4f31-a373-5f3d5ae2d2e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:20.351136 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87c1be-9016-4f31-a373-5f3d5ae2d2e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:20.352964 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-db87c1be-9016-4f31-a373-5f3d5ae2d2e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:20.364240 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87c1be-9016-4f31-a373-5f3d5ae2d2e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:20.366711 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87c1be-9016-4f31-a373-5f3d5ae2d2e7 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:20.376220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1178/2357] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:30:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:30:20.722250 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef6cd1-4142-4af8-a245-ad8f4d14a1c7 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:20.724623 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-41ef6cd1-4142-4af8-a245-ad8f4d14a1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:20.777195 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef6cd1-4142-4af8-a245-ad8f4d14a1c7 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:20.784472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc37cd2-43de-430a-b52e-22453572ca29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57c8b894e74c709ea389ed462184fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:20.785223 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc37cd2-43de-430a-b52e-22453572ca29 service placement] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:20.785744 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc37cd2-43de-430a-b52e-22453572ca29 service placement] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:20.786226 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc37cd2-43de-430a-b52e-22453572ca29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:20.788436 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-8bc37cd2-43de-430a-b52e-22453572ca29 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:20.806823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc37cd2-43de-430a-b52e-22453572ca29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:20.809718 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc37cd2-43de-430a-b52e-22453572ca29 service placement] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:20.828403 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1180/2358] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:30:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:30:24.097043 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87c1be-9016-4f31-a373-5f3d5ae2d2e7 service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:24.121171 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87c1be-9016-4f31-a373-5f3d5ae2d2e7 service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:24.136251 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8e109-7cfc-48be-9338-3dbf370e6e8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:24.137556 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8e109-7cfc-48be-9338-3dbf370e6e8d service nova] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:24.138370 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8e109-7cfc-48be-9338-3dbf370e6e8d service nova] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:24.139011 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8e109-7cfc-48be-9338-3dbf370e6e8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:24.142834 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-a4f8e109-7cfc-48be-9338-3dbf370e6e8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:24.166800 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8e109-7cfc-48be-9338-3dbf370e6e8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:24.170408 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8e109-7cfc-48be-9338-3dbf370e6e8d service nova] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:24.199797 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1179/2359] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:30:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:30:26.807888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc37cd2-43de-430a-b52e-22453572ca29 service placement] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:26.820080 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc37cd2-43de-430a-b52e-22453572ca29 service placement] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:26.825563 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a6685-f882-48ce-92f3-13548fcf68bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:26.826506 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a6685-f882-48ce-92f3-13548fcf68bc service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:26.826968 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a6685-f882-48ce-92f3-13548fcf68bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:26.827497 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a6685-f882-48ce-92f3-13548fcf68bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:26.851058 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a6685-f882-48ce-92f3-13548fcf68bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:26.852797 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a6685-f882-48ce-92f3-13548fcf68bc service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:26.865642 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1181/2360] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:30:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:30:29.390249 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8e109-7cfc-48be-9338-3dbf370e6e8d service nova] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:29.407195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8e109-7cfc-48be-9338-3dbf370e6e8d service nova] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:29.416267 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89375bab-b5e0-484c-bb66-fa7b296aa776 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:29.417506 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89375bab-b5e0-484c-bb66-fa7b296aa776 service nova] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:29.418059 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89375bab-b5e0-484c-bb66-fa7b296aa776 service nova] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:29.418657 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89375bab-b5e0-484c-bb66-fa7b296aa776 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:29.422504 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-89375bab-b5e0-484c-bb66-fa7b296aa776 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:29.449055 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89375bab-b5e0-484c-bb66-fa7b296aa776 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:29.450929 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89375bab-b5e0-484c-bb66-fa7b296aa776 service nova] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:29.463306 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1180/2361] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:30:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:30:36.404433 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a6685-f882-48ce-92f3-13548fcf68bc service neutron] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:36.410167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=31 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:30:36.424552 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a6685-f882-48ce-92f3-13548fcf68bc service neutron] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:36.432558 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ad2f4-b9bf-4d8a-8ab5-297701e19c3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:36.433767 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ad2f4-b9bf-4d8a-8ab5-297701e19c3b service nova] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:36.433913 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ad2f4-b9bf-4d8a-8ab5-297701e19c3b service nova] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:36.434073 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ad2f4-b9bf-4d8a-8ab5-297701e19c3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:36.443539 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ad2f4-b9bf-4d8a-8ab5-297701e19c3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:36.445190 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ad2f4-b9bf-4d8a-8ab5-297701e19c3b service nova] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:36.457684 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1182/2362] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:30:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:30:39.457701 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=33 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:30:46.450381 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=5 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:11.252645 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89375bab-b5e0-484c-bb66-fa7b296aa776 service nova] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:11.266600 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89375bab-b5e0-484c-bb66-fa7b296aa776 service nova] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:11.275582 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdeb800-ab96-4e26-b748-19123d3f2c9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:11.276951 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdeb800-ab96-4e26-b748-19123d3f2c9a service nova] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:11.277182 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdeb800-ab96-4e26-b748-19123d3f2c9a service nova] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:11.277681 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdeb800-ab96-4e26-b748-19123d3f2c9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:11.292635 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdeb800-ab96-4e26-b748-19123d3f2c9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:11.295718 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdeb800-ab96-4e26-b748-19123d3f2c9a service nova] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:11.337660 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1181/2363] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:31:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:31:21.334935 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=13 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:36.409423 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ad2f4-b9bf-4d8a-8ab5-297701e19c3b service nova] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:36.410841 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-655ad2f4-b9bf-4d8a-8ab5-297701e19c3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:36.423050 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ad2f4-b9bf-4d8a-8ab5-297701e19c3b service nova] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:36.426807 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378ce43-0107-4c22-b504-c739ccf39d45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:36.427806 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378ce43-0107-4c22-b504-c739ccf39d45 service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:36.427806 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378ce43-0107-4c22-b504-c739ccf39d45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:36.428072 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378ce43-0107-4c22-b504-c739ccf39d45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:36.437329 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6378ce43-0107-4c22-b504-c739ccf39d45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:36.438794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6378ce43-0107-4c22-b504-c739ccf39d45 service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:36.447617 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1183/2364] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:31:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:31:41.040071 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdeb800-ab96-4e26-b748-19123d3f2c9a service nova] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:41.049360 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdeb800-ab96-4e26-b748-19123d3f2c9a service nova] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:41.053089 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0b43d-7f6f-4204-9645-375bf968c625 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:41.053735 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0b43d-7f6f-4204-9645-375bf968c625 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:41.054021 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0b43d-7f6f-4204-9645-375bf968c625 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:41.054295 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0b43d-7f6f-4204-9645-375bf968c625 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:41.061921 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0b43d-7f6f-4204-9645-375bf968c625 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:41.063389 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0b43d-7f6f-4204-9645-375bf968c625 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:41.072295 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1182/2365] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:31:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:31:46.443488 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=6 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:51.067837 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=6 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:32:19.923408 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378ce43-0107-4c22-b504-c739ccf39d45 service cinder] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:32:19.932584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378ce43-0107-4c22-b504-c739ccf39d45 service cinder] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:32:19.936170 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f63a5f-9cdf-4ff8-bc11-d37d934bef0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:32:19.936798 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f63a5f-9cdf-4ff8-bc11-d37d934bef0d service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:32:19.937080 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f63a5f-9cdf-4ff8-bc11-d37d934bef0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:32:19.937361 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f63a5f-9cdf-4ff8-bc11-d37d934bef0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:32:19.945553 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f63a5f-9cdf-4ff8-bc11-d37d934bef0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:32:19.947027 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f63a5f-9cdf-4ff8-bc11-d37d934bef0d service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:32:19.973269 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1184/2366] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:32:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:32:29.970749 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=13 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:32:40.787765 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0b43d-7f6f-4204-9645-375bf968c625 service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:32:40.797083 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0b43d-7f6f-4204-9645-375bf968c625 service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:32:40.800620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a2096-feca-456f-90d7-cb42677b5da2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:32:40.801251 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a2096-feca-456f-90d7-cb42677b5da2 service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:32:40.801536 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a2096-feca-456f-90d7-cb42677b5da2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:32:40.801811 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a2096-feca-456f-90d7-cb42677b5da2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:32:40.811269 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a2096-feca-456f-90d7-cb42677b5da2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:32:40.812695 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a2096-feca-456f-90d7-cb42677b5da2 service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:32:40.840754 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1183/2367] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:32:40 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:32:50.837628 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=13 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:33:05.215175 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f63a5f-9cdf-4ff8-bc11-d37d934bef0d service cinder] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:33:05.248732 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f63a5f-9cdf-4ff8-bc11-d37d934bef0d service cinder] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:33:05.253565 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a8551-8063-4e79-8db4-a234e75bdbad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:33:05.254250 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a8551-8063-4e79-8db4-a234e75bdbad service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:33:05.254553 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a8551-8063-4e79-8db4-a234e75bdbad service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:33:05.254868 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a8551-8063-4e79-8db4-a234e75bdbad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:33:05.280811 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a8551-8063-4e79-8db4-a234e75bdbad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:33:05.282281 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a8551-8063-4e79-8db4-a234e75bdbad service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:33:05.311661 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1185/2368] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:33:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:33:15.308792 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=24 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:34:40.362857 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a2096-feca-456f-90d7-cb42677b5da2 service cinder] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:34:40.549658 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a2096-feca-456f-90d7-cb42677b5da2 service cinder] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:34:40.555809 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c7b3f-ee5d-4668-8ce1-4b1fecf3346e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57c8b894e74c709ea389ed462184fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:34:40.556389 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c7b3f-ee5d-4668-8ce1-4b1fecf3346e service placement] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:34:40.556685 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c7b3f-ee5d-4668-8ce1-4b1fecf3346e service placement] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:34:40.556946 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c7b3f-ee5d-4668-8ce1-4b1fecf3346e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:34:40.558983 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-f42c7b3f-ee5d-4668-8ce1-4b1fecf3346e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:34:40.598042 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c7b3f-ee5d-4668-8ce1-4b1fecf3346e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:34:40.599681 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c7b3f-ee5d-4668-8ce1-4b1fecf3346e service placement] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:34:40.610593 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1184/2369] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:34:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:34:42.170741 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a8551-8063-4e79-8db4-a234e75bdbad service cinder] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:34:42.174027 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-196a8551-8063-4e79-8db4-a234e75bdbad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:34:42.307710 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a8551-8063-4e79-8db4-a234e75bdbad service cinder] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:34:42.313270 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15aaa62-dbdd-4d83-93a2-031080c8bbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:34:42.314254 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15aaa62-dbdd-4d83-93a2-031080c8bbce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:34:42.314581 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15aaa62-dbdd-4d83-93a2-031080c8bbce admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:34:42.314761 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15aaa62-dbdd-4d83-93a2-031080c8bbce admin admin] PATH_INFO: `/v3/users/3bbd836b67ff4cf0b3787e2d0fff67c6` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:34:42.334562 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15aaa62-dbdd-4d83-93a2-031080c8bbce admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bbd836b67ff4cf0b3787e2d0fff67c6)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:34:42.337259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15aaa62-dbdd-4d83-93a2-031080c8bbce admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:34:42.408367 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e15aaa62-dbdd-4d83-93a2-031080c8bbce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bbd836b67ff4cf0b3787e2d0fff67c6'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:34:42.409202 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e15aaa62-dbdd-4d83-93a2-031080c8bbce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bbd836b67ff4cf0b3787e2d0fff67c6'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:34:42.427194 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e15aaa62-dbdd-4d83-93a2-031080c8bbce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bbd836b67ff4cf0b3787e2d0fff67c6'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:34:42.438837 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e15aaa62-dbdd-4d83-93a2-031080c8bbce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bbd836b67ff4cf0b3787e2d0fff67c6'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:34:42.439866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e15aaa62-dbdd-4d83-93a2-031080c8bbce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bbd836b67ff4cf0b3787e2d0fff67c6'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:34:42.464486 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1186/2370] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:34:42 2022] DELETE /identity/v3/users/3bbd836b67ff4cf0b3787e2d0fff67c6 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:34:42.471411 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62385421-d01b-4c9b-b9ae-24a3c544ba00 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:34:42.472123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62385421-d01b-4c9b-b9ae-24a3c544ba00 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:34:42.472123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62385421-d01b-4c9b-b9ae-24a3c544ba00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:34:42.517036 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-62385421-d01b-4c9b-b9ae-24a3c544ba00 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:34:42.519235 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-62385421-d01b-4c9b-b9ae-24a3c544ba00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:34:42.617526 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1185/2371] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:34:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:34:42.632965 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15aaa62-dbdd-4d83-93a2-031080c8bbce admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:34:42.635092 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-e15aaa62-dbdd-4d83-93a2-031080c8bbce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:34:42.688622 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:34:42.735063 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15aaa62-dbdd-4d83-93a2-031080c8bbce admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:34:42.738846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cced2c-1e10-4ae9-9b6b-153d7963fb1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:34:42.739513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cced2c-1e10-4ae9-9b6b-153d7963fb1d service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:34:42.739794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cced2c-1e10-4ae9-9b6b-153d7963fb1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:34:42.740074 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cced2c-1e10-4ae9-9b6b-153d7963fb1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:34:42.751576 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cced2c-1e10-4ae9-9b6b-153d7963fb1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:34:42.753324 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cced2c-1e10-4ae9-9b6b-153d7963fb1d service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:34:42.764928 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1187/2372] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:34:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:34:43.186677 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62385421-d01b-4c9b-b9ae-24a3c544ba00 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:34:43.188563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-62385421-d01b-4c9b-b9ae-24a3c544ba00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:34:43.210683 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62385421-d01b-4c9b-b9ae-24a3c544ba00 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:34:43.220464 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c5a2b-fd43-48be-a3eb-223edf15b514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:34:43.222172 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c5a2b-fd43-48be-a3eb-223edf15b514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:34:43.222874 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c5a2b-fd43-48be-a3eb-223edf15b514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:34:43.223696 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c5a2b-fd43-48be-a3eb-223edf15b514 admin admin] PATH_INFO: `/v3/projects/9bf20c09938648ee9b478fabe6f0202a` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:34:43.227131 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c5a2b-fd43-48be-a3eb-223edf15b514 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bf20c09938648ee9b478fabe6f0202a)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:34:43.246943 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c5a2b-fd43-48be-a3eb-223edf15b514 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:34:43.270734 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:34:43.356412 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ac0c5a2b-fd43-48be-a3eb-223edf15b514 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bf20c09938648ee9b478fabe6f0202a', 'request_id': 'req-ac0c5a2b-fd43-48be-a3eb-223edf15b514'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:34:43.369363 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ac0c5a2b-fd43-48be-a3eb-223edf15b514 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bf20c09938648ee9b478fabe6f0202a', 'request_id': 'req-ac0c5a2b-fd43-48be-a3eb-223edf15b514'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:34:43.379447 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ac0c5a2b-fd43-48be-a3eb-223edf15b514 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bf20c09938648ee9b478fabe6f0202a', 'request_id': 'req-ac0c5a2b-fd43-48be-a3eb-223edf15b514'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:34:43.399233 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ac0c5a2b-fd43-48be-a3eb-223edf15b514 admin admin] The token cache is being invalidate because project 9bf20c09938648ee9b478fabe6f0202a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:34:43.399595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ac0c5a2b-fd43-48be-a3eb-223edf15b514 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:34:43.400822 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ac0c5a2b-fd43-48be-a3eb-223edf15b514 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:34:43.403480 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1186/2373] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:34:43 2022] DELETE /identity/v3/projects/9bf20c09938648ee9b478fabe6f0202a => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:34:43.411837 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889c96e-3e70-4576-8b18-592455a4d9be None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:34:43.412790 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889c96e-3e70-4576-8b18-592455a4d9be None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:34:43.413119 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889c96e-3e70-4576-8b18-592455a4d9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:34:43.511185 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-b889c96e-3e70-4576-8b18-592455a4d9be None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:34:43.513164 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-b889c96e-3e70-4576-8b18-592455a4d9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:34:43.610390 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1188/2374] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:34:43.622057 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcb2ff-01e3-416c-9201-f9fcc9f33c43 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:34:43.622609 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcb2ff-01e3-416c-9201-f9fcc9f33c43 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:34:43.622771 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcb2ff-01e3-416c-9201-f9fcc9f33c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:34:43.661041 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-4edcb2ff-01e3-416c-9201-f9fcc9f33c43 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:34:43.662518 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-4edcb2ff-01e3-416c-9201-f9fcc9f33c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:34:43.673316 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1187/2375] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:34:43.678390 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889c96e-3e70-4576-8b18-592455a4d9be None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:34:43.689431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889c96e-3e70-4576-8b18-592455a4d9be None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:34:43.695464 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa4274-56ad-4d25-9cf2-3fac94088d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:34:43.696312 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa4274-56ad-4d25-9cf2-3fac94088d88 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:34:43.696601 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa4274-56ad-4d25-9cf2-3fac94088d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:34:43.696877 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa4274-56ad-4d25-9cf2-3fac94088d88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:34:43.697617 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa4274-56ad-4d25-9cf2-3fac94088d88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:34:43.697928 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa4274-56ad-4d25-9cf2-3fac94088d88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:34:43.699611 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa4274-56ad-4d25-9cf2-3fac94088d88 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:34:43.714032 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1189/2376] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:34:43.719137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcb2ff-01e3-416c-9201-f9fcc9f33c43 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:34:43.735043 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcb2ff-01e3-416c-9201-f9fcc9f33c43 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:34:43.742414 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509f1ad-cddd-474c-8ac5-44115d8bf78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:34:43.743337 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509f1ad-cddd-474c-8ac5-44115d8bf78a admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:34:43.743794 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509f1ad-cddd-474c-8ac5-44115d8bf78a admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:34:43.744214 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509f1ad-cddd-474c-8ac5-44115d8bf78a admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:34:43.745082 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509f1ad-cddd-474c-8ac5-44115d8bf78a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:34:43.747454 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509f1ad-cddd-474c-8ac5-44115d8bf78a admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:34:43.801234 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1188/2377] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:34:43 2022] POST /identity/v3/projects => generated 365 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:34:43.813144 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa4274-56ad-4d25-9cf2-3fac94088d88 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:34:43.826284 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa4274-56ad-4d25-9cf2-3fac94088d88 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:34:43.918060 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238c395-c4bb-4852-8df2-5a85c9a03df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:34:43.919763 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238c395-c4bb-4852-8df2-5a85c9a03df8 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:34:43.920441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238c395-c4bb-4852-8df2-5a85c9a03df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:34:43.921182 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238c395-c4bb-4852-8df2-5a85c9a03df8 admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:34:43.922214 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238c395-c4bb-4852-8df2-5a85c9a03df8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:34:43.925203 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238c395-c4bb-4852-8df2-5a85c9a03df8 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:34:43.968722 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1190/2378] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:34:43 2022] POST /identity/v3/users => generated 283 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:34:43.979755 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509f1ad-cddd-474c-8ac5-44115d8bf78a admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:34:43.993616 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509f1ad-cddd-474c-8ac5-44115d8bf78a admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:34:44.000641 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44012b-73f0-48ed-8ce4-4153f97e79a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:34:44.001340 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44012b-73f0-48ed-8ce4-4153f97e79a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:34:44.001623 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44012b-73f0-48ed-8ce4-4153f97e79a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:34:44.001987 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44012b-73f0-48ed-8ce4-4153f97e79a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:34:44.002763 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44012b-73f0-48ed-8ce4-4153f97e79a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:34:44.004412 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44012b-73f0-48ed-8ce4-4153f97e79a1 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:34:44.017731 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1189/2379] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:34:44.022777 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238c395-c4bb-4852-8df2-5a85c9a03df8 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:34:44.038853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238c395-c4bb-4852-8df2-5a85c9a03df8 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:34:44.044740 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa16be-8491-441a-85d8-5adfa9d78e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:34:44.045572 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa16be-8491-441a-85d8-5adfa9d78e3a admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:34:44.045956 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa16be-8491-441a-85d8-5adfa9d78e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:34:44.046337 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa16be-8491-441a-85d8-5adfa9d78e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:34:44.047253 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa16be-8491-441a-85d8-5adfa9d78e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:34:44.049211 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa16be-8491-441a-85d8-5adfa9d78e3a admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:34:44.064410 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1191/2380] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:34:44.071108 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44012b-73f0-48ed-8ce4-4153f97e79a1 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:34:44.084807 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44012b-73f0-48ed-8ce4-4153f97e79a1 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:34:44.094923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83cd12-f5a9-4206-a584-559a1970e2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:34:44.094923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83cd12-f5a9-4206-a584-559a1970e2e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:34:44.094923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83cd12-f5a9-4206-a584-559a1970e2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:34:44.094923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83cd12-f5a9-4206-a584-559a1970e2e6 admin admin] PATH_INFO: `/v3/projects/fb0a33309fac45168c53d8c2fd491ef9/users/513fc34c262d4203b503db988705a4d5/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:34:44.118614 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83cd12-f5a9-4206-a584-559a1970e2e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb0a33309fac45168c53d8c2fd491ef9, user_id=513fc34c262d4203b503db988705a4d5, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:34:44.122450 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83cd12-f5a9-4206-a584-559a1970e2e6 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:34:44.153245 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1190/2381] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:34:44 2022] PUT /identity/v3/projects/fb0a33309fac45168c53d8c2fd491ef9/users/513fc34c262d4203b503db988705a4d5/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:34:44.171385 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994eb7e-2f92-4c45-bb54-19e0b8c54aa9 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:34:44.171946 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994eb7e-2f92-4c45-bb54-19e0b8c54aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:34:44.172474 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994eb7e-2f92-4c45-bb54-19e0b8c54aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:34:44.182870 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:34:44.208363 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-8994eb7e-2f92-4c45-bb54-19e0b8c54aa9 None None] MFA Rules not processed for user `513fc34c262d4203b503db988705a4d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:34:44.209609 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-8994eb7e-2f92-4c45-bb54-19e0b8c54aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:34:44.299654 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1192/2382] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:34:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:34:44.309918 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83cd12-f5a9-4206-a584-559a1970e2e6 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:34:44.311843 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-0e83cd12-f5a9-4206-a584-559a1970e2e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:34:44.384185 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83cd12-f5a9-4206-a584-559a1970e2e6 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:34:44.389907 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fabe32-9bf3-484c-8603-48466877e22d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:34:44.391059 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fabe32-9bf3-484c-8603-48466877e22d service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:34:44.391562 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fabe32-9bf3-484c-8603-48466877e22d service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:34:44.392044 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fabe32-9bf3-484c-8603-48466877e22d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:34:44.408763 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fabe32-9bf3-484c-8603-48466877e22d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:34:44.411502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fabe32-9bf3-484c-8603-48466877e22d service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:34:44.424685 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1191/2383] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:34:44 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:34:54.290003 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=30 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:34:54.419528 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:35:05.940356 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994eb7e-2f92-4c45-bb54-19e0b8c54aa9 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:35:05.942035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-8994eb7e-2f92-4c45-bb54-19e0b8c54aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:35:06.030845 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994eb7e-2f92-4c45-bb54-19e0b8c54aa9 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:35:06.034842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb87349-e54b-42cb-9d05-19dc19dc1cb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:35:06.035513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb87349-e54b-42cb-9d05-19dc19dc1cb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:35:06.035798 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb87349-e54b-42cb-9d05-19dc19dc1cb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:35:06.036083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb87349-e54b-42cb-9d05-19dc19dc1cb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:35:06.038064 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-adb87349-e54b-42cb-9d05-19dc19dc1cb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:35:06.157093 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb87349-e54b-42cb-9d05-19dc19dc1cb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:35:06.159121 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb87349-e54b-42cb-9d05-19dc19dc1cb1 service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:35:06.186076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1193/2384] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:35:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:35:07.173875 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fabe32-9bf3-484c-8603-48466877e22d service cinder] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:35:07.176310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-23fabe32-9bf3-484c-8603-48466877e22d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:35:07.200694 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fabe32-9bf3-484c-8603-48466877e22d service cinder] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:35:07.205531 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1128522-a7d4-425a-aaac-a0c8943aa07f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:35:07.206201 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1128522-a7d4-425a-aaac-a0c8943aa07f service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:35:07.206483 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1128522-a7d4-425a-aaac-a0c8943aa07f service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:35:07.206802 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1128522-a7d4-425a-aaac-a0c8943aa07f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:35:07.208977 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-c1128522-a7d4-425a-aaac-a0c8943aa07f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:35:07.323150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1128522-a7d4-425a-aaac-a0c8943aa07f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:35:07.325216 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1128522-a7d4-425a-aaac-a0c8943aa07f service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:35:07.340880 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1192/2385] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:35:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:35:11.853712 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb87349-e54b-42cb-9d05-19dc19dc1cb1 service neutron] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:35:11.855299 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-adb87349-e54b-42cb-9d05-19dc19dc1cb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:35:11.957409 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb87349-e54b-42cb-9d05-19dc19dc1cb1 service neutron] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:35:11.968981 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638cd81-3c7a-4565-b940-2dc51694b801 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57c8b894e74c709ea389ed462184fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:35:11.969246 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638cd81-3c7a-4565-b940-2dc51694b801 service placement] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:35:11.969423 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638cd81-3c7a-4565-b940-2dc51694b801 service placement] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:35:11.969714 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638cd81-3c7a-4565-b940-2dc51694b801 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:35:11.972872 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-4638cd81-3c7a-4565-b940-2dc51694b801 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:35:11.991725 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4638cd81-3c7a-4565-b940-2dc51694b801 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:35:11.993765 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4638cd81-3c7a-4565-b940-2dc51694b801 service placement] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:35:12.011615 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1194/2386] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:35:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:35:16.227087 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1128522-a7d4-425a-aaac-a0c8943aa07f service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:35:16.228719 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-c1128522-a7d4-425a-aaac-a0c8943aa07f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:35:16.244579 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1128522-a7d4-425a-aaac-a0c8943aa07f service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:35:16.250110 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef729009-d5d8-41e0-8158-558be45970f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:35:16.251633 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef729009-d5d8-41e0-8158-558be45970f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:35:16.252130 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef729009-d5d8-41e0-8158-558be45970f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:35:16.252620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef729009-d5d8-41e0-8158-558be45970f7 admin admin] PATH_INFO: `/v3/users/60b67f91d3e14fc4922d94b97b0ee1f5` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:35:16.274269 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef729009-d5d8-41e0-8158-558be45970f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60b67f91d3e14fc4922d94b97b0ee1f5)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:35:16.277471 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef729009-d5d8-41e0-8158-558be45970f7 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:35:16.349296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ef729009-d5d8-41e0-8158-558be45970f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60b67f91d3e14fc4922d94b97b0ee1f5'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:35:16.352712 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ef729009-d5d8-41e0-8158-558be45970f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60b67f91d3e14fc4922d94b97b0ee1f5'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:35:16.373535 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ef729009-d5d8-41e0-8158-558be45970f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60b67f91d3e14fc4922d94b97b0ee1f5'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:35:16.374487 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ef729009-d5d8-41e0-8158-558be45970f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60b67f91d3e14fc4922d94b97b0ee1f5'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:35:16.384592 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ef729009-d5d8-41e0-8158-558be45970f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60b67f91d3e14fc4922d94b97b0ee1f5'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:35:16.402893 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1193/2387] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:35:16 2022] DELETE /identity/v3/users/60b67f91d3e14fc4922d94b97b0ee1f5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:35:16.701517 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638cd81-3c7a-4565-b940-2dc51694b801 service placement] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:35:16.717627 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:35:16.738582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638cd81-3c7a-4565-b940-2dc51694b801 service placement] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:35:16.823398 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a1f15-84a2-47d9-b641-bf36707268ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:35:16.825373 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a1f15-84a2-47d9-b641-bf36707268ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:35:16.825987 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a1f15-84a2-47d9-b641-bf36707268ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:35:16.826471 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a1f15-84a2-47d9-b641-bf36707268ba admin admin] PATH_INFO: `/v3/projects/74e6d0f5f9924604a213c60cac93349a` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:35:16.830612 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a1f15-84a2-47d9-b641-bf36707268ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=74e6d0f5f9924604a213c60cac93349a)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:35:16.833752 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a1f15-84a2-47d9-b641-bf36707268ba admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:35:16.956033 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-f45a1f15-84a2-47d9-b641-bf36707268ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74e6d0f5f9924604a213c60cac93349a', 'request_id': 'req-f45a1f15-84a2-47d9-b641-bf36707268ba'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:35:16.967506 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-f45a1f15-84a2-47d9-b641-bf36707268ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74e6d0f5f9924604a213c60cac93349a', 'request_id': 'req-f45a1f15-84a2-47d9-b641-bf36707268ba'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:35:16.981901 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-f45a1f15-84a2-47d9-b641-bf36707268ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74e6d0f5f9924604a213c60cac93349a', 'request_id': 'req-f45a1f15-84a2-47d9-b641-bf36707268ba'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:35:17.009473 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-f45a1f15-84a2-47d9-b641-bf36707268ba admin admin] The token cache is being invalidate because project 74e6d0f5f9924604a213c60cac93349a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:35:17.010100 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-f45a1f15-84a2-47d9-b641-bf36707268ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:35:17.011316 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-f45a1f15-84a2-47d9-b641-bf36707268ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:35:17.013984 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1195/2388] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:35:16 2022] DELETE /identity/v3/projects/74e6d0f5f9924604a213c60cac93349a => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:35:17.019589 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef729009-d5d8-41e0-8158-558be45970f7 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:35:17.022035 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-ef729009-d5d8-41e0-8158-558be45970f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:35:17.044959 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef729009-d5d8-41e0-8158-558be45970f7 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:35:17.121899 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:35:17.135729 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea296679-6f0d-4348-8274-57f49473b6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:35:17.136715 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea296679-6f0d-4348-8274-57f49473b6cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:35:17.137470 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea296679-6f0d-4348-8274-57f49473b6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:35:17.137948 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea296679-6f0d-4348-8274-57f49473b6cf admin admin] PATH_INFO: `/v3/users/fb128cfb3a0642f79610144328a0e366` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:35:17.161009 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea296679-6f0d-4348-8274-57f49473b6cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb128cfb3a0642f79610144328a0e366)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:35:17.163085 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea296679-6f0d-4348-8274-57f49473b6cf admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:35:17.229369 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ea296679-6f0d-4348-8274-57f49473b6cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb128cfb3a0642f79610144328a0e366'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:35:17.230495 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ea296679-6f0d-4348-8274-57f49473b6cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb128cfb3a0642f79610144328a0e366'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:35:17.251656 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ea296679-6f0d-4348-8274-57f49473b6cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb128cfb3a0642f79610144328a0e366'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:35:17.252559 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ea296679-6f0d-4348-8274-57f49473b6cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb128cfb3a0642f79610144328a0e366'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:35:17.267095 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ea296679-6f0d-4348-8274-57f49473b6cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb128cfb3a0642f79610144328a0e366'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:35:17.291513 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1194/2389] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:35:17 2022] DELETE /identity/v3/users/fb128cfb3a0642f79610144328a0e366 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:35:17.535531 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a1f15-84a2-47d9-b641-bf36707268ba admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:35:17.537119 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-f45a1f15-84a2-47d9-b641-bf36707268ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:35:17.562322 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a1f15-84a2-47d9-b641-bf36707268ba admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:35:17.652963 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c03f06-eea2-469e-92ce-bcaa5064087c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:35:17.653851 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c03f06-eea2-469e-92ce-bcaa5064087c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:35:17.654135 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c03f06-eea2-469e-92ce-bcaa5064087c admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:35:17.654441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c03f06-eea2-469e-92ce-bcaa5064087c admin admin] PATH_INFO: `/v3/projects/ad8f698b475e470f9c35a258fb132228` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:35:17.670992 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c03f06-eea2-469e-92ce-bcaa5064087c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad8f698b475e470f9c35a258fb132228)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:35:17.673294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c03f06-eea2-469e-92ce-bcaa5064087c admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:35:17.716675 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:35:17.742670 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-81c03f06-eea2-469e-92ce-bcaa5064087c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad8f698b475e470f9c35a258fb132228', 'request_id': 'req-81c03f06-eea2-469e-92ce-bcaa5064087c'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:35:17.749909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-81c03f06-eea2-469e-92ce-bcaa5064087c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad8f698b475e470f9c35a258fb132228', 'request_id': 'req-81c03f06-eea2-469e-92ce-bcaa5064087c'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:35:17.756574 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-81c03f06-eea2-469e-92ce-bcaa5064087c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad8f698b475e470f9c35a258fb132228', 'request_id': 'req-81c03f06-eea2-469e-92ce-bcaa5064087c'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:35:17.780143 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-81c03f06-eea2-469e-92ce-bcaa5064087c admin admin] The token cache is being invalidate because project ad8f698b475e470f9c35a258fb132228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:35:17.780438 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-81c03f06-eea2-469e-92ce-bcaa5064087c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:35:17.781126 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-81c03f06-eea2-469e-92ce-bcaa5064087c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:35:17.783421 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1196/2390] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:35:17 2022] DELETE /identity/v3/projects/ad8f698b475e470f9c35a258fb132228 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:35:26.513684 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea296679-6f0d-4348-8274-57f49473b6cf admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:35:26.515605 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-ea296679-6f0d-4348-8274-57f49473b6cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:35:26.592773 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea296679-6f0d-4348-8274-57f49473b6cf admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:35:26.662143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6627c4-14da-450d-a960-5b4d6e2ff65a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:35:26.662937 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6627c4-14da-450d-a960-5b4d6e2ff65a service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:35:26.663218 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6627c4-14da-450d-a960-5b4d6e2ff65a service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:35:26.663497 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6627c4-14da-450d-a960-5b4d6e2ff65a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:35:26.665479 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-5c6627c4-14da-450d-a960-5b4d6e2ff65a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:35:26.713814 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:35:26.770074 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6627c4-14da-450d-a960-5b4d6e2ff65a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:35:26.771703 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6627c4-14da-450d-a960-5b4d6e2ff65a service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:35:26.784162 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1195/2391] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:35:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:35:27.770410 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=14,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:35:36.732450 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c03f06-eea2-469e-92ce-bcaa5064087c admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:35:36.734463 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-81c03f06-eea2-469e-92ce-bcaa5064087c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:35:36.778749 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=18 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:35:36.805593 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c03f06-eea2-469e-92ce-bcaa5064087c admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:35:36.810081 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4004ce-d8ed-457f-b073-64235b530a3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:35:36.816515 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4004ce-d8ed-457f-b073-64235b530a3d service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:35:36.816846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4004ce-d8ed-457f-b073-64235b530a3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:35:36.817067 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4004ce-d8ed-457f-b073-64235b530a3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:35:36.820364 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-3a4004ce-d8ed-457f-b073-64235b530a3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:35:36.936232 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4004ce-d8ed-457f-b073-64235b530a3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:35:36.937893 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4004ce-d8ed-457f-b073-64235b530a3d service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:35:36.968017 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1197/2392] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:35:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:35:46.963775 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=61 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:36:11.241722 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6627c4-14da-450d-a960-5b4d6e2ff65a service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:36:11.257588 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6627c4-14da-450d-a960-5b4d6e2ff65a service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:36:11.262776 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e1237-b4c2-4a72-b155-0847b927543e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:36:11.263444 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e1237-b4c2-4a72-b155-0847b927543e service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:36:11.263737 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e1237-b4c2-4a72-b155-0847b927543e service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:36:11.264024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e1237-b4c2-4a72-b155-0847b927543e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:36:11.266343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-781e1237-b4c2-4a72-b155-0847b927543e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:36:11.381633 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e1237-b4c2-4a72-b155-0847b927543e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:36:11.383126 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e1237-b4c2-4a72-b155-0847b927543e service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:36:11.392943 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1196/2393] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:36:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:36:21.388827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=33 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:36:35.837875 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4004ce-d8ed-457f-b073-64235b530a3d service cinder] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:36:35.839749 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-3a4004ce-d8ed-457f-b073-64235b530a3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:36:35.859552 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4004ce-d8ed-457f-b073-64235b530a3d service cinder] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:36:35.870993 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd275dbc-5dbc-4f0e-a005-82426a72e816 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:36:35.872357 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd275dbc-5dbc-4f0e-a005-82426a72e816 service nova] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:36:35.872482 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd275dbc-5dbc-4f0e-a005-82426a72e816 service nova] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:36:35.873216 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd275dbc-5dbc-4f0e-a005-82426a72e816 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:36:35.875826 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-fd275dbc-5dbc-4f0e-a005-82426a72e816 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:36:35.994938 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd275dbc-5dbc-4f0e-a005-82426a72e816 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:36:35.996590 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd275dbc-5dbc-4f0e-a005-82426a72e816 service nova] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:36:36.028186 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1198/2394] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:36:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:36:44.713967 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e1237-b4c2-4a72-b155-0847b927543e service cinder] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:36:44.715770 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-781e1237-b4c2-4a72-b155-0847b927543e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:36:44.728384 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e1237-b4c2-4a72-b155-0847b927543e service cinder] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:36:44.732154 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7d531-7989-4fb2-beac-240c67bb4087 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:36:44.732812 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7d531-7989-4fb2-beac-240c67bb4087 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:36:44.733090 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7d531-7989-4fb2-beac-240c67bb4087 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:36:44.733366 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7d531-7989-4fb2-beac-240c67bb4087 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:36:44.735460 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-1bb7d531-7989-4fb2-beac-240c67bb4087 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:36:44.746821 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7d531-7989-4fb2-beac-240c67bb4087 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:36:44.748284 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7d531-7989-4fb2-beac-240c67bb4087 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:36:44.757821 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1197/2395] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:36:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:36:46.023162 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=41 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:36:54.753114 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=6 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:37:05.248831 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd275dbc-5dbc-4f0e-a005-82426a72e816 service nova] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:37:05.274236 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd275dbc-5dbc-4f0e-a005-82426a72e816 service nova] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:37:05.287897 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972c9bd-7a6c-42b7-a60c-1d6e8455a3e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:37:05.289278 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972c9bd-7a6c-42b7-a60c-1d6e8455a3e7 service nova] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:37:05.289774 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972c9bd-7a6c-42b7-a60c-1d6e8455a3e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:37:05.290481 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972c9bd-7a6c-42b7-a60c-1d6e8455a3e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:37:05.293972 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-b972c9bd-7a6c-42b7-a60c-1d6e8455a3e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:37:05.309864 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972c9bd-7a6c-42b7-a60c-1d6e8455a3e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:37:05.311844 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972c9bd-7a6c-42b7-a60c-1d6e8455a3e7 service nova] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:37:05.338328 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1199/2396] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:37:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:37:15.319080 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=6 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:38:17.950343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7d531-7989-4fb2-beac-240c67bb4087 service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:38:17.968592 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7d531-7989-4fb2-beac-240c67bb4087 service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:38:17.977832 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f830a-9f43-4cc5-b6ac-eb8fc59a516b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:38:17.978529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f830a-9f43-4cc5-b6ac-eb8fc59a516b service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:38:17.978844 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f830a-9f43-4cc5-b6ac-eb8fc59a516b service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:38:17.979121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f830a-9f43-4cc5-b6ac-eb8fc59a516b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:38:17.980909 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-a65f830a-9f43-4cc5-b6ac-eb8fc59a516b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:38:18.053264 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f830a-9f43-4cc5-b6ac-eb8fc59a516b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:38:18.054738 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f830a-9f43-4cc5-b6ac-eb8fc59a516b service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:38:18.069851 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1198/2397] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:38:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:38:28.064040 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=37 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:39:47.360055 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972c9bd-7a6c-42b7-a60c-1d6e8455a3e7 service nova] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:39:47.361447 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-b972c9bd-7a6c-42b7-a60c-1d6e8455a3e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:39:47.433196 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972c9bd-7a6c-42b7-a60c-1d6e8455a3e7 service nova] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:39:47.438338 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d6567-5ab7-480f-baa4-fe52c1f0501d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57c8b894e74c709ea389ed462184fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:39:47.439026 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d6567-5ab7-480f-baa4-fe52c1f0501d service placement] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:39:47.439320 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d6567-5ab7-480f-baa4-fe52c1f0501d service placement] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:39:47.439598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d6567-5ab7-480f-baa4-fe52c1f0501d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:39:47.441988 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-436d6567-5ab7-480f-baa4-fe52c1f0501d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:39:47.454232 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d6567-5ab7-480f-baa4-fe52c1f0501d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:39:47.455903 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d6567-5ab7-480f-baa4-fe52c1f0501d service placement] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:39:47.466206 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1200/2398] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:39:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:39:57.461718 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=32 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:40:05.551864 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f830a-9f43-4cc5-b6ac-eb8fc59a516b service cinder] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:40:05.561537 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f830a-9f43-4cc5-b6ac-eb8fc59a516b service cinder] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:40:05.565143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d08e10-b89c-4120-9802-fcb729558086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:40:05.565791 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d08e10-b89c-4120-9802-fcb729558086 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:40:05.566066 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d08e10-b89c-4120-9802-fcb729558086 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:40:05.566339 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d08e10-b89c-4120-9802-fcb729558086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:40:05.568146 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-f5d08e10-b89c-4120-9802-fcb729558086 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:40:05.581983 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d08e10-b89c-4120-9802-fcb729558086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:40:05.583432 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d08e10-b89c-4120-9802-fcb729558086 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:40:05.595298 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1199/2399] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:40:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:40:15.590399 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=6 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:40:18.302020 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d6567-5ab7-480f-baa4-fe52c1f0501d service placement] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:40:18.311423 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d6567-5ab7-480f-baa4-fe52c1f0501d service placement] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:40:18.314994 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05230305-cb72-4555-832a-9f71e23accfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:40:18.315629 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05230305-cb72-4555-832a-9f71e23accfc service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:40:18.315913 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05230305-cb72-4555-832a-9f71e23accfc service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:40:18.316186 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05230305-cb72-4555-832a-9f71e23accfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:40:18.318442 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-05230305-cb72-4555-832a-9f71e23accfc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:40:18.377880 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05230305-cb72-4555-832a-9f71e23accfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:40:18.379931 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05230305-cb72-4555-832a-9f71e23accfc service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:40:18.389364 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1201/2400] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:40:18 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:40:26.706656 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d08e10-b89c-4120-9802-fcb729558086 service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:40:26.708157 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-f5d08e10-b89c-4120-9802-fcb729558086 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:40:26.718794 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d08e10-b89c-4120-9802-fcb729558086 service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:40:26.722445 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325386fa-4235-4b17-b4b7-1ec3367a349d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:40:26.723130 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325386fa-4235-4b17-b4b7-1ec3367a349d service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:40:26.723417 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325386fa-4235-4b17-b4b7-1ec3367a349d service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:40:26.724216 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325386fa-4235-4b17-b4b7-1ec3367a349d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:40:26.735588 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325386fa-4235-4b17-b4b7-1ec3367a349d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:40:26.737029 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325386fa-4235-4b17-b4b7-1ec3367a349d service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:40:26.749477 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1200/2401] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:40:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:40:28.385116 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=28 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:40:36.743707 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=6 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:40:37.466779 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05230305-cb72-4555-832a-9f71e23accfc service cinder] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:40:37.479960 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05230305-cb72-4555-832a-9f71e23accfc service cinder] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:40:37.485359 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e3dea-6438-452c-b910-128a5b0857f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:40:37.486002 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e3dea-6438-452c-b910-128a5b0857f4 service nova] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:40:37.486285 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e3dea-6438-452c-b910-128a5b0857f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:40:37.486558 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e3dea-6438-452c-b910-128a5b0857f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:40:37.496815 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e3dea-6438-452c-b910-128a5b0857f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:40:37.499172 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e3dea-6438-452c-b910-128a5b0857f4 service nova] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:40:37.510366 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1202/2402] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:40:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:40:47.505717 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=6 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:41:48.023255 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325386fa-4235-4b17-b4b7-1ec3367a349d service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:41:48.032398 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325386fa-4235-4b17-b4b7-1ec3367a349d service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:41:48.036022 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddd041-8892-4f55-b859-54e4cb37b0b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:41:48.036654 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddd041-8892-4f55-b859-54e4cb37b0b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:41:48.036938 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddd041-8892-4f55-b859-54e4cb37b0b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:41:48.037215 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddd041-8892-4f55-b859-54e4cb37b0b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:41:48.044374 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eddd041-8892-4f55-b859-54e4cb37b0b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:41:48.045804 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eddd041-8892-4f55-b859-54e4cb37b0b2 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:41:48.053864 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1201/2403] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:41:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:41:58.050734 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=6 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:42:18.651489 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e3dea-6438-452c-b910-128a5b0857f4 service nova] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:42:18.660667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e3dea-6438-452c-b910-128a5b0857f4 service nova] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:42:18.664210 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d6be0-1db5-443a-8fd0-8f7c7fe72fa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:42:18.665514 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d6be0-1db5-443a-8fd0-8f7c7fe72fa4 service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:42:18.665792 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d6be0-1db5-443a-8fd0-8f7c7fe72fa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:42:18.666064 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d6be0-1db5-443a-8fd0-8f7c7fe72fa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:42:18.674462 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d6be0-1db5-443a-8fd0-8f7c7fe72fa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:42:18.675925 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d6be0-1db5-443a-8fd0-8f7c7fe72fa4 service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:42:18.684636 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1203/2404] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:42:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:42:18.712807 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddd041-8892-4f55-b859-54e4cb37b0b2 service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:42:18.722227 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddd041-8892-4f55-b859-54e4cb37b0b2 service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:42:18.725730 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1c942-1fa5-4c89-a31e-1e199734433e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:42:18.726599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1c942-1fa5-4c89-a31e-1e199734433e service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:42:18.727594 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1c942-1fa5-4c89-a31e-1e199734433e service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:42:18.727810 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1c942-1fa5-4c89-a31e-1e199734433e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:42:18.737043 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1c942-1fa5-4c89-a31e-1e199734433e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:42:18.738483 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1c942-1fa5-4c89-a31e-1e199734433e service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:42:18.765256 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1202/2405] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:42:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:42:28.680650 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=6 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:42:28.762544 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=13 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:44:06.193140 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038841e-010b-4a0a-858b-87619ca9465a None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:44:06.193677 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038841e-010b-4a0a-858b-87619ca9465a None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:44:06.193677 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038841e-010b-4a0a-858b-87619ca9465a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:44:06.221223 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-b038841e-010b-4a0a-858b-87619ca9465a None None] MFA Rules not processed for user `026de546e4f448b3b5258cafedf8bf78`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:44:06.222426 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-b038841e-010b-4a0a-858b-87619ca9465a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:44:06.229273 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1204/2406] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:44:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:44:06.527960 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1c942-1fa5-4c89-a31e-1e199734433e service cinder] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:44:06.537207 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1c942-1fa5-4c89-a31e-1e199734433e service cinder] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:44:06.540810 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17823e17-370f-41e3-97c1-1fed33a5d8c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:44:06.541441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17823e17-370f-41e3-97c1-1fed33a5d8c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:44:06.541724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17823e17-370f-41e3-97c1-1fed33a5d8c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:44:06.541998 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17823e17-370f-41e3-97c1-1fed33a5d8c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:44:06.543770 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-17823e17-370f-41e3-97c1-1fed33a5d8c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:44:06.553215 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17823e17-370f-41e3-97c1-1fed33a5d8c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:44:06.554655 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17823e17-370f-41e3-97c1-1fed33a5d8c3 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:44:06.563301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1203/2407] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:44:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:44:06.886296 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038841e-010b-4a0a-858b-87619ca9465a None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:44:06.887686 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-b038841e-010b-4a0a-858b-87619ca9465a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:44:06.903675 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038841e-010b-4a0a-858b-87619ca9465a None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:44:06.909350 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b3d67-1d07-44e1-99ca-503e1028db33 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57c8b894e74c709ea389ed462184fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:44:06.909939 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b3d67-1d07-44e1-99ca-503e1028db33 service placement] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:44:06.910218 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b3d67-1d07-44e1-99ca-503e1028db33 service placement] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:44:06.910494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b3d67-1d07-44e1-99ca-503e1028db33 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:44:06.912735 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-c21b3d67-1d07-44e1-99ca-503e1028db33 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:44:06.930365 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b3d67-1d07-44e1-99ca-503e1028db33 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:44:06.932954 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b3d67-1d07-44e1-99ca-503e1028db33 service placement] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:44:06.944731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1205/2408] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:44:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:44:10.312210 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17823e17-370f-41e3-97c1-1fed33a5d8c3 service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:44:10.314358 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-17823e17-370f-41e3-97c1-1fed33a5d8c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:44:10.331459 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17823e17-370f-41e3-97c1-1fed33a5d8c3 service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:44:10.338274 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c93860-99b1-42a3-8592-c8c343edebd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:44:10.338985 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c93860-99b1-42a3-8592-c8c343edebd2 service nova] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:44:10.339273 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c93860-99b1-42a3-8592-c8c343edebd2 service nova] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:44:10.339548 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c93860-99b1-42a3-8592-c8c343edebd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:44:10.351643 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c93860-99b1-42a3-8592-c8c343edebd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:44:10.353836 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c93860-99b1-42a3-8592-c8c343edebd2 service nova] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:44:10.366687 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1204/2409] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:44:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:44:15.734083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b3d67-1d07-44e1-99ca-503e1028db33 service placement] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:44:15.748788 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b3d67-1d07-44e1-99ca-503e1028db33 service placement] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:44:15.754888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7299bb9-f61a-416c-85c5-279db73967eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:44:15.755438 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7299bb9-f61a-416c-85c5-279db73967eb service nova] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:44:15.755717 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7299bb9-f61a-416c-85c5-279db73967eb service nova] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:44:15.755990 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7299bb9-f61a-416c-85c5-279db73967eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:44:15.757835 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-d7299bb9-f61a-416c-85c5-279db73967eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:44:15.772051 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7299bb9-f61a-416c-85c5-279db73967eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:44:15.773666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7299bb9-f61a-416c-85c5-279db73967eb service nova] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:44:15.784896 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1206/2410] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:44:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:44:19.049757 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c93860-99b1-42a3-8592-c8c343edebd2 service nova] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:44:19.059832 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c93860-99b1-42a3-8592-c8c343edebd2 service nova] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:44:19.063536 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d162c7-4863-4689-8b40-cad916b728d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:44:19.064191 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d162c7-4863-4689-8b40-cad916b728d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:44:19.064479 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d162c7-4863-4689-8b40-cad916b728d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:44:19.064761 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d162c7-4863-4689-8b40-cad916b728d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:44:19.074335 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d162c7-4863-4689-8b40-cad916b728d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:44:19.075827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d162c7-4863-4689-8b40-cad916b728d7 service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:44:19.105012 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1205/2411] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:44:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:44:19.579359 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7299bb9-f61a-416c-85c5-279db73967eb service nova] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:44:19.590626 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7299bb9-f61a-416c-85c5-279db73967eb service nova] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:44:19.596199 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5eb92-b8cb-49c3-b637-71912edc8846 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:44:19.596850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5eb92-b8cb-49c3-b637-71912edc8846 service nova] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:44:19.597135 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5eb92-b8cb-49c3-b637-71912edc8846 service nova] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:44:19.597415 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5eb92-b8cb-49c3-b637-71912edc8846 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:44:19.599202 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-20e5eb92-b8cb-49c3-b637-71912edc8846 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:44:19.612449 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e5eb92-b8cb-49c3-b637-71912edc8846 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:44:19.614051 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e5eb92-b8cb-49c3-b637-71912edc8846 service nova] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:44:19.625224 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1207/2412] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:44:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:44:29.101714 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=25 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:44:29.620804 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=24 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:44:53.308493 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d162c7-4863-4689-8b40-cad916b728d7 service cinder] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:44:53.368044 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d162c7-4863-4689-8b40-cad916b728d7 service cinder] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:44:53.373504 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa6235-a083-425d-af96-e0beaf471882 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57c8b894e74c709ea389ed462184fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:44:53.374147 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa6235-a083-425d-af96-e0beaf471882 service placement] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:44:53.374425 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa6235-a083-425d-af96-e0beaf471882 service placement] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:44:53.374736 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa6235-a083-425d-af96-e0beaf471882 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:44:53.383184 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa6235-a083-425d-af96-e0beaf471882 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:44:53.385322 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa6235-a083-425d-af96-e0beaf471882 service placement] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:44:53.395386 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1206/2413] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:44:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:45:03.390990 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=27 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:46:19.422795 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5eb92-b8cb-49c3-b637-71912edc8846 service nova] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:46:19.424476 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-20e5eb92-b8cb-49c3-b637-71912edc8846 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:46:19.526037 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5eb92-b8cb-49c3-b637-71912edc8846 service nova] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:46:19.529907 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006f7b7-c203-4afa-85ec-a564a0c2f0ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:46:19.530552 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006f7b7-c203-4afa-85ec-a564a0c2f0ce service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:46:19.530864 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006f7b7-c203-4afa-85ec-a564a0c2f0ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:46:19.531144 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006f7b7-c203-4afa-85ec-a564a0c2f0ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:46:19.533023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-a006f7b7-c203-4afa-85ec-a564a0c2f0ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:46:19.613356 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006f7b7-c203-4afa-85ec-a564a0c2f0ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:46:19.614788 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006f7b7-c203-4afa-85ec-a564a0c2f0ce service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:46:19.633372 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1208/2414] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:46:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:46:19.676295 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa6235-a083-425d-af96-e0beaf471882 service placement] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:46:19.686036 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa6235-a083-425d-af96-e0beaf471882 service placement] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:46:19.689523 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c177e5-da55-4b03-bf2a-f2deb679d4b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:46:19.690150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c177e5-da55-4b03-bf2a-f2deb679d4b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:46:19.690430 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c177e5-da55-4b03-bf2a-f2deb679d4b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:46:19.690736 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c177e5-da55-4b03-bf2a-f2deb679d4b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:46:19.698979 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c177e5-da55-4b03-bf2a-f2deb679d4b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:46:19.700396 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c177e5-da55-4b03-bf2a-f2deb679d4b8 service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:46:19.728850 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1207/2415] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:46:19 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:46:29.630660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=79 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:46:29.724754 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=13 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:46:52.008721 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006f7b7-c203-4afa-85ec-a564a0c2f0ce service cinder] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:46:52.010361 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-a006f7b7-c203-4afa-85ec-a564a0c2f0ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:46:52.088617 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006f7b7-c203-4afa-85ec-a564a0c2f0ce service cinder] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:46:52.092220 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c47a7-7afc-4f5a-9811-adc361a059bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:46:52.092860 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c47a7-7afc-4f5a-9811-adc361a059bd service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:46:52.093146 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c47a7-7afc-4f5a-9811-adc361a059bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:46:52.093425 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c47a7-7afc-4f5a-9811-adc361a059bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:46:52.095306 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-3d5c47a7-7afc-4f5a-9811-adc361a059bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:46:52.105136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c47a7-7afc-4f5a-9811-adc361a059bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:46:52.106569 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c47a7-7afc-4f5a-9811-adc361a059bd service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:46:52.114521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1209/2416] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:46:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:47:02.111098 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=35 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:47:18.127649 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c177e5-da55-4b03-bf2a-f2deb679d4b8 service cinder] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:47:18.129073 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-92c177e5-da55-4b03-bf2a-f2deb679d4b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:47:18.140417 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c177e5-da55-4b03-bf2a-f2deb679d4b8 service cinder] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:47:18.144347 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb321948-f086-46ed-97dc-21f219dd564e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:47:18.144989 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb321948-f086-46ed-97dc-21f219dd564e service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:47:18.145274 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb321948-f086-46ed-97dc-21f219dd564e service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:47:18.145553 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb321948-f086-46ed-97dc-21f219dd564e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:47:18.147454 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-eb321948-f086-46ed-97dc-21f219dd564e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:47:18.234257 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb321948-f086-46ed-97dc-21f219dd564e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:47:18.235785 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb321948-f086-46ed-97dc-21f219dd564e service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:47:18.255559 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1208/2417] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:47:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:47:18.283121 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c47a7-7afc-4f5a-9811-adc361a059bd service neutron] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:47:18.293314 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c47a7-7afc-4f5a-9811-adc361a059bd service neutron] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:47:18.296882 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb9619-d9a0-4fdd-a122-ac92c9f2cebb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:47:18.297516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb9619-d9a0-4fdd-a122-ac92c9f2cebb service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:47:18.297796 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb9619-d9a0-4fdd-a122-ac92c9f2cebb service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:47:18.298070 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb9619-d9a0-4fdd-a122-ac92c9f2cebb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:47:18.299908 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-43bb9619-d9a0-4fdd-a122-ac92c9f2cebb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:47:18.368955 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb9619-d9a0-4fdd-a122-ac92c9f2cebb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:47:18.370399 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb9619-d9a0-4fdd-a122-ac92c9f2cebb service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:47:18.379227 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1210/2418] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:47:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:47:28.252121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=41 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:47:28.375107 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=33 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:49:06.320665 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb321948-f086-46ed-97dc-21f219dd564e service cinder] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:49:06.329964 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb321948-f086-46ed-97dc-21f219dd564e service cinder] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:49:06.333445 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ffcca-bfda-4dd0-b2b7-8c4db15c7625 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:49:06.334082 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ffcca-bfda-4dd0-b2b7-8c4db15c7625 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:49:06.334364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ffcca-bfda-4dd0-b2b7-8c4db15c7625 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:49:06.334681 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ffcca-bfda-4dd0-b2b7-8c4db15c7625 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:49:06.336554 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-b11ffcca-bfda-4dd0-b2b7-8c4db15c7625 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:49:06.435815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ffcca-bfda-4dd0-b2b7-8c4db15c7625 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:49:06.437263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ffcca-bfda-4dd0-b2b7-8c4db15c7625 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:49:06.459485 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1209/2419] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:49:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:49:09.799796 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb9619-d9a0-4fdd-a122-ac92c9f2cebb service cinder] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:49:09.816840 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb9619-d9a0-4fdd-a122-ac92c9f2cebb service cinder] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:49:09.823127 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1a516-dcb2-49ac-8765-1666daab3f96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:49:09.823897 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1a516-dcb2-49ac-8765-1666daab3f96 service nova] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:49:09.824265 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1a516-dcb2-49ac-8765-1666daab3f96 service nova] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:49:09.824604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1a516-dcb2-49ac-8765-1666daab3f96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:49:09.827184 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-e9a1a516-dcb2-49ac-8765-1666daab3f96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:49:09.842328 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1a516-dcb2-49ac-8765-1666daab3f96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:49:09.845656 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1a516-dcb2-49ac-8765-1666daab3f96 service nova] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:49:09.857865 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1211/2420] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:49:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:49:11.218899 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ffcca-bfda-4dd0-b2b7-8c4db15c7625 service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:49:11.228296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ffcca-bfda-4dd0-b2b7-8c4db15c7625 service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:49:11.232057 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbd05f-fdd7-4e7d-9ca9-39333c20a6a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:49:11.232706 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbd05f-fdd7-4e7d-9ca9-39333c20a6a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:49:11.232987 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbd05f-fdd7-4e7d-9ca9-39333c20a6a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:49:11.233292 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbd05f-fdd7-4e7d-9ca9-39333c20a6a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:49:11.235119 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-f7dbd05f-fdd7-4e7d-9ca9-39333c20a6a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:49:11.345449 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbd05f-fdd7-4e7d-9ca9-39333c20a6a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:49:11.349200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbd05f-fdd7-4e7d-9ca9-39333c20a6a1 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:49:11.377441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1210/2421] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:49:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:49:14.637886 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1a516-dcb2-49ac-8765-1666daab3f96 service nova] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:49:14.650239 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1a516-dcb2-49ac-8765-1666daab3f96 service nova] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:49:14.655275 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a59f49-3da1-4605-a389-38d3c7912868 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57c8b894e74c709ea389ed462184fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:49:14.655920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a59f49-3da1-4605-a389-38d3c7912868 service placement] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:49:14.656323 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a59f49-3da1-4605-a389-38d3c7912868 service placement] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:49:14.656582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a59f49-3da1-4605-a389-38d3c7912868 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:49:14.658385 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-03a59f49-3da1-4605-a389-38d3c7912868 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:49:14.694874 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbd05f-fdd7-4e7d-9ca9-39333c20a6a1 service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:49:14.696312 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-f7dbd05f-fdd7-4e7d-9ca9-39333c20a6a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:49:14.705476 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a59f49-3da1-4605-a389-38d3c7912868 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:49:14.709051 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a59f49-3da1-4605-a389-38d3c7912868 service placement] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:49:14.716441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbd05f-fdd7-4e7d-9ca9-39333c20a6a1 service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:49:14.720670 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1212/2422] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:49:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:49:14.721956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c121ce0-da65-48e5-94b3-cf842fa70ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:49:14.723279 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c121ce0-da65-48e5-94b3-cf842fa70ebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:49:14.723778 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c121ce0-da65-48e5-94b3-cf842fa70ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:49:14.724123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c121ce0-da65-48e5-94b3-cf842fa70ebd admin admin] PATH_INFO: `/v3/users/c78b0769644d48aa9a9c03a9a1566dd0` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:49:14.749257 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c121ce0-da65-48e5-94b3-cf842fa70ebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c78b0769644d48aa9a9c03a9a1566dd0)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:49:14.751346 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c121ce0-da65-48e5-94b3-cf842fa70ebd admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:49:14.765228 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:49:14.824311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-6c121ce0-da65-48e5-94b3-cf842fa70ebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c78b0769644d48aa9a9c03a9a1566dd0'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:49:14.824976 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-6c121ce0-da65-48e5-94b3-cf842fa70ebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c78b0769644d48aa9a9c03a9a1566dd0'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:49:14.837866 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-6c121ce0-da65-48e5-94b3-cf842fa70ebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c78b0769644d48aa9a9c03a9a1566dd0'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:49:14.838566 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-6c121ce0-da65-48e5-94b3-cf842fa70ebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c78b0769644d48aa9a9c03a9a1566dd0'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:49:14.848021 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-6c121ce0-da65-48e5-94b3-cf842fa70ebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c78b0769644d48aa9a9c03a9a1566dd0'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:49:14.860411 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1211/2423] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:49:14 2022] DELETE /identity/v3/users/c78b0769644d48aa9a9c03a9a1566dd0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:49:15.054190 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a59f49-3da1-4605-a389-38d3c7912868 service placement] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:49:15.076738 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a59f49-3da1-4605-a389-38d3c7912868 service placement] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:49:15.153162 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492662a-4264-4ddf-bf07-654e6aa667bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:49:15.154073 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492662a-4264-4ddf-bf07-654e6aa667bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:49:15.154358 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492662a-4264-4ddf-bf07-654e6aa667bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:49:15.154655 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492662a-4264-4ddf-bf07-654e6aa667bd admin admin] PATH_INFO: `/v3/projects/d1772e35c9ca43d590f7738ac5163db3` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:49:15.155899 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492662a-4264-4ddf-bf07-654e6aa667bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1772e35c9ca43d590f7738ac5163db3)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:49:15.157850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492662a-4264-4ddf-bf07-654e6aa667bd admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:49:15.208253 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e492662a-4264-4ddf-bf07-654e6aa667bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1772e35c9ca43d590f7738ac5163db3', 'request_id': 'req-e492662a-4264-4ddf-bf07-654e6aa667bd'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:49:15.214412 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e492662a-4264-4ddf-bf07-654e6aa667bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1772e35c9ca43d590f7738ac5163db3', 'request_id': 'req-e492662a-4264-4ddf-bf07-654e6aa667bd'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:49:15.219945 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e492662a-4264-4ddf-bf07-654e6aa667bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1772e35c9ca43d590f7738ac5163db3', 'request_id': 'req-e492662a-4264-4ddf-bf07-654e6aa667bd'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:49:15.233359 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e492662a-4264-4ddf-bf07-654e6aa667bd admin admin] The token cache is being invalidate because project d1772e35c9ca43d590f7738ac5163db3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:49:15.233663 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e492662a-4264-4ddf-bf07-654e6aa667bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:49:15.234300 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e492662a-4264-4ddf-bf07-654e6aa667bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:49:15.235905 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1213/2424] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:49:15 2022] DELETE /identity/v3/projects/d1772e35c9ca43d590f7738ac5163db3 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:49:15.242371 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e850cd-2a5c-4b81-ae0e-2575c795521e None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:49:15.242685 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e850cd-2a5c-4b81-ae0e-2575c795521e None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:49:15.242971 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e850cd-2a5c-4b81-ae0e-2575c795521e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:49:15.299934 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-94e850cd-2a5c-4b81-ae0e-2575c795521e None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:49:15.301663 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-94e850cd-2a5c-4b81-ae0e-2575c795521e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:49:15.365760 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1212/2425] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:49:15.373372 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7ff40-1a38-4a4a-a5e2-7f1fb3e4161a None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:49:15.373663 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7ff40-1a38-4a4a-a5e2-7f1fb3e4161a None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:49:15.373953 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7ff40-1a38-4a4a-a5e2-7f1fb3e4161a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:49:15.393345 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-22c7ff40-1a38-4a4a-a5e2-7f1fb3e4161a None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:49:15.394629 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-22c7ff40-1a38-4a4a-a5e2-7f1fb3e4161a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:49:15.402904 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1214/2426] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:49:15.407140 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e850cd-2a5c-4b81-ae0e-2575c795521e None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:49:15.416847 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e850cd-2a5c-4b81-ae0e-2575c795521e None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:49:15.421446 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c6783-a321-47dd-912d-fda2aa6f2ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:49:15.422160 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c6783-a321-47dd-912d-fda2aa6f2ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:49:15.422391 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c6783-a321-47dd-912d-fda2aa6f2ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:49:15.422705 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c6783-a321-47dd-912d-fda2aa6f2ae9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:49:15.423435 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c6783-a321-47dd-912d-fda2aa6f2ae9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:49:15.423746 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c6783-a321-47dd-912d-fda2aa6f2ae9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:49:15.425900 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c6783-a321-47dd-912d-fda2aa6f2ae9 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:49:15.438327 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1213/2427] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:49:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:49:15.443214 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7ff40-1a38-4a4a-a5e2-7f1fb3e4161a None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:49:15.452564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7ff40-1a38-4a4a-a5e2-7f1fb3e4161a None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:49:15.457313 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e087fa-475a-4185-8d20-05d8d526f0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:49:15.457975 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e087fa-475a-4185-8d20-05d8d526f0b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:49:15.458257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e087fa-475a-4185-8d20-05d8d526f0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:49:15.458559 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e087fa-475a-4185-8d20-05d8d526f0b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:49:15.459287 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e087fa-475a-4185-8d20-05d8d526f0b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:49:15.461682 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e087fa-475a-4185-8d20-05d8d526f0b5 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:49:15.497931 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1215/2428] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:49:15 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:49:15.502194 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c6783-a321-47dd-912d-fda2aa6f2ae9 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:49:15.512667 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c6783-a321-47dd-912d-fda2aa6f2ae9 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:49:15.557634 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:49:15.581552 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7821a-c4b1-43d0-b539-1c8e634a26b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:49:15.582263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7821a-c4b1-43d0-b539-1c8e634a26b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:49:15.582569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7821a-c4b1-43d0-b539-1c8e634a26b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:49:15.582875 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7821a-c4b1-43d0-b539-1c8e634a26b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:49:15.583587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7821a-c4b1-43d0-b539-1c8e634a26b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:49:15.585506 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7821a-c4b1-43d0-b539-1c8e634a26b9 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:49:15.610392 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1214/2429] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:49:15 2022] POST /identity/v3/users => generated 284 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:49:15.611675 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e087fa-475a-4185-8d20-05d8d526f0b5 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:49:15.622567 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e087fa-475a-4185-8d20-05d8d526f0b5 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:49:15.627449 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8393f-4218-4bfd-ade7-716a36bc2d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:49:15.628132 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8393f-4218-4bfd-ade7-716a36bc2d86 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:49:15.628411 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8393f-4218-4bfd-ade7-716a36bc2d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:49:15.628684 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8393f-4218-4bfd-ade7-716a36bc2d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:49:15.629412 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8393f-4218-4bfd-ade7-716a36bc2d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:49:15.631153 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8393f-4218-4bfd-ade7-716a36bc2d86 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:49:15.641776 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1216/2430] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:49:15.646281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7821a-c4b1-43d0-b539-1c8e634a26b9 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:49:15.656782 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7821a-c4b1-43d0-b539-1c8e634a26b9 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:49:15.663955 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcb795-b018-4d2f-8fe3-bb48bd0d7c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:49:15.664627 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcb795-b018-4d2f-8fe3-bb48bd0d7c8e admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:49:15.664911 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcb795-b018-4d2f-8fe3-bb48bd0d7c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:49:15.665187 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcb795-b018-4d2f-8fe3-bb48bd0d7c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:49:15.665916 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fcb795-b018-4d2f-8fe3-bb48bd0d7c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:49:15.667578 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fcb795-b018-4d2f-8fe3-bb48bd0d7c8e admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:49:15.678659 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1215/2431] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:49:15.682819 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8393f-4218-4bfd-ade7-716a36bc2d86 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:49:15.689267 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:49:15.693706 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8393f-4218-4bfd-ade7-716a36bc2d86 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:49:15.699240 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45f030-959b-4871-8774-d76444453810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:49:15.700133 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45f030-959b-4871-8774-d76444453810 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:49:15.700715 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45f030-959b-4871-8774-d76444453810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:49:15.701180 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45f030-959b-4871-8774-d76444453810 admin admin] PATH_INFO: `/v3/projects/111ec6f4f16942fcbb19b9c22549566d/users/9d0424e009274b81a07b7549c1a4f662/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:49:15.717633 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be45f030-959b-4871-8774-d76444453810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=111ec6f4f16942fcbb19b9c22549566d, user_id=9d0424e009274b81a07b7549c1a4f662, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:49:15.723069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be45f030-959b-4871-8774-d76444453810 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:49:15.741542 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1217/2432] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:49:15 2022] PUT /identity/v3/projects/111ec6f4f16942fcbb19b9c22549566d/users/9d0424e009274b81a07b7549c1a4f662/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:49:15.752509 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e724b00-d416-49ed-8639-2e71257111c7 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:49:15.753047 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e724b00-d416-49ed-8639-2e71257111c7 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:49:15.753047 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e724b00-d416-49ed-8639-2e71257111c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:49:15.781645 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-8e724b00-d416-49ed-8639-2e71257111c7 None None] MFA Rules not processed for user `9d0424e009274b81a07b7549c1a4f662`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:49:15.782887 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-8e724b00-d416-49ed-8639-2e71257111c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:49:15.853748 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1216/2433] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:49:15 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:49:15.888369 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45f030-959b-4871-8774-d76444453810 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:49:15.890712 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-be45f030-959b-4871-8774-d76444453810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:49:15.958386 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45f030-959b-4871-8774-d76444453810 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:49:15.962161 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652cd26-7393-4735-a147-94f01ca2f8e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:49:15.962848 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652cd26-7393-4735-a147-94f01ca2f8e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:49:15.963132 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652cd26-7393-4735-a147-94f01ca2f8e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:49:15.963410 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652cd26-7393-4735-a147-94f01ca2f8e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:49:15.972852 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652cd26-7393-4735-a147-94f01ca2f8e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:49:15.974319 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652cd26-7393-4735-a147-94f01ca2f8e8 service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:49:15.983732 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1218/2434] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:49:15 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:49:25.847772 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=47,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:49:25.979388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=38,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:49:58.312495 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e724b00-d416-49ed-8639-2e71257111c7 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:49:58.313927 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-8e724b00-d416-49ed-8639-2e71257111c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:49:58.382464 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e724b00-d416-49ed-8639-2e71257111c7 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:49:58.387468 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6495843-ebcf-4e5f-9bfb-c5ff88a8f2c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57c8b894e74c709ea389ed462184fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:49:58.388120 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6495843-ebcf-4e5f-9bfb-c5ff88a8f2c4 service placement] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:49:58.388674 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6495843-ebcf-4e5f-9bfb-c5ff88a8f2c4 service placement] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:49:58.388947 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6495843-ebcf-4e5f-9bfb-c5ff88a8f2c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:49:58.390737 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-c6495843-ebcf-4e5f-9bfb-c5ff88a8f2c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:49:58.401934 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6495843-ebcf-4e5f-9bfb-c5ff88a8f2c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:49:58.403534 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6495843-ebcf-4e5f-9bfb-c5ff88a8f2c4 service placement] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:49:58.413756 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1217/2435] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:49:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:50:08.409612 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=32 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:51:19.346826 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652cd26-7393-4735-a147-94f01ca2f8e8 service cinder] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:51:19.348269 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-b652cd26-7393-4735-a147-94f01ca2f8e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:51:19.360225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652cd26-7393-4735-a147-94f01ca2f8e8 service cinder] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:51:19.363844 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9640f85-ed3a-4073-94db-b8a39906f9e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:51:19.364482 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9640f85-ed3a-4073-94db-b8a39906f9e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:51:19.364756 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9640f85-ed3a-4073-94db-b8a39906f9e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:51:19.365033 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9640f85-ed3a-4073-94db-b8a39906f9e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:51:19.366800 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-e9640f85-ed3a-4073-94db-b8a39906f9e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:51:19.424639 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9640f85-ed3a-4073-94db-b8a39906f9e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:51:19.426084 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9640f85-ed3a-4073-94db-b8a39906f9e2 service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:51:19.435262 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1219/2436] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:51:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:51:19.809265 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6495843-ebcf-4e5f-9bfb-c5ff88a8f2c4 service placement] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:51:19.818617 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6495843-ebcf-4e5f-9bfb-c5ff88a8f2c4 service placement] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:51:19.822405 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2105dc-39b9-4036-ac98-fd41140f46fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:51:19.823092 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2105dc-39b9-4036-ac98-fd41140f46fb service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:51:19.823359 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2105dc-39b9-4036-ac98-fd41140f46fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:51:19.823634 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2105dc-39b9-4036-ac98-fd41140f46fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:51:19.825904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-ac2105dc-39b9-4036-ac98-fd41140f46fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:51:19.898316 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2105dc-39b9-4036-ac98-fd41140f46fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:51:19.899796 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2105dc-39b9-4036-ac98-fd41140f46fb service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:51:19.909236 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1218/2437] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:51:19 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:51:29.430972 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=28 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:51:29.905174 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=33 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:51:54.030791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9640f85-ed3a-4073-94db-b8a39906f9e2 service cinder] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:51:54.032296 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-e9640f85-ed3a-4073-94db-b8a39906f9e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:51:54.103636 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9640f85-ed3a-4073-94db-b8a39906f9e2 service cinder] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:51:54.107233 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb51440-7ead-4198-855e-5ffab5351f30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:51:54.107875 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb51440-7ead-4198-855e-5ffab5351f30 service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:51:54.108157 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb51440-7ead-4198-855e-5ffab5351f30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:51:54.108431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb51440-7ead-4198-855e-5ffab5351f30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:51:54.110153 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-ceb51440-7ead-4198-855e-5ffab5351f30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:51:54.119429 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb51440-7ead-4198-855e-5ffab5351f30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:51:54.120867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb51440-7ead-4198-855e-5ffab5351f30 service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:51:54.128821 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1220/2438] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:51:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:52:04.125117 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=26 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:52:18.198845 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2105dc-39b9-4036-ac98-fd41140f46fb service cinder] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:52:18.207540 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2105dc-39b9-4036-ac98-fd41140f46fb service cinder] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:52:18.211346 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789baafc-ace4-46ea-ac48-e5de665d9de7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:52:18.211993 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789baafc-ace4-46ea-ac48-e5de665d9de7 service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:52:18.212282 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789baafc-ace4-46ea-ac48-e5de665d9de7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:52:18.212559 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789baafc-ace4-46ea-ac48-e5de665d9de7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:52:18.215028 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-789baafc-ace4-46ea-ac48-e5de665d9de7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:52:18.273379 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789baafc-ace4-46ea-ac48-e5de665d9de7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:52:18.274907 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789baafc-ace4-46ea-ac48-e5de665d9de7 service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:52:18.284637 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1219/2439] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:52:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:52:18.482927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb51440-7ead-4198-855e-5ffab5351f30 service neutron] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:52:18.492533 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb51440-7ead-4198-855e-5ffab5351f30 service neutron] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:52:18.496642 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e61026-ec05-4ccd-84fb-1ae00da57803 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:52:18.497283 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e61026-ec05-4ccd-84fb-1ae00da57803 service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:52:18.497563 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e61026-ec05-4ccd-84fb-1ae00da57803 service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:52:18.497837 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e61026-ec05-4ccd-84fb-1ae00da57803 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:52:18.499591 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-a4e61026-ec05-4ccd-84fb-1ae00da57803 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:52:18.558553 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e61026-ec05-4ccd-84fb-1ae00da57803 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:52:18.560058 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e61026-ec05-4ccd-84fb-1ae00da57803 service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:52:18.569439 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1221/2440] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:52:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:52:19.745261 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789baafc-ace4-46ea-ac48-e5de665d9de7 service cinder] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:52:19.746952 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-789baafc-ace4-46ea-ac48-e5de665d9de7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:52:19.759508 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789baafc-ace4-46ea-ac48-e5de665d9de7 service cinder] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:52:19.764141 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614768cf-4145-4ea6-9c9e-9e5541510f55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:52:19.764805 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614768cf-4145-4ea6-9c9e-9e5541510f55 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:52:19.765091 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614768cf-4145-4ea6-9c9e-9e5541510f55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:52:19.765370 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614768cf-4145-4ea6-9c9e-9e5541510f55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:52:19.767200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-614768cf-4145-4ea6-9c9e-9e5541510f55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:52:19.839269 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614768cf-4145-4ea6-9c9e-9e5541510f55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:52:19.840736 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614768cf-4145-4ea6-9c9e-9e5541510f55 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:52:19.851557 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1220/2441] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:52:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:52:23.315758 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e61026-ec05-4ccd-84fb-1ae00da57803 service cinder] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:52:23.317219 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-a4e61026-ec05-4ccd-84fb-1ae00da57803 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:52:23.332270 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e61026-ec05-4ccd-84fb-1ae00da57803 service cinder] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:52:23.337427 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52fb01-b9d8-407e-9765-505bbe8f104f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:52:23.338448 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52fb01-b9d8-407e-9765-505bbe8f104f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:52:23.338977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52fb01-b9d8-407e-9765-505bbe8f104f admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:52:23.339116 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52fb01-b9d8-407e-9765-505bbe8f104f admin admin] PATH_INFO: `/v3/users/00a1e1a5b2044f2bb37bb4bd52f3afb9` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:52:23.340355 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52fb01-b9d8-407e-9765-505bbe8f104f admin admin] RBAC: Authorizing `identity:delete_user(user_id=00a1e1a5b2044f2bb37bb4bd52f3afb9)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:52:23.342423 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52fb01-b9d8-407e-9765-505bbe8f104f admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:52:23.394718 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-9c52fb01-b9d8-407e-9765-505bbe8f104f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00a1e1a5b2044f2bb37bb4bd52f3afb9'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:52:23.395348 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-9c52fb01-b9d8-407e-9765-505bbe8f104f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00a1e1a5b2044f2bb37bb4bd52f3afb9'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:52:23.408128 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-9c52fb01-b9d8-407e-9765-505bbe8f104f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00a1e1a5b2044f2bb37bb4bd52f3afb9'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:52:23.421932 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-9c52fb01-b9d8-407e-9765-505bbe8f104f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00a1e1a5b2044f2bb37bb4bd52f3afb9'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:52:23.427536 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-9c52fb01-b9d8-407e-9765-505bbe8f104f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00a1e1a5b2044f2bb37bb4bd52f3afb9'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:52:23.443253 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1222/2442] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:52:23 2022] DELETE /identity/v3/users/00a1e1a5b2044f2bb37bb4bd52f3afb9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:52:23.616039 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614768cf-4145-4ea6-9c9e-9e5541510f55 service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:52:23.626613 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614768cf-4145-4ea6-9c9e-9e5541510f55 service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:52:23.687106 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652b670-662c-4559-ac7e-d40bf1ff4c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:52:23.687933 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652b670-662c-4559-ac7e-d40bf1ff4c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:52:23.688262 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652b670-662c-4559-ac7e-d40bf1ff4c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:52:23.688548 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652b670-662c-4559-ac7e-d40bf1ff4c25 admin admin] PATH_INFO: `/v3/projects/6846438ca78f4340864eb0e40a0c0858` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:52:23.699480 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652b670-662c-4559-ac7e-d40bf1ff4c25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6846438ca78f4340864eb0e40a0c0858)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:52:23.701419 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652b670-662c-4559-ac7e-d40bf1ff4c25 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:52:23.734183 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:52:23.751540 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-e652b670-662c-4559-ac7e-d40bf1ff4c25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6846438ca78f4340864eb0e40a0c0858', 'request_id': 'req-e652b670-662c-4559-ac7e-d40bf1ff4c25'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:52:23.758866 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-e652b670-662c-4559-ac7e-d40bf1ff4c25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6846438ca78f4340864eb0e40a0c0858', 'request_id': 'req-e652b670-662c-4559-ac7e-d40bf1ff4c25'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:52:23.765941 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-e652b670-662c-4559-ac7e-d40bf1ff4c25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6846438ca78f4340864eb0e40a0c0858', 'request_id': 'req-e652b670-662c-4559-ac7e-d40bf1ff4c25'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:52:23.777205 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-e652b670-662c-4559-ac7e-d40bf1ff4c25 admin admin] The token cache is being invalidate because project 6846438ca78f4340864eb0e40a0c0858 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:52:23.777493 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-e652b670-662c-4559-ac7e-d40bf1ff4c25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:52:23.778208 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-e652b670-662c-4559-ac7e-d40bf1ff4c25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:52:23.779836 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1221/2443] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:52:23 2022] DELETE /identity/v3/projects/6846438ca78f4340864eb0e40a0c0858 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:52:23.785846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3464def-4294-4e33-91c9-69c63ef5f009 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:52:23.786153 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3464def-4294-4e33-91c9-69c63ef5f009 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:52:23.786411 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3464def-4294-4e33-91c9-69c63ef5f009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:52:23.804896 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-a3464def-4294-4e33-91c9-69c63ef5f009 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:52:23.806094 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-a3464def-4294-4e33-91c9-69c63ef5f009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:52:23.867948 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1223/2444] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:52:23.875577 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4881a1-e17f-4bce-8d39-8c990b93cb3e None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:52:23.875893 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4881a1-e17f-4bce-8d39-8c990b93cb3e None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:52:23.876169 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4881a1-e17f-4bce-8d39-8c990b93cb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:52:23.893935 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-4b4881a1-e17f-4bce-8d39-8c990b93cb3e None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:52:23.895168 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-4b4881a1-e17f-4bce-8d39-8c990b93cb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:52:23.903527 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1222/2445] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:52:23.907814 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3464def-4294-4e33-91c9-69c63ef5f009 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:52:23.918151 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3464def-4294-4e33-91c9-69c63ef5f009 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:52:23.922829 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb72f2c-b9d1-491d-aa52-7026f8ac8f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:52:23.923511 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb72f2c-b9d1-491d-aa52-7026f8ac8f1d admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:52:23.923813 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb72f2c-b9d1-491d-aa52-7026f8ac8f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:52:23.924089 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb72f2c-b9d1-491d-aa52-7026f8ac8f1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:52:23.924803 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb72f2c-b9d1-491d-aa52-7026f8ac8f1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:52:23.925130 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb72f2c-b9d1-491d-aa52-7026f8ac8f1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:52:23.926786 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb72f2c-b9d1-491d-aa52-7026f8ac8f1d admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:52:23.933373 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:52:23.942931 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1224/2446] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:52:23.944020 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4881a1-e17f-4bce-8d39-8c990b93cb3e None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:52:23.953152 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4881a1-e17f-4bce-8d39-8c990b93cb3e None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:52:23.957843 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f12190-4470-448f-836e-829c47fec3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:52:23.958511 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f12190-4470-448f-836e-829c47fec3c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:52:23.958807 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f12190-4470-448f-836e-829c47fec3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:52:23.959085 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f12190-4470-448f-836e-829c47fec3c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:52:23.959785 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f12190-4470-448f-836e-829c47fec3c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:52:23.961701 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f12190-4470-448f-836e-829c47fec3c7 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:52:23.989099 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1223/2447] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:52:23 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:52:23.993892 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb72f2c-b9d1-491d-aa52-7026f8ac8f1d admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:52:24.004110 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb72f2c-b9d1-491d-aa52-7026f8ac8f1d admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:52:24.071380 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3670dc9c-0717-43be-a1a3-26273589f760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:52:24.071380 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670dc9c-0717-43be-a1a3-26273589f760 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:52:24.071380 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670dc9c-0717-43be-a1a3-26273589f760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:52:24.071380 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670dc9c-0717-43be-a1a3-26273589f760 admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:52:24.071928 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3670dc9c-0717-43be-a1a3-26273589f760 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:52:24.074034 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3670dc9c-0717-43be-a1a3-26273589f760 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:52:24.098330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1225/2448] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:52:23 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:52:24.102305 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f12190-4470-448f-836e-829c47fec3c7 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:52:24.113822 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f12190-4470-448f-836e-829c47fec3c7 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:52:24.119407 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3dec6-2059-4779-b524-b4795c4a48d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:52:24.120075 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3dec6-2059-4779-b524-b4795c4a48d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:52:24.120353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3dec6-2059-4779-b524-b4795c4a48d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:52:24.120644 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3dec6-2059-4779-b524-b4795c4a48d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:52:24.121692 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3dec6-2059-4779-b524-b4795c4a48d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:52:24.124493 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3dec6-2059-4779-b524-b4795c4a48d3 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:52:24.138431 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1224/2449] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:52:24.142293 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3670dc9c-0717-43be-a1a3-26273589f760 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:52:24.153364 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3670dc9c-0717-43be-a1a3-26273589f760 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:52:24.157881 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189a3dc-2c14-4e2a-9b3b-89190a7e89a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:52:24.158535 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189a3dc-2c14-4e2a-9b3b-89190a7e89a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:52:24.158850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189a3dc-2c14-4e2a-9b3b-89190a7e89a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:52:24.159123 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189a3dc-2c14-4e2a-9b3b-89190a7e89a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:52:24.159832 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189a3dc-2c14-4e2a-9b3b-89190a7e89a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:52:24.161450 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189a3dc-2c14-4e2a-9b3b-89190a7e89a7 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:52:24.171578 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1226/2450] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:52:24.175615 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3dec6-2059-4779-b524-b4795c4a48d3 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:52:24.186146 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3dec6-2059-4779-b524-b4795c4a48d3 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:52:24.190714 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23851a62-cbe5-40d5-b143-57cfdc4c654e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:52:24.191603 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23851a62-cbe5-40d5-b143-57cfdc4c654e admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:52:24.191880 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23851a62-cbe5-40d5-b143-57cfdc4c654e admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:52:24.192151 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23851a62-cbe5-40d5-b143-57cfdc4c654e admin admin] PATH_INFO: `/v3/projects/dc18d4bf3224406d8ff9382d5bbde540/users/ce8138cd63894fe5a66e8c050c42a520/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:52:24.207315 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23851a62-cbe5-40d5-b143-57cfdc4c654e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc18d4bf3224406d8ff9382d5bbde540, user_id=ce8138cd63894fe5a66e8c050c42a520, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:52:24.209903 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23851a62-cbe5-40d5-b143-57cfdc4c654e admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:52:24.223581 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1225/2451] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:52:24 2022] PUT /identity/v3/projects/dc18d4bf3224406d8ff9382d5bbde540/users/ce8138cd63894fe5a66e8c050c42a520/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:52:24.228675 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1f1c4-78ee-48bc-9dff-4d5491da8ad2 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:52:24.228992 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1f1c4-78ee-48bc-9dff-4d5491da8ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:52:24.229273 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1f1c4-78ee-48bc-9dff-4d5491da8ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:52:24.246583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-f4b1f1c4-78ee-48bc-9dff-4d5491da8ad2 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:52:24.247808 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-f4b1f1c4-78ee-48bc-9dff-4d5491da8ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:52:24.306046 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1227/2452] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:52:24.315688 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23851a62-cbe5-40d5-b143-57cfdc4c654e admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:52:24.317435 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-23851a62-cbe5-40d5-b143-57cfdc4c654e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:52:24.374137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23851a62-cbe5-40d5-b143-57cfdc4c654e admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:52:24.377796 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583fda64-1a51-4063-9f97-f3329ba89c1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:52:24.378471 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fda64-1a51-4063-9f97-f3329ba89c1f service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:52:24.378792 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fda64-1a51-4063-9f97-f3329ba89c1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:52:24.379099 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fda64-1a51-4063-9f97-f3329ba89c1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:52:24.389067 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583fda64-1a51-4063-9f97-f3329ba89c1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:52:24.390504 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583fda64-1a51-4063-9f97-f3329ba89c1f service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:52:24.400126 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1226/2453] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:52:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:52:28.239233 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b268b-d21a-495c-91b5-3329d10552c2 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:52:28.239813 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b268b-d21a-495c-91b5-3329d10552c2 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:52:28.239813 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b268b-d21a-495c-91b5-3329d10552c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:52:28.269471 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-a27b268b-d21a-495c-91b5-3329d10552c2 None None] MFA Rules not processed for user `ce8138cd63894fe5a66e8c050c42a520`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:52:28.270833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-a27b268b-d21a-495c-91b5-3329d10552c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:52:28.354207 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1228/2454] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:52:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:52:28.377339 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583fda64-1a51-4063-9f97-f3329ba89c1f service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:52:28.378810 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-583fda64-1a51-4063-9f97-f3329ba89c1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:52:28.443067 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:52:28.480518 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583fda64-1a51-4063-9f97-f3329ba89c1f service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:52:28.486280 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5196ae-8140-46da-843c-48cb5a7f16fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:52:28.486965 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5196ae-8140-46da-843c-48cb5a7f16fe service nova] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:52:28.487247 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5196ae-8140-46da-843c-48cb5a7f16fe service nova] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:52:28.487521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5196ae-8140-46da-843c-48cb5a7f16fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:52:28.496660 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5196ae-8140-46da-843c-48cb5a7f16fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:52:28.498296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5196ae-8140-46da-843c-48cb5a7f16fe service nova] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:52:28.507804 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1227/2455] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:52:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:52:30.179669 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44835610-01f7-4cf1-bba4-f0d5c66e76c4 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:52:30.180233 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44835610-01f7-4cf1-bba4-f0d5c66e76c4 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:52:30.180233 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44835610-01f7-4cf1-bba4-f0d5c66e76c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:52:30.195661 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:52:30.210006 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-44835610-01f7-4cf1-bba4-f0d5c66e76c4 None None] MFA Rules not processed for user `ce8138cd63894fe5a66e8c050c42a520`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:52:30.211278 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-44835610-01f7-4cf1-bba4-f0d5c66e76c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:52:30.219314 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1229/2456] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:52:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:52:30.543456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5196ae-8140-46da-843c-48cb5a7f16fe service nova] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:52:30.552696 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5196ae-8140-46da-843c-48cb5a7f16fe service nova] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:52:30.556922 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93249cf4-55e2-4722-bc52-31d3e26d4194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:52:30.558032 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93249cf4-55e2-4722-bc52-31d3e26d4194 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:52:30.558805 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93249cf4-55e2-4722-bc52-31d3e26d4194 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:52:30.559087 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93249cf4-55e2-4722-bc52-31d3e26d4194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:52:30.560877 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-93249cf4-55e2-4722-bc52-31d3e26d4194 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:52:30.570566 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93249cf4-55e2-4722-bc52-31d3e26d4194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:52:30.572609 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93249cf4-55e2-4722-bc52-31d3e26d4194 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:52:30.581596 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1228/2457] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:52:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:52:31.151563 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44835610-01f7-4cf1-bba4-f0d5c66e76c4 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:52:31.153206 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-44835610-01f7-4cf1-bba4-f0d5c66e76c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:52:31.250793 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44835610-01f7-4cf1-bba4-f0d5c66e76c4 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:52:31.258149 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556dac18-11d4-4d16-9c79-bddca4dbf12b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57c8b894e74c709ea389ed462184fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:52:31.258933 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dac18-11d4-4d16-9c79-bddca4dbf12b service placement] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:52:31.259292 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dac18-11d4-4d16-9c79-bddca4dbf12b service placement] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:52:31.259692 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dac18-11d4-4d16-9c79-bddca4dbf12b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:52:31.262248 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-556dac18-11d4-4d16-9c79-bddca4dbf12b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:52:31.276486 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556dac18-11d4-4d16-9c79-bddca4dbf12b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:52:31.278619 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556dac18-11d4-4d16-9c79-bddca4dbf12b service placement] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:52:31.293058 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1230/2458] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:52:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:52:37.912099 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93249cf4-55e2-4722-bc52-31d3e26d4194 service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:52:37.926172 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93249cf4-55e2-4722-bc52-31d3e26d4194 service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:52:37.933000 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d80fc-92ff-414e-ba90-49c9a58e408e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:52:37.933655 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d80fc-92ff-414e-ba90-49c9a58e408e service nova] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:52:37.933944 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d80fc-92ff-414e-ba90-49c9a58e408e service nova] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:52:37.934225 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d80fc-92ff-414e-ba90-49c9a58e408e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:52:37.936057 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-3f9d80fc-92ff-414e-ba90-49c9a58e408e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:52:37.949124 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d80fc-92ff-414e-ba90-49c9a58e408e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:52:37.950784 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d80fc-92ff-414e-ba90-49c9a58e408e service nova] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:52:37.961841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1229/2459] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:52:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:52:41.285574 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=32 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:52:41.626329 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556dac18-11d4-4d16-9c79-bddca4dbf12b service placement] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:52:41.638646 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556dac18-11d4-4d16-9c79-bddca4dbf12b service placement] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:52:41.644022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813336e2-7368-43b9-af88-3a73bdc6d6bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:52:41.644663 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813336e2-7368-43b9-af88-3a73bdc6d6bf service nova] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:52:41.644944 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813336e2-7368-43b9-af88-3a73bdc6d6bf service nova] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:52:41.645394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813336e2-7368-43b9-af88-3a73bdc6d6bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:52:41.647188 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-813336e2-7368-43b9-af88-3a73bdc6d6bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:52:41.659781 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813336e2-7368-43b9-af88-3a73bdc6d6bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:52:41.661517 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813336e2-7368-43b9-af88-3a73bdc6d6bf service nova] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:52:41.674046 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1231/2460] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:52:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:52:47.957146 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=22 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:52:51.669024 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=6 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:00.681037 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef794df8-8eeb-4237-8f37-de13215193fd None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:00.681664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef794df8-8eeb-4237-8f37-de13215193fd None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:00.681664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef794df8-8eeb-4237-8f37-de13215193fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:00.714113 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-ef794df8-8eeb-4237-8f37-de13215193fd None None] MFA Rules not processed for user `f156542c7b3a4eed9a41bb1a8c67cdde`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:00.715392 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-ef794df8-8eeb-4237-8f37-de13215193fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:00.774092 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1230/2461] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:54:01.846169 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813336e2-7368-43b9-af88-3a73bdc6d6bf service nova] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:01.847815 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-813336e2-7368-43b9-af88-3a73bdc6d6bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:01.848521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef794df8-8eeb-4237-8f37-de13215193fd None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:01.850148 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-ef794df8-8eeb-4237-8f37-de13215193fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:01.941797 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813336e2-7368-43b9-af88-3a73bdc6d6bf service nova] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:01.942996 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef794df8-8eeb-4237-8f37-de13215193fd None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:01.946667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a785b80-7efa-427f-bd67-bfea588e2f45 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09d603d756a9484bbf48cfd6d56bdb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:01.947323 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a785b80-7efa-427f-bd67-bfea588e2f45 service glance] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:01.947466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a457452-8ae9-4069-a68d-1a979c49a5f9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09d603d756a9484bbf48cfd6d56bdb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:01.947582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a785b80-7efa-427f-bd67-bfea588e2f45 service glance] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:01.947985 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a457452-8ae9-4069-a68d-1a979c49a5f9 service glance] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:01.948131 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a785b80-7efa-427f-bd67-bfea588e2f45 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:01.948250 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a457452-8ae9-4069-a68d-1a979c49a5f9 service glance] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:01.948531 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a457452-8ae9-4069-a68d-1a979c49a5f9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:01.950450 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-7a785b80-7efa-427f-bd67-bfea588e2f45 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:01.950603 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-5a457452-8ae9-4069-a68d-1a979c49a5f9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:01.966762 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application [None req-5a457452-8ae9-4069-a68d-1a979c49a5f9 service glance] Could not find project: 74e6d0f5f9924604a213c60cac93349a.: keystone.exception.ProjectNotFound: Could not find project: 74e6d0f5f9924604a213c60cac93349a. Jun 29 12:54:01.966762 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:54:01.966762 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:54:01.966762 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:54:01.966762 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:54:01.966762 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:54:01.966762 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:54:01.966762 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:54:01.966762 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:54:01.966762 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:54:01.966762 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:54:01.966762 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:54:01.966762 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Jun 29 12:54:01.966762 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Jun 29 12:54:01.966762 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jun 29 12:54:01.968301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jun 29 12:54:01.968301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jun 29 12:54:01.968301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jun 29 12:54:01.968301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:54:01.968301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:54:01.968301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token Jun 29 12:54:01.968301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application token = self._validate_token(token_id) Jun 29 12:54:01.968301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:54:01.968301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:54:01.968301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:54:01.968301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:54:01.968301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:54:01.968301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:54:01.968301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:54:01.968301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:54:01.968301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:54:01.968301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:54:01.969722 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:54:01.969722 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:54:01.969722 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:54:01.969722 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:54:01.969722 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token Jun 29 12:54:01.969722 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) Jun 29 12:54:01.969722 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint Jun 29 12:54:01.969722 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self._validate_token_resources() Jun 29 12:54:01.969722 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources Jun 29 12:54:01.969722 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): Jun 29 12:54:01.969722 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project Jun 29 12:54:01.969722 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( Jun 29 12:54:01.969722 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:54:01.969722 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:54:01.969722 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:54:01.969722 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:54:01.969722 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:54:01.972145 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:54:01.972145 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:54:01.972145 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application with Lock( Jun 29 12:54:01.972145 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:54:01.972145 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:54:01.972145 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:54:01.972145 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:54:01.972145 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:54:01.972145 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:54:01.972145 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:54:01.972145 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:54:01.972145 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:54:01.972145 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:54:01.972145 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:54:01.972145 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:54:01.972145 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:54:01.972145 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:54:01.974124 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 74e6d0f5f9924604a213c60cac93349a. Jun 29 12:54:01.974124 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: ERROR keystone.server.flask.application Jun 29 12:54:01.974124 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1231/2462] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:54:01 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 120 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jun 29 12:54:01.988148 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application [None req-7a785b80-7efa-427f-bd67-bfea588e2f45 service glance] Could not find project: 9bf20c09938648ee9b478fabe6f0202a.: keystone.exception.ProjectNotFound: Could not find project: 9bf20c09938648ee9b478fabe6f0202a. Jun 29 12:54:01.988148 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:54:01.988148 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:54:01.988148 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:54:01.988148 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:54:01.988148 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:54:01.988148 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:54:01.988148 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:54:01.988148 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:54:01.988148 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:54:01.988148 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:54:01.988148 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:54:01.988148 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Jun 29 12:54:01.988148 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Jun 29 12:54:01.988148 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jun 29 12:54:01.989611 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jun 29 12:54:01.989611 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jun 29 12:54:01.989611 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jun 29 12:54:01.989611 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:54:01.989611 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:54:01.989611 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token Jun 29 12:54:01.989611 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application token = self._validate_token(token_id) Jun 29 12:54:01.989611 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:54:01.989611 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:54:01.989611 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:54:01.989611 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:54:01.989611 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:54:01.989611 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:54:01.989611 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:54:01.989611 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:54:01.989611 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:54:01.989611 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:54:01.991035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:54:01.991035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:54:01.991035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:54:01.991035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:54:01.991035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token Jun 29 12:54:01.991035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) Jun 29 12:54:01.991035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint Jun 29 12:54:01.991035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application self._validate_token_resources() Jun 29 12:54:01.991035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources Jun 29 12:54:01.991035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): Jun 29 12:54:01.991035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project Jun 29 12:54:01.991035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( Jun 29 12:54:01.991035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:54:01.991035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:54:01.991035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:54:01.991035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:54:01.991035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:54:01.993035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:54:01.993035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:54:01.993035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application with Lock( Jun 29 12:54:01.993035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:54:01.993035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:54:01.993035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:54:01.993035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:54:01.993035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:54:01.993035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:54:01.993035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:54:01.993035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:54:01.993035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:54:01.993035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:54:01.993035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:54:01.993035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:54:01.993035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:54:01.993035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:54:01.994954 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 9bf20c09938648ee9b478fabe6f0202a. Jun 29 12:54:01.994954 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: ERROR keystone.server.flask.application Jun 29 12:54:01.996540 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1232/2463] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:54:01 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 29 12:54:06.154882 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a457452-8ae9-4069-a68d-1a979c49a5f9 service glance] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:06.165757 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a457452-8ae9-4069-a68d-1a979c49a5f9 service glance] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:06.169611 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575e343-f456-4f1f-8c7e-a9a162524da0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:06.170256 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575e343-f456-4f1f-8c7e-a9a162524da0 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:06.170553 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575e343-f456-4f1f-8c7e-a9a162524da0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:06.170849 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575e343-f456-4f1f-8c7e-a9a162524da0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:06.172785 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-3575e343-f456-4f1f-8c7e-a9a162524da0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:06.187925 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575e343-f456-4f1f-8c7e-a9a162524da0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:06.189467 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575e343-f456-4f1f-8c7e-a9a162524da0 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:06.201516 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1232/2464] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:54:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:54:08.967474 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a785b80-7efa-427f-bd67-bfea588e2f45 service glance] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:08.968880 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-7a785b80-7efa-427f-bd67-bfea588e2f45 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:08.983539 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a785b80-7efa-427f-bd67-bfea588e2f45 service glance] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:08.988118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffa551-13ce-4e02-9e0c-7399ba033040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:08.988957 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffa551-13ce-4e02-9e0c-7399ba033040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:08.989231 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffa551-13ce-4e02-9e0c-7399ba033040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:08.989506 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffa551-13ce-4e02-9e0c-7399ba033040 admin admin] PATH_INFO: `/v3/users/9d0424e009274b81a07b7549c1a4f662` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:08.990805 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dffa551-13ce-4e02-9e0c-7399ba033040 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d0424e009274b81a07b7549c1a4f662)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:08.992751 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dffa551-13ce-4e02-9e0c-7399ba033040 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:09.043150 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-7dffa551-13ce-4e02-9e0c-7399ba033040 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d0424e009274b81a07b7549c1a4f662'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:09.043802 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-7dffa551-13ce-4e02-9e0c-7399ba033040 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d0424e009274b81a07b7549c1a4f662'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:09.055632 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-7dffa551-13ce-4e02-9e0c-7399ba033040 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d0424e009274b81a07b7549c1a4f662'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:09.063380 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-7dffa551-13ce-4e02-9e0c-7399ba033040 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d0424e009274b81a07b7549c1a4f662'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:09.064069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-7dffa551-13ce-4e02-9e0c-7399ba033040 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d0424e009274b81a07b7549c1a4f662'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:09.077015 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1233/2465] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:54:08 2022] DELETE /identity/v3/users/9d0424e009274b81a07b7549c1a4f662 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:09.081635 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6a043-9b8d-44bf-8f6b-29db901e9f02 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:09.082057 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6a043-9b8d-44bf-8f6b-29db901e9f02 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:09.082185 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6a043-9b8d-44bf-8f6b-29db901e9f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:09.100211 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-bba6a043-9b8d-44bf-8f6b-29db901e9f02 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:09.101395 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-bba6a043-9b8d-44bf-8f6b-29db901e9f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:09.160350 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1233/2466] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:54:09.169936 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffa551-13ce-4e02-9e0c-7399ba033040 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:09.171426 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-7dffa551-13ce-4e02-9e0c-7399ba033040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:09.228344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffa551-13ce-4e02-9e0c-7399ba033040 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:09.231977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d37ea-0a2e-4a3b-bf9d-65f053cd311e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:09.232615 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d37ea-0a2e-4a3b-bf9d-65f053cd311e service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:09.232897 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d37ea-0a2e-4a3b-bf9d-65f053cd311e service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:09.233169 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d37ea-0a2e-4a3b-bf9d-65f053cd311e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:09.242154 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d37ea-0a2e-4a3b-bf9d-65f053cd311e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:09.243631 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d37ea-0a2e-4a3b-bf9d-65f053cd311e service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:09.252944 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1234/2467] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:54:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:54:09.528769 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6a043-9b8d-44bf-8f6b-29db901e9f02 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:09.530186 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-bba6a043-9b8d-44bf-8f6b-29db901e9f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:09.543761 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6a043-9b8d-44bf-8f6b-29db901e9f02 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:09.548336 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b65d40-782d-4836-9dc0-091532692cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:09.549199 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b65d40-782d-4836-9dc0-091532692cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:09.550009 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b65d40-782d-4836-9dc0-091532692cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:09.550442 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b65d40-782d-4836-9dc0-091532692cd4 admin admin] PATH_INFO: `/v3/projects/111ec6f4f16942fcbb19b9c22549566d` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:09.551798 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b65d40-782d-4836-9dc0-091532692cd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=111ec6f4f16942fcbb19b9c22549566d)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:09.553801 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b65d40-782d-4836-9dc0-091532692cd4 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:09.571747 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:09.601012 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-24b65d40-782d-4836-9dc0-091532692cd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '111ec6f4f16942fcbb19b9c22549566d', 'request_id': 'req-24b65d40-782d-4836-9dc0-091532692cd4'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:09.608221 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-24b65d40-782d-4836-9dc0-091532692cd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '111ec6f4f16942fcbb19b9c22549566d', 'request_id': 'req-24b65d40-782d-4836-9dc0-091532692cd4'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:09.614756 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-24b65d40-782d-4836-9dc0-091532692cd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '111ec6f4f16942fcbb19b9c22549566d', 'request_id': 'req-24b65d40-782d-4836-9dc0-091532692cd4'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:09.626738 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-24b65d40-782d-4836-9dc0-091532692cd4 admin admin] The token cache is being invalidate because project 111ec6f4f16942fcbb19b9c22549566d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:54:09.627058 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-24b65d40-782d-4836-9dc0-091532692cd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:09.627767 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-24b65d40-782d-4836-9dc0-091532692cd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:09.629485 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1234/2468] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:54:09 2022] DELETE /identity/v3/projects/111ec6f4f16942fcbb19b9c22549566d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:09.635951 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2515e09-27d6-4137-a702-fbc7b231f9bf None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:09.636290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2515e09-27d6-4137-a702-fbc7b231f9bf None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:09.636588 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2515e09-27d6-4137-a702-fbc7b231f9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:09.644031 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:09.659448 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-a2515e09-27d6-4137-a702-fbc7b231f9bf None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:09.660651 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-a2515e09-27d6-4137-a702-fbc7b231f9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:09.759264 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1235/2469] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:54:09.766682 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb89c2-2db1-4ab7-a046-c956860b2b7d None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:09.767054 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb89c2-2db1-4ab7-a046-c956860b2b7d None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:09.767436 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb89c2-2db1-4ab7-a046-c956860b2b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:09.797552 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-c3eb89c2-2db1-4ab7-a046-c956860b2b7d None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:09.798914 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-c3eb89c2-2db1-4ab7-a046-c956860b2b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:09.813104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1235/2470] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:54:09.817590 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2515e09-27d6-4137-a702-fbc7b231f9bf None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:09.834840 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2515e09-27d6-4137-a702-fbc7b231f9bf None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:09.842963 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cea771-0a47-4b74-a158-ec36202faa2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:09.843316 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cea771-0a47-4b74-a158-ec36202faa2c admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:09.843853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cea771-0a47-4b74-a158-ec36202faa2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:09.844246 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cea771-0a47-4b74-a158-ec36202faa2c admin admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:09.845344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cea771-0a47-4b74-a158-ec36202faa2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:54:09.845698 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cea771-0a47-4b74-a158-ec36202faa2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:09.847606 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cea771-0a47-4b74-a158-ec36202faa2c admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:09.865927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1236/2471] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:54:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:54:09.877045 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb89c2-2db1-4ab7-a046-c956860b2b7d None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:09.888573 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb89c2-2db1-4ab7-a046-c956860b2b7d None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:09.893697 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58aa28-9e39-438a-a2d4-d51e28c353e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:09.894362 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58aa28-9e39-438a-a2d4-d51e28c353e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:09.894661 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58aa28-9e39-438a-a2d4-d51e28c353e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:09.894959 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58aa28-9e39-438a-a2d4-d51e28c353e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:09.895657 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd58aa28-9e39-438a-a2d4-d51e28c353e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:09.897579 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd58aa28-9e39-438a-a2d4-d51e28c353e0 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:09.925092 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1236/2472] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:54:09 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:54:09.929081 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cea771-0a47-4b74-a158-ec36202faa2c admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:09.942294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cea771-0a47-4b74-a158-ec36202faa2c admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:10.000675 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70631ded-3599-45f1-ae57-d566dc3b9b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:10.001362 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70631ded-3599-45f1-ae57-d566dc3b9b47 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:10.001696 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70631ded-3599-45f1-ae57-d566dc3b9b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:10.002054 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70631ded-3599-45f1-ae57-d566dc3b9b47 admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:10.002762 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70631ded-3599-45f1-ae57-d566dc3b9b47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:10.004755 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70631ded-3599-45f1-ae57-d566dc3b9b47 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:10.024395 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1237/2473] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:54:09 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:54:10.028872 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58aa28-9e39-438a-a2d4-d51e28c353e0 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:10.040138 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58aa28-9e39-438a-a2d4-d51e28c353e0 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:10.045097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9922c-b84c-4731-8bee-4a04ce886433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:10.045762 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9922c-b84c-4731-8bee-4a04ce886433 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:10.046041 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9922c-b84c-4731-8bee-4a04ce886433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:10.046310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9922c-b84c-4731-8bee-4a04ce886433 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:10.047170 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a9922c-b84c-4731-8bee-4a04ce886433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:10.048809 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a9922c-b84c-4731-8bee-4a04ce886433 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:10.060311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1237/2474] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:54:10.064593 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70631ded-3599-45f1-ae57-d566dc3b9b47 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:10.075194 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70631ded-3599-45f1-ae57-d566dc3b9b47 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:10.080444 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d462d96-2b01-48a3-8c0b-23374d78f7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:10.081137 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d462d96-2b01-48a3-8c0b-23374d78f7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:10.081427 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d462d96-2b01-48a3-8c0b-23374d78f7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:10.081704 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d462d96-2b01-48a3-8c0b-23374d78f7b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:10.082425 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d462d96-2b01-48a3-8c0b-23374d78f7b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:10.084101 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d462d96-2b01-48a3-8c0b-23374d78f7b8 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:10.094305 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1238/2475] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:54:10.098721 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9922c-b84c-4731-8bee-4a04ce886433 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:10.109946 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9922c-b84c-4731-8bee-4a04ce886433 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:10.114650 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea3cc6-152e-4e2a-b05c-9b7cdba9be58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:10.115546 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea3cc6-152e-4e2a-b05c-9b7cdba9be58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:10.115816 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea3cc6-152e-4e2a-b05c-9b7cdba9be58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:10.116091 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea3cc6-152e-4e2a-b05c-9b7cdba9be58 admin admin] PATH_INFO: `/v3/projects/4f970acbde1f49dab717cd4e29719619/users/987eb72690d34182a0a4071d18577532/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:10.134760 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea3cc6-152e-4e2a-b05c-9b7cdba9be58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f970acbde1f49dab717cd4e29719619, user_id=987eb72690d34182a0a4071d18577532, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:10.137875 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea3cc6-152e-4e2a-b05c-9b7cdba9be58 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:10.151381 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1238/2476] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:54:10 2022] PUT /identity/v3/projects/4f970acbde1f49dab717cd4e29719619/users/987eb72690d34182a0a4071d18577532/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:10.162247 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92b942-6f23-4617-bb1b-8983c9d65ede None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:10.162543 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92b942-6f23-4617-bb1b-8983c9d65ede None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:10.162861 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92b942-6f23-4617-bb1b-8983c9d65ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:10.190246 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-ae92b942-6f23-4617-bb1b-8983c9d65ede None None] MFA Rules not processed for user `987eb72690d34182a0a4071d18577532`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:10.191494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-ae92b942-6f23-4617-bb1b-8983c9d65ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:10.251225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:10.259204 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1239/2477] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:54:10.270041 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea3cc6-152e-4e2a-b05c-9b7cdba9be58 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:10.271868 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-e6ea3cc6-152e-4e2a-b05c-9b7cdba9be58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:10.352017 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea3cc6-152e-4e2a-b05c-9b7cdba9be58 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:10.357605 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39af8d-d49a-4196-b0b0-b8ea2c91799b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:10.358255 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39af8d-d49a-4196-b0b0-b8ea2c91799b service nova] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:10.358539 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39af8d-d49a-4196-b0b0-b8ea2c91799b service nova] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:10.358919 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39af8d-d49a-4196-b0b0-b8ea2c91799b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:10.367165 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39af8d-d49a-4196-b0b0-b8ea2c91799b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:10.368780 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39af8d-d49a-4196-b0b0-b8ea2c91799b service nova] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:10.377902 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1239/2478] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:54:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:54:11.257659 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92b942-6f23-4617-bb1b-8983c9d65ede None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:11.323854 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92b942-6f23-4617-bb1b-8983c9d65ede None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:11.328393 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49643b-7650-4a1f-b1de-3d3f49ec4cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:11.329262 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49643b-7650-4a1f-b1de-3d3f49ec4cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:11.329541 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49643b-7650-4a1f-b1de-3d3f49ec4cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:11.329812 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49643b-7650-4a1f-b1de-3d3f49ec4cd2 admin admin] PATH_INFO: `/v3/users/987eb72690d34182a0a4071d18577532` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:11.331022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49643b-7650-4a1f-b1de-3d3f49ec4cd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=987eb72690d34182a0a4071d18577532)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:11.332962 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49643b-7650-4a1f-b1de-3d3f49ec4cd2 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:11.378411 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-4e49643b-7650-4a1f-b1de-3d3f49ec4cd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '987eb72690d34182a0a4071d18577532'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:11.379089 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-4e49643b-7650-4a1f-b1de-3d3f49ec4cd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '987eb72690d34182a0a4071d18577532'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:11.391151 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-4e49643b-7650-4a1f-b1de-3d3f49ec4cd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '987eb72690d34182a0a4071d18577532'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:11.397839 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-4e49643b-7650-4a1f-b1de-3d3f49ec4cd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '987eb72690d34182a0a4071d18577532'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:11.398686 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-4e49643b-7650-4a1f-b1de-3d3f49ec4cd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '987eb72690d34182a0a4071d18577532'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:11.412143 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1240/2479] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:54:11 2022] DELETE /identity/v3/users/987eb72690d34182a0a4071d18577532 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:11.417177 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61e508-71a5-4b53-b7d5-d28ab26bb9e7 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:11.417670 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61e508-71a5-4b53-b7d5-d28ab26bb9e7 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:11.417804 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61e508-71a5-4b53-b7d5-d28ab26bb9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:11.436460 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-df61e508-71a5-4b53-b7d5-d28ab26bb9e7 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:11.438215 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-df61e508-71a5-4b53-b7d5-d28ab26bb9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:11.462673 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:11.501533 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1240/2480] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:54:11.512027 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49643b-7650-4a1f-b1de-3d3f49ec4cd2 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:11.513447 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-4e49643b-7650-4a1f-b1de-3d3f49ec4cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:11.569514 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49643b-7650-4a1f-b1de-3d3f49ec4cd2 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:11.573552 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7df56-6332-4f96-b244-1262b5b8a9a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:11.574186 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7df56-6332-4f96-b244-1262b5b8a9a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:11.574467 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7df56-6332-4f96-b244-1262b5b8a9a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:11.574777 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7df56-6332-4f96-b244-1262b5b8a9a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:11.583669 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7df56-6332-4f96-b244-1262b5b8a9a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:11.585124 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7df56-6332-4f96-b244-1262b5b8a9a8 service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:11.595065 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1241/2481] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:54:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:54:11.861277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61e508-71a5-4b53-b7d5-d28ab26bb9e7 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:11.862717 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-df61e508-71a5-4b53-b7d5-d28ab26bb9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:11.874500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61e508-71a5-4b53-b7d5-d28ab26bb9e7 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:11.879374 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a7c7e2-4d9e-4408-b266-5f8a46388e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:11.880365 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7c7e2-4d9e-4408-b266-5f8a46388e44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:11.880647 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7c7e2-4d9e-4408-b266-5f8a46388e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:11.881017 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7c7e2-4d9e-4408-b266-5f8a46388e44 admin admin] PATH_INFO: `/v3/projects/4f970acbde1f49dab717cd4e29719619` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:11.882206 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a7c7e2-4d9e-4408-b266-5f8a46388e44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f970acbde1f49dab717cd4e29719619)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:11.884462 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a7c7e2-4d9e-4408-b266-5f8a46388e44 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:11.936568 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b0a7c7e2-4d9e-4408-b266-5f8a46388e44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f970acbde1f49dab717cd4e29719619', 'request_id': 'req-b0a7c7e2-4d9e-4408-b266-5f8a46388e44'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:11.944152 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b0a7c7e2-4d9e-4408-b266-5f8a46388e44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f970acbde1f49dab717cd4e29719619', 'request_id': 'req-b0a7c7e2-4d9e-4408-b266-5f8a46388e44'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:11.950597 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b0a7c7e2-4d9e-4408-b266-5f8a46388e44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f970acbde1f49dab717cd4e29719619', 'request_id': 'req-b0a7c7e2-4d9e-4408-b266-5f8a46388e44'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:11.961722 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b0a7c7e2-4d9e-4408-b266-5f8a46388e44 admin admin] The token cache is being invalidate because project 4f970acbde1f49dab717cd4e29719619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:54:11.962011 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b0a7c7e2-4d9e-4408-b266-5f8a46388e44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:11.962700 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b0a7c7e2-4d9e-4408-b266-5f8a46388e44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:11.964293 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1241/2482] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:54:11 2022] DELETE /identity/v3/projects/4f970acbde1f49dab717cd4e29719619 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:11.969964 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4256bb-2a36-47d3-b3a3-996ec512417d None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:11.970257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4256bb-2a36-47d3-b3a3-996ec512417d None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:11.970537 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4256bb-2a36-47d3-b3a3-996ec512417d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:11.989022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-1b4256bb-2a36-47d3-b3a3-996ec512417d None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:11.990311 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-1b4256bb-2a36-47d3-b3a3-996ec512417d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:12.004256 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:12.061859 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1242/2483] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:54:12.070691 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980decc4-3c32-4fa9-9af3-7dc43a106e9b None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:12.070990 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980decc4-3c32-4fa9-9af3-7dc43a106e9b None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:12.071635 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980decc4-3c32-4fa9-9af3-7dc43a106e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:12.092913 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-980decc4-3c32-4fa9-9af3-7dc43a106e9b None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:12.094095 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-980decc4-3c32-4fa9-9af3-7dc43a106e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:12.102232 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1242/2484] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:54:12.106481 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4256bb-2a36-47d3-b3a3-996ec512417d None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:12.117038 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4256bb-2a36-47d3-b3a3-996ec512417d None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:12.121593 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72b0f7-e064-4045-b00b-8954e3d5ae17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:12.122817 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72b0f7-e064-4045-b00b-8954e3d5ae17 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:12.123152 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72b0f7-e064-4045-b00b-8954e3d5ae17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:12.123431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72b0f7-e064-4045-b00b-8954e3d5ae17 admin admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:12.124149 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72b0f7-e064-4045-b00b-8954e3d5ae17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:54:12.124454 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72b0f7-e064-4045-b00b-8954e3d5ae17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:12.126307 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72b0f7-e064-4045-b00b-8954e3d5ae17 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:12.129080 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980decc4-3c32-4fa9-9af3-7dc43a106e9b None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:12.130565 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-980decc4-3c32-4fa9-9af3-7dc43a106e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:12.142458 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1243/2485] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:54:12.143430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72b0f7-e064-4045-b00b-8954e3d5ae17 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:12.143735 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980decc4-3c32-4fa9-9af3-7dc43a106e9b None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:12.148907 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa517ebf-74b3-4827-b1f8-f2c6fdf9b447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:12.149776 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa517ebf-74b3-4827-b1f8-f2c6fdf9b447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:12.150063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa517ebf-74b3-4827-b1f8-f2c6fdf9b447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:12.150338 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa517ebf-74b3-4827-b1f8-f2c6fdf9b447 admin admin] PATH_INFO: `/v3/users/513fc34c262d4203b503db988705a4d5` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:12.151620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa517ebf-74b3-4827-b1f8-f2c6fdf9b447 admin admin] RBAC: Authorizing `identity:delete_user(user_id=513fc34c262d4203b503db988705a4d5)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:12.153583 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa517ebf-74b3-4827-b1f8-f2c6fdf9b447 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:12.153685 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72b0f7-e064-4045-b00b-8954e3d5ae17 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:12.158699 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218848b1-9a67-4779-8c19-4189943d155f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:12.159341 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218848b1-9a67-4779-8c19-4189943d155f admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:12.159621 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218848b1-9a67-4779-8c19-4189943d155f admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:12.159962 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218848b1-9a67-4779-8c19-4189943d155f admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:12.160641 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218848b1-9a67-4779-8c19-4189943d155f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:12.162557 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218848b1-9a67-4779-8c19-4189943d155f admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:12.190657 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1244/2486] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:54:12 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:54:12.196528 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218848b1-9a67-4779-8c19-4189943d155f admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:12.213481 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-fa517ebf-74b3-4827-b1f8-f2c6fdf9b447 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '513fc34c262d4203b503db988705a4d5'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:12.214317 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-fa517ebf-74b3-4827-b1f8-f2c6fdf9b447 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '513fc34c262d4203b503db988705a4d5'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:12.229428 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-fa517ebf-74b3-4827-b1f8-f2c6fdf9b447 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '513fc34c262d4203b503db988705a4d5'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:12.230841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-fa517ebf-74b3-4827-b1f8-f2c6fdf9b447 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '513fc34c262d4203b503db988705a4d5'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:12.240433 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-fa517ebf-74b3-4827-b1f8-f2c6fdf9b447 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '513fc34c262d4203b503db988705a4d5'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:12.258973 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1243/2487] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:54:12 2022] DELETE /identity/v3/users/513fc34c262d4203b503db988705a4d5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:54:12.263223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefde74-15c0-402e-a3f0-54e876f97f73 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:12.263510 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefde74-15c0-402e-a3f0-54e876f97f73 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:12.263856 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefde74-15c0-402e-a3f0-54e876f97f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:12.268390 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218848b1-9a67-4779-8c19-4189943d155f admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:12.284090 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-eaefde74-15c0-402e-a3f0-54e876f97f73 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:12.285308 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-eaefde74-15c0-402e-a3f0-54e876f97f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:12.296031 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:12.332565 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd4e19-0df4-461f-9ac8-2793996e318e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:12.333662 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd4e19-0df4-461f-9ac8-2793996e318e admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:12.333948 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd4e19-0df4-461f-9ac8-2793996e318e admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:12.334220 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd4e19-0df4-461f-9ac8-2793996e318e admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:12.335957 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd4e19-0df4-461f-9ac8-2793996e318e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:12.338064 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd4e19-0df4-461f-9ac8-2793996e318e admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:12.353555 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1244/2488] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:54:12.359574 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1245/2489] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:54:12 2022] POST /identity/v3/users => generated 282 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:54:12.363393 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd4e19-0df4-461f-9ac8-2793996e318e admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:12.363506 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefde74-15c0-402e-a3f0-54e876f97f73 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:12.364760 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-eaefde74-15c0-402e-a3f0-54e876f97f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:12.364967 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-25bd4e19-0df4-461f-9ac8-2793996e318e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:12.377022 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefde74-15c0-402e-a3f0-54e876f97f73 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:12.381662 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f36c40-7afd-471c-a233-3855fba6c93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:12.382946 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f36c40-7afd-471c-a233-3855fba6c93c admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:12.383231 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f36c40-7afd-471c-a233-3855fba6c93c admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:12.383763 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f36c40-7afd-471c-a233-3855fba6c93c admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:12.384494 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f36c40-7afd-471c-a233-3855fba6c93c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:12.386107 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f36c40-7afd-471c-a233-3855fba6c93c admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:12.392343 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:12.399428 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1245/2490] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:54:12.400637 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f36c40-7afd-471c-a233-3855fba6c93c admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:12.411102 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f36c40-7afd-471c-a233-3855fba6c93c admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:12.415897 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ac22c-4825-4622-ac36-91ad934bf42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:12.416544 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ac22c-4825-4622-ac36-91ad934bf42b admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:12.416827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ac22c-4825-4622-ac36-91ad934bf42b admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:12.417105 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ac22c-4825-4622-ac36-91ad934bf42b admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:12.417815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ac22c-4825-4622-ac36-91ad934bf42b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:12.419459 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ac22c-4825-4622-ac36-91ad934bf42b admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:12.423577 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd4e19-0df4-461f-9ac8-2793996e318e admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:12.427687 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d160ef3-4a7a-4d86-bde4-8839a5b9aac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:12.428330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d160ef3-4a7a-4d86-bde4-8839a5b9aac5 service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:12.428615 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d160ef3-4a7a-4d86-bde4-8839a5b9aac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:12.429414 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d160ef3-4a7a-4d86-bde4-8839a5b9aac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:12.430125 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1246/2491] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:54:12.434134 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ac22c-4825-4622-ac36-91ad934bf42b admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:12.439359 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d160ef3-4a7a-4d86-bde4-8839a5b9aac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:12.440835 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d160ef3-4a7a-4d86-bde4-8839a5b9aac5 service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:12.443657 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ac22c-4825-4622-ac36-91ad934bf42b admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:12.449007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3f448-23f3-498e-bb4f-dbd644b17618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:12.449964 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3f448-23f3-498e-bb4f-dbd644b17618 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:12.450243 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3f448-23f3-498e-bb4f-dbd644b17618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:12.450519 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3f448-23f3-498e-bb4f-dbd644b17618 admin admin] PATH_INFO: `/v3/projects/0092a5e288104d9796b84140af05c148/users/bb7e432bf25544c2b2166a5a83a25bdd/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:12.451047 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1246/2492] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:54:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:54:12.465721 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf3f448-23f3-498e-bb4f-dbd644b17618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0092a5e288104d9796b84140af05c148, user_id=bb7e432bf25544c2b2166a5a83a25bdd, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:12.468425 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf3f448-23f3-498e-bb4f-dbd644b17618 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:12.482959 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1247/2493] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:54:12 2022] PUT /identity/v3/projects/0092a5e288104d9796b84140af05c148/users/bb7e432bf25544c2b2166a5a83a25bdd/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:54:12.493764 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76150de7-09be-4db9-99bc-9468421e90d7 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:12.494055 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76150de7-09be-4db9-99bc-9468421e90d7 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:12.494336 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76150de7-09be-4db9-99bc-9468421e90d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:12.523230 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-76150de7-09be-4db9-99bc-9468421e90d7 None None] MFA Rules not processed for user `bb7e432bf25544c2b2166a5a83a25bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:12.524438 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-76150de7-09be-4db9-99bc-9468421e90d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:12.610670 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1247/2494] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:12 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:54:12.615010 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3f448-23f3-498e-bb4f-dbd644b17618 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:12.703245 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3f448-23f3-498e-bb4f-dbd644b17618 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:12.708050 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fa5a2-628f-494a-aadb-804188072eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:12.708720 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fa5a2-628f-494a-aadb-804188072eea admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:12.709006 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fa5a2-628f-494a-aadb-804188072eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:12.709287 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fa5a2-628f-494a-aadb-804188072eea admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:12.709995 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152fa5a2-628f-494a-aadb-804188072eea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:12.711987 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152fa5a2-628f-494a-aadb-804188072eea admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:12.743977 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1248/2495] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:54:12 2022] POST /identity/v3/projects => generated 363 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:54:12.749286 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76150de7-09be-4db9-99bc-9468421e90d7 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:12.760473 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fa5a2-628f-494a-aadb-804188072eea admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:12.762421 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-152fa5a2-628f-494a-aadb-804188072eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:12.763470 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76150de7-09be-4db9-99bc-9468421e90d7 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:12.829161 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:12.831378 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230a5c8-b94f-45eb-bf55-c4af7a5bcf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:12.832055 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230a5c8-b94f-45eb-bf55-c4af7a5bcf38 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:12.832337 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230a5c8-b94f-45eb-bf55-c4af7a5bcf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:12.832731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230a5c8-b94f-45eb-bf55-c4af7a5bcf38 admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:12.833333 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7230a5c8-b94f-45eb-bf55-c4af7a5bcf38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:12.835643 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7230a5c8-b94f-45eb-bf55-c4af7a5bcf38 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:12.835758 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fa5a2-628f-494a-aadb-804188072eea admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:12.840914 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47f9ab-eb96-4008-8f61-6f436299d53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:12.841779 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47f9ab-eb96-4008-8f61-6f436299d53a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:12.842063 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47f9ab-eb96-4008-8f61-6f436299d53a admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:12.842341 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47f9ab-eb96-4008-8f61-6f436299d53a admin admin] PATH_INFO: `/v3/projects/fb0a33309fac45168c53d8c2fd491ef9` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:12.843607 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47f9ab-eb96-4008-8f61-6f436299d53a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb0a33309fac45168c53d8c2fd491ef9)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:12.845511 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47f9ab-eb96-4008-8f61-6f436299d53a admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:12.857086 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1248/2496] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:54:12 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:54:12.861173 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230a5c8-b94f-45eb-bf55-c4af7a5bcf38 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:12.871469 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230a5c8-b94f-45eb-bf55-c4af7a5bcf38 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:12.876171 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e881e67-715d-472a-bcd4-78ddc4e0721c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:12.876816 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e881e67-715d-472a-bcd4-78ddc4e0721c admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:12.877173 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e881e67-715d-472a-bcd4-78ddc4e0721c admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:12.877488 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e881e67-715d-472a-bcd4-78ddc4e0721c admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:12.878213 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e881e67-715d-472a-bcd4-78ddc4e0721c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:12.880021 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e881e67-715d-472a-bcd4-78ddc4e0721c admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:12.893752 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1249/2497] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:54:12.894831 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e881e67-715d-472a-bcd4-78ddc4e0721c admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:12.898562 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-dd47f9ab-eb96-4008-8f61-6f436299d53a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb0a33309fac45168c53d8c2fd491ef9', 'request_id': 'req-dd47f9ab-eb96-4008-8f61-6f436299d53a'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:12.905349 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e881e67-715d-472a-bcd4-78ddc4e0721c admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:12.906815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-dd47f9ab-eb96-4008-8f61-6f436299d53a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb0a33309fac45168c53d8c2fd491ef9', 'request_id': 'req-dd47f9ab-eb96-4008-8f61-6f436299d53a'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:12.914484 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-dd47f9ab-eb96-4008-8f61-6f436299d53a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb0a33309fac45168c53d8c2fd491ef9', 'request_id': 'req-dd47f9ab-eb96-4008-8f61-6f436299d53a'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:12.925306 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-dd47f9ab-eb96-4008-8f61-6f436299d53a admin admin] The token cache is being invalidate because project fb0a33309fac45168c53d8c2fd491ef9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:54:12.925587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-dd47f9ab-eb96-4008-8f61-6f436299d53a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:12.926267 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-dd47f9ab-eb96-4008-8f61-6f436299d53a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:12.927845 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1249/2498] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:54:12 2022] DELETE /identity/v3/projects/fb0a33309fac45168c53d8c2fd491ef9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:12.933034 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bbf3f-4769-434f-aa98-070f940fe745 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:12.933320 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bbf3f-4769-434f-aa98-070f940fe745 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:12.933631 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bbf3f-4769-434f-aa98-070f940fe745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:12.938916 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:12.952200 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-bd9bbf3f-4769-434f-aa98-070f940fe745 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:12.953410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-bd9bbf3f-4769-434f-aa98-070f940fe745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:12.966991 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888171c4-9db8-4e2a-829f-293699123ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:12.967935 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888171c4-9db8-4e2a-829f-293699123ccb admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:12.968229 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888171c4-9db8-4e2a-829f-293699123ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:12.968508 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888171c4-9db8-4e2a-829f-293699123ccb admin admin] PATH_INFO: `/v3/projects/c7758626437f465c984d5e7e68e76edc/users/aaa04c44a888475ab8be538480b3b97e/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:12.982972 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888171c4-9db8-4e2a-829f-293699123ccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7758626437f465c984d5e7e68e76edc, user_id=aaa04c44a888475ab8be538480b3b97e, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:12.985704 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888171c4-9db8-4e2a-829f-293699123ccb admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:12.998863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1250/2499] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:54:12 2022] PUT /identity/v3/projects/c7758626437f465c984d5e7e68e76edc/users/aaa04c44a888475ab8be538480b3b97e/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:13.002598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888171c4-9db8-4e2a-829f-293699123ccb admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:13.004349 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-888171c4-9db8-4e2a-829f-293699123ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:13.012550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1250/2500] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:54:13.020564 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fa4ab-666e-49eb-ac30-b8ba56cfd48f None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:13.020855 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fa4ab-666e-49eb-ac30-b8ba56cfd48f None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:13.021134 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fa4ab-666e-49eb-ac30-b8ba56cfd48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:13.041768 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-ed0fa4ab-666e-49eb-ac30-b8ba56cfd48f None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:13.043505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-ed0fa4ab-666e-49eb-ac30-b8ba56cfd48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:13.070067 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888171c4-9db8-4e2a-829f-293699123ccb admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:13.074766 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639bb34-26d9-44cb-ae3f-0c13a31739a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:13.077027 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639bb34-26d9-44cb-ae3f-0c13a31739a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:13.077191 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639bb34-26d9-44cb-ae3f-0c13a31739a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:13.077477 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639bb34-26d9-44cb-ae3f-0c13a31739a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:13.078215 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639bb34-26d9-44cb-ae3f-0c13a31739a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:13.079940 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639bb34-26d9-44cb-ae3f-0c13a31739a1 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:13.095255 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1251/2501] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:54:13.096032 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639bb34-26d9-44cb-ae3f-0c13a31739a1 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:13.108272 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639bb34-26d9-44cb-ae3f-0c13a31739a1 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:13.112111 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1251/2502] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:54:13.113243 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fa4ab-666e-49eb-ac30-b8ba56cfd48f None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:13.113365 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d0183-d642-4fa2-9be0-d09de2c18d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:13.114310 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d0183-d642-4fa2-9be0-d09de2c18d5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:13.114603 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d0183-d642-4fa2-9be0-d09de2c18d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:13.114918 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d0183-d642-4fa2-9be0-d09de2c18d5b admin admin] PATH_INFO: `/v3/projects/c7758626437f465c984d5e7e68e76edc/users/aaa04c44a888475ab8be538480b3b97e/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:13.117620 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d0183-d642-4fa2-9be0-d09de2c18d5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7758626437f465c984d5e7e68e76edc, user_id=aaa04c44a888475ab8be538480b3b97e, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:13.121289 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d0183-d642-4fa2-9be0-d09de2c18d5b admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:13.124990 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fa4ab-666e-49eb-ac30-b8ba56cfd48f None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:13.130626 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299428af-b01c-4fa6-8fe0-8c00c63d72d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:13.131704 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299428af-b01c-4fa6-8fe0-8c00c63d72d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:13.132032 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299428af-b01c-4fa6-8fe0-8c00c63d72d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:13.132316 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299428af-b01c-4fa6-8fe0-8c00c63d72d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:13.133049 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299428af-b01c-4fa6-8fe0-8c00c63d72d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:54:13.143196 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1252/2503] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:54:13 2022] PUT /identity/v3/projects/c7758626437f465c984d5e7e68e76edc/users/aaa04c44a888475ab8be538480b3b97e/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:13.143521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299428af-b01c-4fa6-8fe0-8c00c63d72d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:13.143521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299428af-b01c-4fa6-8fe0-8c00c63d72d9 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:13.146987 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a1ad1-42f1-4ea0-820d-c9278d198536 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:13.148131 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a1ad1-42f1-4ea0-820d-c9278d198536 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:13.148590 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a1ad1-42f1-4ea0-820d-c9278d198536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:13.148964 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1252/2504] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:54:13.154511 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299428af-b01c-4fa6-8fe0-8c00c63d72d9 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:13.165377 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299428af-b01c-4fa6-8fe0-8c00c63d72d9 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:13.175832 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:13.181184 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-f53a1ad1-42f1-4ea0-820d-c9278d198536 None None] MFA Rules not processed for user `aaa04c44a888475ab8be538480b3b97e`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:13.182488 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-f53a1ad1-42f1-4ea0-820d-c9278d198536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:13.232962 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700018e-e7db-4823-9509-50aca1f37600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:13.233761 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700018e-e7db-4823-9509-50aca1f37600 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:13.234065 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700018e-e7db-4823-9509-50aca1f37600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:13.234323 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700018e-e7db-4823-9509-50aca1f37600 admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:13.235211 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700018e-e7db-4823-9509-50aca1f37600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:13.237309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700018e-e7db-4823-9509-50aca1f37600 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:13.263820 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1253/2505] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:13 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:54:13.268686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1253/2506] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:54:13 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:54:13.272436 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a1ad1-42f1-4ea0-820d-c9278d198536 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:13.276986 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700018e-e7db-4823-9509-50aca1f37600 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:13.278937 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-7700018e-e7db-4823-9509-50aca1f37600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:13.284062 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a1ad1-42f1-4ea0-820d-c9278d198536 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:13.305939 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:13.339284 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700018e-e7db-4823-9509-50aca1f37600 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:13.343170 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f05942-56c0-4474-9902-d1796ed9d4a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:13.343904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f05942-56c0-4474-9902-d1796ed9d4a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:13.344014 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51130b94-7e08-4c14-956c-58dd12adbda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:13.344100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f05942-56c0-4474-9902-d1796ed9d4a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:13.344367 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f05942-56c0-4474-9902-d1796ed9d4a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:13.344645 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51130b94-7e08-4c14-956c-58dd12adbda7 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:13.344936 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51130b94-7e08-4c14-956c-58dd12adbda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:13.345204 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51130b94-7e08-4c14-956c-58dd12adbda7 admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:13.345884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51130b94-7e08-4c14-956c-58dd12adbda7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:13.347847 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51130b94-7e08-4c14-956c-58dd12adbda7 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:13.369815 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1254/2507] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:54:13 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:54:13.374061 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51130b94-7e08-4c14-956c-58dd12adbda7 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:13.385420 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51130b94-7e08-4c14-956c-58dd12adbda7 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:13.390622 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d879c21-79a3-41f0-88c4-8b58274f974f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:13.391518 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d879c21-79a3-41f0-88c4-8b58274f974f admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:13.391802 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d879c21-79a3-41f0-88c4-8b58274f974f admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:13.392718 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d879c21-79a3-41f0-88c4-8b58274f974f admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:13.393020 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d879c21-79a3-41f0-88c4-8b58274f974f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:13.394667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d879c21-79a3-41f0-88c4-8b58274f974f admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:13.406096 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1255/2508] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:54:13.411619 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d879c21-79a3-41f0-88c4-8b58274f974f admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:13.415141 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f05942-56c0-4474-9902-d1796ed9d4a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:13.416581 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f05942-56c0-4474-9902-d1796ed9d4a7 service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:13.422573 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d879c21-79a3-41f0-88c4-8b58274f974f admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:13.427098 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1254/2509] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:54:13 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:54:13.427943 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b949f91-c59d-4b8d-8bc4-b4218a2682dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:13.428608 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b949f91-c59d-4b8d-8bc4-b4218a2682dd admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:13.428935 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b949f91-c59d-4b8d-8bc4-b4218a2682dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:13.429218 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b949f91-c59d-4b8d-8bc4-b4218a2682dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:13.430241 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b949f91-c59d-4b8d-8bc4-b4218a2682dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:13.431606 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b949f91-c59d-4b8d-8bc4-b4218a2682dd admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:13.444086 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1256/2510] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:54:13.448636 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f05942-56c0-4474-9902-d1796ed9d4a7 service cinder] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:13.461557 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f05942-56c0-4474-9902-d1796ed9d4a7 service cinder] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:13.471796 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45e409-8bca-480e-9fc3-c36b07b34afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:13.473017 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45e409-8bca-480e-9fc3-c36b07b34afe admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:13.473798 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45e409-8bca-480e-9fc3-c36b07b34afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:13.474111 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45e409-8bca-480e-9fc3-c36b07b34afe admin admin] PATH_INFO: `/v3/projects/65a5b074ef7b467bb1e78b35c1384189/users/f0b40276ea0e4f158a9b4931eebe508e/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:13.493764 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d45e409-8bca-480e-9fc3-c36b07b34afe admin admin] RBAC: Authorizing `identity:create_grant(project_id=65a5b074ef7b467bb1e78b35c1384189, user_id=f0b40276ea0e4f158a9b4931eebe508e, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:13.496642 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d45e409-8bca-480e-9fc3-c36b07b34afe admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:13.513044 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1255/2511] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:54:13 2022] PUT /identity/v3/projects/65a5b074ef7b467bb1e78b35c1384189/users/f0b40276ea0e4f158a9b4931eebe508e/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:54:13.514451 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b949f91-c59d-4b8d-8bc4-b4218a2682dd admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:13.523835 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e7824-ea27-4818-9d06-90b1e926c0a9 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:13.524123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e7824-ea27-4818-9d06-90b1e926c0a9 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:13.524399 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e7824-ea27-4818-9d06-90b1e926c0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:13.534431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b949f91-c59d-4b8d-8bc4-b4218a2682dd admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:13.560189 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-1f6e7824-ea27-4818-9d06-90b1e926c0a9 None None] MFA Rules not processed for user `f0b40276ea0e4f158a9b4931eebe508e`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:13.561521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-1f6e7824-ea27-4818-9d06-90b1e926c0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:13.576500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:13.594837 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bea0d-ed0c-43c7-8a4b-5c4db6a05a45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:13.595649 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bea0d-ed0c-43c7-8a4b-5c4db6a05a45 service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:13.595900 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bea0d-ed0c-43c7-8a4b-5c4db6a05a45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:13.596361 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bea0d-ed0c-43c7-8a4b-5c4db6a05a45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:13.598378 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-385bea0d-ed0c-43c7-8a4b-5c4db6a05a45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:13.641702 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1256/2512] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:54:13.652810 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e7824-ea27-4818-9d06-90b1e926c0a9 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:13.654239 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-1f6e7824-ea27-4818-9d06-90b1e926c0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:13.670232 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e7824-ea27-4818-9d06-90b1e926c0a9 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:13.670936 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385bea0d-ed0c-43c7-8a4b-5c4db6a05a45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:13.672366 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385bea0d-ed0c-43c7-8a4b-5c4db6a05a45 service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:13.674530 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49770a-4a3e-4d6d-8e41-78d6b634544e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:13.675369 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49770a-4a3e-4d6d-8e41-78d6b634544e service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:13.675768 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49770a-4a3e-4d6d-8e41-78d6b634544e service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:13.676148 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49770a-4a3e-4d6d-8e41-78d6b634544e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:13.684827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1257/2513] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:54:13 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:54:13.685891 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49770a-4a3e-4d6d-8e41-78d6b634544e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:13.687609 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49770a-4a3e-4d6d-8e41-78d6b634544e service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:13.698989 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1257/2514] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:54:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:54:15.599089 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bea0d-ed0c-43c7-8a4b-5c4db6a05a45 service cinder] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:15.650191 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:15.666188 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bea0d-ed0c-43c7-8a4b-5c4db6a05a45 service cinder] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:15.670765 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e61dd-3fd5-48ce-988e-f3da86e25453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:15.671645 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e61dd-3fd5-48ce-988e-f3da86e25453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:15.671930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e61dd-3fd5-48ce-988e-f3da86e25453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:15.672212 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e61dd-3fd5-48ce-988e-f3da86e25453 admin admin] PATH_INFO: `/v3/users/bb7e432bf25544c2b2166a5a83a25bdd` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:15.673402 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e61dd-3fd5-48ce-988e-f3da86e25453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb7e432bf25544c2b2166a5a83a25bdd)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:15.675400 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e61dd-3fd5-48ce-988e-f3da86e25453 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:15.722188 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-2c3e61dd-3fd5-48ce-988e-f3da86e25453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb7e432bf25544c2b2166a5a83a25bdd'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:15.722933 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-2c3e61dd-3fd5-48ce-988e-f3da86e25453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb7e432bf25544c2b2166a5a83a25bdd'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:15.736816 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-2c3e61dd-3fd5-48ce-988e-f3da86e25453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb7e432bf25544c2b2166a5a83a25bdd'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:15.745474 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-2c3e61dd-3fd5-48ce-988e-f3da86e25453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb7e432bf25544c2b2166a5a83a25bdd'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:15.746102 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-2c3e61dd-3fd5-48ce-988e-f3da86e25453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb7e432bf25544c2b2166a5a83a25bdd'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:15.758115 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1258/2515] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:54:15 2022] DELETE /identity/v3/users/bb7e432bf25544c2b2166a5a83a25bdd => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:15.762945 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3a7f1-e3a4-4cf5-8db0-801c8a2e95c6 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:15.763376 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3a7f1-e3a4-4cf5-8db0-801c8a2e95c6 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:15.763508 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3a7f1-e3a4-4cf5-8db0-801c8a2e95c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:15.780876 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-7ea3a7f1-e3a4-4cf5-8db0-801c8a2e95c6 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:15.782078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-7ea3a7f1-e3a4-4cf5-8db0-801c8a2e95c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:15.848861 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1258/2516] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:54:15.858989 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e61dd-3fd5-48ce-988e-f3da86e25453 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:15.860452 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-2c3e61dd-3fd5-48ce-988e-f3da86e25453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:15.917458 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e61dd-3fd5-48ce-988e-f3da86e25453 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:15.921133 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950face-11ab-4017-8123-f8b20a3b8fc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:15.921796 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950face-11ab-4017-8123-f8b20a3b8fc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:15.922064 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950face-11ab-4017-8123-f8b20a3b8fc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:15.922342 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950face-11ab-4017-8123-f8b20a3b8fc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:15.932269 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950face-11ab-4017-8123-f8b20a3b8fc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:15.933714 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950face-11ab-4017-8123-f8b20a3b8fc3 service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:15.944229 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1259/2517] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:54:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:54:16.229081 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea3a7f1-e3a4-4cf5-8db0-801c8a2e95c6 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:16.230609 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-7ea3a7f1-e3a4-4cf5-8db0-801c8a2e95c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:16.242770 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea3a7f1-e3a4-4cf5-8db0-801c8a2e95c6 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:16.248211 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe966a-6d5c-4a18-9daa-7800ad4262e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:16.249137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe966a-6d5c-4a18-9daa-7800ad4262e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:16.249355 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe966a-6d5c-4a18-9daa-7800ad4262e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:16.249716 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe966a-6d5c-4a18-9daa-7800ad4262e3 admin admin] PATH_INFO: `/v3/projects/0092a5e288104d9796b84140af05c148` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:16.250829 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe966a-6d5c-4a18-9daa-7800ad4262e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0092a5e288104d9796b84140af05c148)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:16.252740 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe966a-6d5c-4a18-9daa-7800ad4262e3 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:16.302559 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-5afe966a-6d5c-4a18-9daa-7800ad4262e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0092a5e288104d9796b84140af05c148', 'request_id': 'req-5afe966a-6d5c-4a18-9daa-7800ad4262e3'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:16.309801 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-5afe966a-6d5c-4a18-9daa-7800ad4262e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0092a5e288104d9796b84140af05c148', 'request_id': 'req-5afe966a-6d5c-4a18-9daa-7800ad4262e3'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:16.316364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-5afe966a-6d5c-4a18-9daa-7800ad4262e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0092a5e288104d9796b84140af05c148', 'request_id': 'req-5afe966a-6d5c-4a18-9daa-7800ad4262e3'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:16.327846 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-5afe966a-6d5c-4a18-9daa-7800ad4262e3 admin admin] The token cache is being invalidate because project 0092a5e288104d9796b84140af05c148 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:54:16.328130 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-5afe966a-6d5c-4a18-9daa-7800ad4262e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:16.328907 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-5afe966a-6d5c-4a18-9daa-7800ad4262e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:16.330440 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1259/2518] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:54:16 2022] DELETE /identity/v3/projects/0092a5e288104d9796b84140af05c148 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:16.334286 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950face-11ab-4017-8123-f8b20a3b8fc3 service neutron] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:16.344151 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950face-11ab-4017-8123-f8b20a3b8fc3 service neutron] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:16.400928 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c642d-bf70-43fd-b78e-d3f087da8a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:16.401797 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c642d-bf70-43fd-b78e-d3f087da8a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:16.402116 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c642d-bf70-43fd-b78e-d3f087da8a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:16.402392 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c642d-bf70-43fd-b78e-d3f087da8a56 admin admin] PATH_INFO: `/v3/users/aaa04c44a888475ab8be538480b3b97e` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:16.403632 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c642d-bf70-43fd-b78e-d3f087da8a56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaa04c44a888475ab8be538480b3b97e)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:16.405564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c642d-bf70-43fd-b78e-d3f087da8a56 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:16.416130 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:16.452041 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-979c642d-bf70-43fd-b78e-d3f087da8a56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaa04c44a888475ab8be538480b3b97e'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:16.452759 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-979c642d-bf70-43fd-b78e-d3f087da8a56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaa04c44a888475ab8be538480b3b97e'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:16.464925 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-979c642d-bf70-43fd-b78e-d3f087da8a56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaa04c44a888475ab8be538480b3b97e'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:16.472523 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-979c642d-bf70-43fd-b78e-d3f087da8a56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaa04c44a888475ab8be538480b3b97e'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:16.473136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-979c642d-bf70-43fd-b78e-d3f087da8a56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaa04c44a888475ab8be538480b3b97e'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:16.486167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1260/2519] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:54:16 2022] DELETE /identity/v3/users/aaa04c44a888475ab8be538480b3b97e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:16.848544 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe966a-6d5c-4a18-9daa-7800ad4262e3 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:16.851133 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-5afe966a-6d5c-4a18-9daa-7800ad4262e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:16.871530 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe966a-6d5c-4a18-9daa-7800ad4262e3 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:16.894115 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:16.938654 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda5610-6c6e-4e8c-b614-26f7891ae229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:16.939524 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda5610-6c6e-4e8c-b614-26f7891ae229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:16.939805 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda5610-6c6e-4e8c-b614-26f7891ae229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:16.940077 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda5610-6c6e-4e8c-b614-26f7891ae229 admin admin] PATH_INFO: `/v3/projects/c7758626437f465c984d5e7e68e76edc` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:16.941252 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda5610-6c6e-4e8c-b614-26f7891ae229 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7758626437f465c984d5e7e68e76edc)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:16.943241 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda5610-6c6e-4e8c-b614-26f7891ae229 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:16.989301 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-8dda5610-6c6e-4e8c-b614-26f7891ae229 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7758626437f465c984d5e7e68e76edc', 'request_id': 'req-8dda5610-6c6e-4e8c-b614-26f7891ae229'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:16.996983 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-8dda5610-6c6e-4e8c-b614-26f7891ae229 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7758626437f465c984d5e7e68e76edc', 'request_id': 'req-8dda5610-6c6e-4e8c-b614-26f7891ae229'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:17.003358 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-8dda5610-6c6e-4e8c-b614-26f7891ae229 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7758626437f465c984d5e7e68e76edc', 'request_id': 'req-8dda5610-6c6e-4e8c-b614-26f7891ae229'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:17.014534 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-8dda5610-6c6e-4e8c-b614-26f7891ae229 admin admin] The token cache is being invalidate because project c7758626437f465c984d5e7e68e76edc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:54:17.014794 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-8dda5610-6c6e-4e8c-b614-26f7891ae229 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:17.015771 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-8dda5610-6c6e-4e8c-b614-26f7891ae229 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:17.016965 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1260/2520] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:54:16 2022] DELETE /identity/v3/projects/c7758626437f465c984d5e7e68e76edc => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:17.021867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a9523-222c-4e6f-861b-f20ee96f4154 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:17.022342 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a9523-222c-4e6f-861b-f20ee96f4154 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:17.022444 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a9523-222c-4e6f-861b-f20ee96f4154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:17.040256 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-8c5a9523-222c-4e6f-861b-f20ee96f4154 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:17.041840 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-8c5a9523-222c-4e6f-861b-f20ee96f4154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:17.102207 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1261/2521] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:54:17.109938 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7238b-14b5-4a94-ab5d-68087ea0c984 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:17.110295 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7238b-14b5-4a94-ab5d-68087ea0c984 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:17.114895 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7238b-14b5-4a94-ab5d-68087ea0c984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:17.135286 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-dbc7238b-14b5-4a94-ab5d-68087ea0c984 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:17.136496 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-dbc7238b-14b5-4a94-ab5d-68087ea0c984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:17.145599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1261/2522] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:54:17.149811 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a9523-222c-4e6f-861b-f20ee96f4154 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:17.160090 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a9523-222c-4e6f-861b-f20ee96f4154 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:17.164647 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69988e71-938e-448b-aca9-730930c596f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:17.165292 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69988e71-938e-448b-aca9-730930c596f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:17.165575 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69988e71-938e-448b-aca9-730930c596f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:17.165850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69988e71-938e-448b-aca9-730930c596f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:17.166569 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69988e71-938e-448b-aca9-730930c596f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:54:17.166918 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69988e71-938e-448b-aca9-730930c596f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:17.168528 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69988e71-938e-448b-aca9-730930c596f2 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:17.180637 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1262/2523] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:54:17.184881 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7238b-14b5-4a94-ab5d-68087ea0c984 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:17.194116 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7238b-14b5-4a94-ab5d-68087ea0c984 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:17.199733 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5f77c-13e2-47fe-8d38-dde68a2b30b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:17.200382 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5f77c-13e2-47fe-8d38-dde68a2b30b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:17.200828 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5f77c-13e2-47fe-8d38-dde68a2b30b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:17.201110 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5f77c-13e2-47fe-8d38-dde68a2b30b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:17.201794 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5f77c-13e2-47fe-8d38-dde68a2b30b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:17.203740 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5f77c-13e2-47fe-8d38-dde68a2b30b4 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:17.228978 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1262/2524] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:54:17 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:54:17.233100 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69988e71-938e-448b-aca9-730930c596f2 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:17.243549 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69988e71-938e-448b-aca9-730930c596f2 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:17.299408 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdb3de-1739-41a3-9853-a02570c44ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:17.300004 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdb3de-1739-41a3-9853-a02570c44ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:17.300289 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdb3de-1739-41a3-9853-a02570c44ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:17.300567 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdb3de-1739-41a3-9853-a02570c44ff5 admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:17.301255 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbdb3de-1739-41a3-9853-a02570c44ff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:17.303372 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbdb3de-1739-41a3-9853-a02570c44ff5 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:17.324789 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1263/2525] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:54:17 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:54:17.329036 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5f77c-13e2-47fe-8d38-dde68a2b30b4 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:17.339266 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5f77c-13e2-47fe-8d38-dde68a2b30b4 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:17.344811 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02105e8-c5fd-499a-9336-607437e630cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:17.345885 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02105e8-c5fd-499a-9336-607437e630cb admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:17.346383 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02105e8-c5fd-499a-9336-607437e630cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:17.346830 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02105e8-c5fd-499a-9336-607437e630cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:17.347573 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02105e8-c5fd-499a-9336-607437e630cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:17.349645 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02105e8-c5fd-499a-9336-607437e630cb admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:17.362905 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1263/2526] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:54:17.367766 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdb3de-1739-41a3-9853-a02570c44ff5 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:17.374255 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:17.378018 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdb3de-1739-41a3-9853-a02570c44ff5 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:17.385306 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d68ca-380d-4bc1-a272-49fdf40f3a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:17.386275 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d68ca-380d-4bc1-a272-49fdf40f3a23 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:17.386749 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d68ca-380d-4bc1-a272-49fdf40f3a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:17.387085 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d68ca-380d-4bc1-a272-49fdf40f3a23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:17.388032 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d68ca-380d-4bc1-a272-49fdf40f3a23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:17.389666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d68ca-380d-4bc1-a272-49fdf40f3a23 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:17.401482 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1264/2527] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:54:17.405681 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02105e8-c5fd-499a-9336-607437e630cb admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:17.416017 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02105e8-c5fd-499a-9336-607437e630cb admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:17.421055 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d794a8-fd98-4f2b-be07-9e9868ddd6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:17.422049 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d794a8-fd98-4f2b-be07-9e9868ddd6ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:17.422332 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d794a8-fd98-4f2b-be07-9e9868ddd6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:17.422607 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d794a8-fd98-4f2b-be07-9e9868ddd6ba admin admin] PATH_INFO: `/v3/projects/d046c23825054d0087696003e512e386/users/6b85ac293ef247e6be65a15282bdd40d/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:17.440985 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d794a8-fd98-4f2b-be07-9e9868ddd6ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=d046c23825054d0087696003e512e386, user_id=6b85ac293ef247e6be65a15282bdd40d, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:17.443706 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d794a8-fd98-4f2b-be07-9e9868ddd6ba admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:17.458616 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1264/2528] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:54:17 2022] PUT /identity/v3/projects/d046c23825054d0087696003e512e386/users/6b85ac293ef247e6be65a15282bdd40d/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:54:17.472823 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3b9dd-b563-4fdf-ba80-434d35e5fa3f None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:17.473110 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3b9dd-b563-4fdf-ba80-434d35e5fa3f None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:17.473390 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3b9dd-b563-4fdf-ba80-434d35e5fa3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:17.498647 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-54d3b9dd-b563-4fdf-ba80-434d35e5fa3f None None] MFA Rules not processed for user `6b85ac293ef247e6be65a15282bdd40d`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:17.499866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-54d3b9dd-b563-4fdf-ba80-434d35e5fa3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:17.563771 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1265/2529] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:54:17.568151 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d794a8-fd98-4f2b-be07-9e9868ddd6ba admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:17.622588 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:17.635759 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d794a8-fd98-4f2b-be07-9e9868ddd6ba admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:17.641322 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b072360-825a-460b-9e77-bd408ea8cf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:17.641989 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b072360-825a-460b-9e77-bd408ea8cf5e admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:17.642275 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b072360-825a-460b-9e77-bd408ea8cf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:17.642551 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b072360-825a-460b-9e77-bd408ea8cf5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:17.643280 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b072360-825a-460b-9e77-bd408ea8cf5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:17.645233 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b072360-825a-460b-9e77-bd408ea8cf5e admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:17.671042 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1265/2530] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:54:17 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:54:17.675272 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3b9dd-b563-4fdf-ba80-434d35e5fa3f None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:17.686329 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3b9dd-b563-4fdf-ba80-434d35e5fa3f None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:17.742190 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ee99b-446c-4fd4-81bf-fb83af73abd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:17.742887 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ee99b-446c-4fd4-81bf-fb83af73abd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:17.743167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ee99b-446c-4fd4-81bf-fb83af73abd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:17.743441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ee99b-446c-4fd4-81bf-fb83af73abd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:17.744131 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ee99b-446c-4fd4-81bf-fb83af73abd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:17.746072 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ee99b-446c-4fd4-81bf-fb83af73abd8 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:17.766499 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1266/2531] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:54:17 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:54:17.770441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b072360-825a-460b-9e77-bd408ea8cf5e admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:17.781721 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b072360-825a-460b-9e77-bd408ea8cf5e admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:17.786223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80c60f-1d8b-444b-b40c-4d9f7f542e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:17.786910 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80c60f-1d8b-444b-b40c-4d9f7f542e92 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:17.787188 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80c60f-1d8b-444b-b40c-4d9f7f542e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:17.787462 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80c60f-1d8b-444b-b40c-4d9f7f542e92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:17.788751 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80c60f-1d8b-444b-b40c-4d9f7f542e92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:17.790352 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80c60f-1d8b-444b-b40c-4d9f7f542e92 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:17.800935 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1266/2532] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:54:17.805171 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ee99b-446c-4fd4-81bf-fb83af73abd8 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:17.815251 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ee99b-446c-4fd4-81bf-fb83af73abd8 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:17.819754 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090212bd-b4db-46f2-8c77-5148b7651dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:17.820624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090212bd-b4db-46f2-8c77-5148b7651dcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:17.820901 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090212bd-b4db-46f2-8c77-5148b7651dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:17.821171 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090212bd-b4db-46f2-8c77-5148b7651dcb admin admin] PATH_INFO: `/v3/projects/03bbb8db61b145b48c62ecf158b4a4c8/users/95b76e650e044a04bc1ce62eb8411aa5/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:17.836199 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090212bd-b4db-46f2-8c77-5148b7651dcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=03bbb8db61b145b48c62ecf158b4a4c8, user_id=95b76e650e044a04bc1ce62eb8411aa5, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:17.838892 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090212bd-b4db-46f2-8c77-5148b7651dcb admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:17.852221 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1267/2533] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:54:17 2022] PUT /identity/v3/projects/03bbb8db61b145b48c62ecf158b4a4c8/users/95b76e650e044a04bc1ce62eb8411aa5/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:17.856040 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80c60f-1d8b-444b-b40c-4d9f7f542e92 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:17.866919 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80c60f-1d8b-444b-b40c-4d9f7f542e92 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:17.940095 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d5577-6edd-4c92-8201-deceee0c0801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:17.940775 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d5577-6edd-4c92-8201-deceee0c0801 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:17.941094 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d5577-6edd-4c92-8201-deceee0c0801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:17.941376 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d5577-6edd-4c92-8201-deceee0c0801 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:17.942102 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d5577-6edd-4c92-8201-deceee0c0801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:17.943776 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d5577-6edd-4c92-8201-deceee0c0801 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:17.955565 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1267/2534] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:54:17.959581 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090212bd-b4db-46f2-8c77-5148b7651dcb admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:17.971001 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090212bd-b4db-46f2-8c77-5148b7651dcb admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:17.975363 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649040f-2c5e-4957-bbb7-f7a5439c9915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:17.976867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649040f-2c5e-4957-bbb7-f7a5439c9915 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:17.977152 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649040f-2c5e-4957-bbb7-f7a5439c9915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:17.977429 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649040f-2c5e-4957-bbb7-f7a5439c9915 admin admin] PATH_INFO: `/v3/projects/03bbb8db61b145b48c62ecf158b4a4c8/users/95b76e650e044a04bc1ce62eb8411aa5/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:17.979417 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6649040f-2c5e-4957-bbb7-f7a5439c9915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03bbb8db61b145b48c62ecf158b4a4c8, user_id=95b76e650e044a04bc1ce62eb8411aa5, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:17.982087 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6649040f-2c5e-4957-bbb7-f7a5439c9915 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:17.993012 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1268/2535] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:54:17 2022] PUT /identity/v3/projects/03bbb8db61b145b48c62ecf158b4a4c8/users/95b76e650e044a04bc1ce62eb8411aa5/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:18.004086 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16baab-d957-4698-8172-a4b06b92813a None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:18.004378 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16baab-d957-4698-8172-a4b06b92813a None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:18.004656 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16baab-d957-4698-8172-a4b06b92813a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:18.037332 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-0d16baab-d957-4698-8172-a4b06b92813a None None] MFA Rules not processed for user `95b76e650e044a04bc1ce62eb8411aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:18.039730 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-0d16baab-d957-4698-8172-a4b06b92813a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:18.114079 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1268/2536] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:54:18.125095 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649040f-2c5e-4957-bbb7-f7a5439c9915 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:18.127179 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-6649040f-2c5e-4957-bbb7-f7a5439c9915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:18.168336 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:18.191254 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649040f-2c5e-4957-bbb7-f7a5439c9915 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:18.195449 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c32f0-2be8-4757-bc10-d8ae1f09077d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:18.196102 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c32f0-2be8-4757-bc10-d8ae1f09077d service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:18.196389 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c32f0-2be8-4757-bc10-d8ae1f09077d service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:18.196667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c32f0-2be8-4757-bc10-d8ae1f09077d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:18.205884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c32f0-2be8-4757-bc10-d8ae1f09077d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:18.207255 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c32f0-2be8-4757-bc10-d8ae1f09077d service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:18.217532 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1269/2537] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:54:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:54:18.284370 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16baab-d957-4698-8172-a4b06b92813a None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:18.334582 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:18.353024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16baab-d957-4698-8172-a4b06b92813a None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:18.359584 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f93f8f-ad5c-4980-b5fe-b06c22712945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:18.360487 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f93f8f-ad5c-4980-b5fe-b06c22712945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:18.360774 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f93f8f-ad5c-4980-b5fe-b06c22712945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:18.361048 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f93f8f-ad5c-4980-b5fe-b06c22712945 admin admin] PATH_INFO: `/v3/users/6b85ac293ef247e6be65a15282bdd40d` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:18.362317 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f93f8f-ad5c-4980-b5fe-b06c22712945 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b85ac293ef247e6be65a15282bdd40d)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:18.364323 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f93f8f-ad5c-4980-b5fe-b06c22712945 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:18.424314 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-e4f93f8f-ad5c-4980-b5fe-b06c22712945 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b85ac293ef247e6be65a15282bdd40d'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:18.425066 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-e4f93f8f-ad5c-4980-b5fe-b06c22712945 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b85ac293ef247e6be65a15282bdd40d'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:18.439550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-e4f93f8f-ad5c-4980-b5fe-b06c22712945 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b85ac293ef247e6be65a15282bdd40d'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:18.440450 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-e4f93f8f-ad5c-4980-b5fe-b06c22712945 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b85ac293ef247e6be65a15282bdd40d'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:18.449571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-e4f93f8f-ad5c-4980-b5fe-b06c22712945 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b85ac293ef247e6be65a15282bdd40d'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:18.462879 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1269/2538] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:54:18 2022] DELETE /identity/v3/users/6b85ac293ef247e6be65a15282bdd40d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:18.467506 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f851d33-3e6e-4cd0-8608-1444afcbb22c None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:18.467842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f851d33-3e6e-4cd0-8608-1444afcbb22c None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:18.468120 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f851d33-3e6e-4cd0-8608-1444afcbb22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:18.493194 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-9f851d33-3e6e-4cd0-8608-1444afcbb22c None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:18.494569 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-9f851d33-3e6e-4cd0-8608-1444afcbb22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:18.556583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1270/2539] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:54:18.565897 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f93f8f-ad5c-4980-b5fe-b06c22712945 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:18.567311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-e4f93f8f-ad5c-4980-b5fe-b06c22712945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:18.624507 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f93f8f-ad5c-4980-b5fe-b06c22712945 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:18.628325 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb3dce-17ab-495b-a5f6-524c207e0107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:18.628979 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb3dce-17ab-495b-a5f6-524c207e0107 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:18.629263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb3dce-17ab-495b-a5f6-524c207e0107 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:18.629540 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb3dce-17ab-495b-a5f6-524c207e0107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:18.641741 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb3dce-17ab-495b-a5f6-524c207e0107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:18.643265 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb3dce-17ab-495b-a5f6-524c207e0107 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:18.653437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1270/2540] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:54:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:54:18.934827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f851d33-3e6e-4cd0-8608-1444afcbb22c None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:18.936647 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-9f851d33-3e6e-4cd0-8608-1444afcbb22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:18.955339 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f851d33-3e6e-4cd0-8608-1444afcbb22c None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:18.963022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f4a4c-6bf5-4fd2-b629-5920ba9bf85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:18.963912 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f4a4c-6bf5-4fd2-b629-5920ba9bf85b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:18.964198 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f4a4c-6bf5-4fd2-b629-5920ba9bf85b admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:18.964502 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f4a4c-6bf5-4fd2-b629-5920ba9bf85b admin admin] PATH_INFO: `/v3/projects/d046c23825054d0087696003e512e386` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:18.965850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f4a4c-6bf5-4fd2-b629-5920ba9bf85b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d046c23825054d0087696003e512e386)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:18.967955 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f4a4c-6bf5-4fd2-b629-5920ba9bf85b admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:19.016623 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-308f4a4c-6bf5-4fd2-b629-5920ba9bf85b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd046c23825054d0087696003e512e386', 'request_id': 'req-308f4a4c-6bf5-4fd2-b629-5920ba9bf85b'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:19.023075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-308f4a4c-6bf5-4fd2-b629-5920ba9bf85b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd046c23825054d0087696003e512e386', 'request_id': 'req-308f4a4c-6bf5-4fd2-b629-5920ba9bf85b'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:19.028577 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-308f4a4c-6bf5-4fd2-b629-5920ba9bf85b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd046c23825054d0087696003e512e386', 'request_id': 'req-308f4a4c-6bf5-4fd2-b629-5920ba9bf85b'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:19.041648 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-308f4a4c-6bf5-4fd2-b629-5920ba9bf85b admin admin] The token cache is being invalidate because project d046c23825054d0087696003e512e386 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:54:19.041942 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-308f4a4c-6bf5-4fd2-b629-5920ba9bf85b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:19.042574 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-308f4a4c-6bf5-4fd2-b629-5920ba9bf85b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:19.047226 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1271/2541] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:54:18 2022] DELETE /identity/v3/projects/d046c23825054d0087696003e512e386 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:19.048226 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb3dce-17ab-495b-a5f6-524c207e0107 service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:19.060463 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb3dce-17ab-495b-a5f6-524c207e0107 service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:19.137310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e156f-3332-44b7-a3c7-5e012bae1056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:19.138314 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e156f-3332-44b7-a3c7-5e012bae1056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:19.138695 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e156f-3332-44b7-a3c7-5e012bae1056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:19.139044 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e156f-3332-44b7-a3c7-5e012bae1056 admin admin] PATH_INFO: `/v3/users/95b76e650e044a04bc1ce62eb8411aa5` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:19.140422 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e156f-3332-44b7-a3c7-5e012bae1056 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95b76e650e044a04bc1ce62eb8411aa5)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:19.142410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e156f-3332-44b7-a3c7-5e012bae1056 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:19.154021 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:19.205039 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-cd7e156f-3332-44b7-a3c7-5e012bae1056 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95b76e650e044a04bc1ce62eb8411aa5'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:19.205732 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-cd7e156f-3332-44b7-a3c7-5e012bae1056 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95b76e650e044a04bc1ce62eb8411aa5'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:19.224430 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-cd7e156f-3332-44b7-a3c7-5e012bae1056 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95b76e650e044a04bc1ce62eb8411aa5'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:19.225233 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-cd7e156f-3332-44b7-a3c7-5e012bae1056 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95b76e650e044a04bc1ce62eb8411aa5'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:19.240869 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-cd7e156f-3332-44b7-a3c7-5e012bae1056 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95b76e650e044a04bc1ce62eb8411aa5'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:19.256012 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1271/2542] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:54:19 2022] DELETE /identity/v3/users/95b76e650e044a04bc1ce62eb8411aa5 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:19.554959 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f4a4c-6bf5-4fd2-b629-5920ba9bf85b admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:19.557324 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-308f4a4c-6bf5-4fd2-b629-5920ba9bf85b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:19.571060 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f4a4c-6bf5-4fd2-b629-5920ba9bf85b admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:19.629101 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acbfca-063a-4535-ba6f-5fe24b2cfa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:19.629973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acbfca-063a-4535-ba6f-5fe24b2cfa0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:19.630257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acbfca-063a-4535-ba6f-5fe24b2cfa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:19.630615 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acbfca-063a-4535-ba6f-5fe24b2cfa0e admin admin] PATH_INFO: `/v3/projects/03bbb8db61b145b48c62ecf158b4a4c8` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:19.632481 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8acbfca-063a-4535-ba6f-5fe24b2cfa0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=03bbb8db61b145b48c62ecf158b4a4c8)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:19.634547 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8acbfca-063a-4535-ba6f-5fe24b2cfa0e admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:19.637151 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:19.684360 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-c8acbfca-063a-4535-ba6f-5fe24b2cfa0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03bbb8db61b145b48c62ecf158b4a4c8', 'request_id': 'req-c8acbfca-063a-4535-ba6f-5fe24b2cfa0e'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:19.690451 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-c8acbfca-063a-4535-ba6f-5fe24b2cfa0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03bbb8db61b145b48c62ecf158b4a4c8', 'request_id': 'req-c8acbfca-063a-4535-ba6f-5fe24b2cfa0e'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:19.696485 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-c8acbfca-063a-4535-ba6f-5fe24b2cfa0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03bbb8db61b145b48c62ecf158b4a4c8', 'request_id': 'req-c8acbfca-063a-4535-ba6f-5fe24b2cfa0e'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:19.710844 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-c8acbfca-063a-4535-ba6f-5fe24b2cfa0e admin admin] The token cache is being invalidate because project 03bbb8db61b145b48c62ecf158b4a4c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:54:19.711128 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-c8acbfca-063a-4535-ba6f-5fe24b2cfa0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:19.712399 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-c8acbfca-063a-4535-ba6f-5fe24b2cfa0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:19.713933 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1272/2543] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:54:19 2022] DELETE /identity/v3/projects/03bbb8db61b145b48c62ecf158b4a4c8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:19.718947 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18615c79-ec80-4c81-8ac2-297f023f02ca None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:19.719243 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18615c79-ec80-4c81-8ac2-297f023f02ca None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:19.719558 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18615c79-ec80-4c81-8ac2-297f023f02ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:19.744087 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-18615c79-ec80-4c81-8ac2-297f023f02ca None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:19.745299 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-18615c79-ec80-4c81-8ac2-297f023f02ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:19.810429 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1272/2544] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:54:19.817872 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff41f9-9e9a-41a7-8799-95d56559c34b None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:19.818163 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff41f9-9e9a-41a7-8799-95d56559c34b None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:19.818441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff41f9-9e9a-41a7-8799-95d56559c34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:19.838146 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-55ff41f9-9e9a-41a7-8799-95d56559c34b None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:19.839360 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-55ff41f9-9e9a-41a7-8799-95d56559c34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:19.847291 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1273/2545] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:54:19.851687 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18615c79-ec80-4c81-8ac2-297f023f02ca None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:19.861702 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18615c79-ec80-4c81-8ac2-297f023f02ca None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:19.866895 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8dca2c-1d2b-4b46-9e9b-8d11924f5793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:19.867774 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dca2c-1d2b-4b46-9e9b-8d11924f5793 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:19.868167 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dca2c-1d2b-4b46-9e9b-8d11924f5793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:19.868521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dca2c-1d2b-4b46-9e9b-8d11924f5793 admin admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:19.875300 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8dca2c-1d2b-4b46-9e9b-8d11924f5793 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:54:19.875300 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8dca2c-1d2b-4b46-9e9b-8d11924f5793 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:19.875300 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8dca2c-1d2b-4b46-9e9b-8d11924f5793 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:19.885244 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1273/2546] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:54:19.889358 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff41f9-9e9a-41a7-8799-95d56559c34b None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:19.898742 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff41f9-9e9a-41a7-8799-95d56559c34b None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:19.903494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55774150-a0eb-4413-98c9-3048011b6aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:19.904210 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55774150-a0eb-4413-98c9-3048011b6aff admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:19.904561 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55774150-a0eb-4413-98c9-3048011b6aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:19.904920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55774150-a0eb-4413-98c9-3048011b6aff admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:19.905669 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55774150-a0eb-4413-98c9-3048011b6aff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:19.907711 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55774150-a0eb-4413-98c9-3048011b6aff admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:19.933960 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1274/2547] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:54:19 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:54:19.938166 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8dca2c-1d2b-4b46-9e9b-8d11924f5793 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:19.949129 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8dca2c-1d2b-4b46-9e9b-8d11924f5793 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:20.005208 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9005a97-d20e-444c-aed9-584992489bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:20.006083 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9005a97-d20e-444c-aed9-584992489bef admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:20.006373 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9005a97-d20e-444c-aed9-584992489bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:20.007782 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9005a97-d20e-444c-aed9-584992489bef admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:20.008652 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9005a97-d20e-444c-aed9-584992489bef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:20.010871 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9005a97-d20e-444c-aed9-584992489bef admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:20.033041 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1274/2548] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:54:19 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:54:20.037177 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55774150-a0eb-4413-98c9-3048011b6aff admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:20.047989 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55774150-a0eb-4413-98c9-3048011b6aff admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:20.053143 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895f8e1-af3f-4abd-b440-4604eaae329c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:20.055067 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895f8e1-af3f-4abd-b440-4604eaae329c admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:20.055067 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895f8e1-af3f-4abd-b440-4604eaae329c admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:20.055425 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895f8e1-af3f-4abd-b440-4604eaae329c admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:20.056300 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895f8e1-af3f-4abd-b440-4604eaae329c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:20.058025 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895f8e1-af3f-4abd-b440-4604eaae329c admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:20.080292 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1275/2549] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:54:20.084447 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9005a97-d20e-444c-aed9-584992489bef admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:20.091863 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:20.096280 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9005a97-d20e-444c-aed9-584992489bef admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:20.104065 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413787e-831d-4952-9271-169a87e042dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:20.104746 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413787e-831d-4952-9271-169a87e042dd admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:20.105036 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413787e-831d-4952-9271-169a87e042dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:20.105308 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413787e-831d-4952-9271-169a87e042dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:20.107171 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413787e-831d-4952-9271-169a87e042dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:20.109471 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413787e-831d-4952-9271-169a87e042dd admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:20.125780 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1275/2550] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:54:20.127084 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895f8e1-af3f-4abd-b440-4604eaae329c admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:20.138517 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895f8e1-af3f-4abd-b440-4604eaae329c admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:20.143459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8bd01-4c26-41f7-9336-c44035612e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:20.144411 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8bd01-4c26-41f7-9336-c44035612e3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:20.144696 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8bd01-4c26-41f7-9336-c44035612e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:20.144968 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8bd01-4c26-41f7-9336-c44035612e3f admin admin] PATH_INFO: `/v3/projects/b539367b067c4424bad7a1930679f6d0/users/2f8144232a9c4995836916d7e0dca15d/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:20.161150 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8bd01-4c26-41f7-9336-c44035612e3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b539367b067c4424bad7a1930679f6d0, user_id=2f8144232a9c4995836916d7e0dca15d, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:20.163868 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8bd01-4c26-41f7-9336-c44035612e3f admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:20.177601 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1276/2551] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:54:20 2022] PUT /identity/v3/projects/b539367b067c4424bad7a1930679f6d0/users/2f8144232a9c4995836916d7e0dca15d/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:20.188305 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d72bde-03b8-4981-9fed-88def24371f4 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:20.188541 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d72bde-03b8-4981-9fed-88def24371f4 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:20.188817 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d72bde-03b8-4981-9fed-88def24371f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:20.215945 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-d1d72bde-03b8-4981-9fed-88def24371f4 None None] MFA Rules not processed for user `2f8144232a9c4995836916d7e0dca15d`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:20.217166 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-d1d72bde-03b8-4981-9fed-88def24371f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:20.292768 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1276/2552] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:54:20.297227 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8bd01-4c26-41f7-9336-c44035612e3f admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:20.395129 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8bd01-4c26-41f7-9336-c44035612e3f admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:20.400221 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae9399-2409-4f4d-9dd9-997ea6cba430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:20.401011 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae9399-2409-4f4d-9dd9-997ea6cba430 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:20.401402 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae9399-2409-4f4d-9dd9-997ea6cba430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:20.401982 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae9399-2409-4f4d-9dd9-997ea6cba430 admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:20.402837 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae9399-2409-4f4d-9dd9-997ea6cba430 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:20.404879 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae9399-2409-4f4d-9dd9-997ea6cba430 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:20.446818 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1277/2553] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:54:20 2022] POST /identity/v3/projects => generated 381 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:54:20.447981 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d72bde-03b8-4981-9fed-88def24371f4 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:20.471361 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d72bde-03b8-4981-9fed-88def24371f4 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:20.554627 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493ba72-33e8-4104-82e4-f279277c358b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:20.555464 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493ba72-33e8-4104-82e4-f279277c358b admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:20.555756 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493ba72-33e8-4104-82e4-f279277c358b admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:20.556042 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493ba72-33e8-4104-82e4-f279277c358b admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:20.556713 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6493ba72-33e8-4104-82e4-f279277c358b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:20.558663 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6493ba72-33e8-4104-82e4-f279277c358b admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:20.579169 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1277/2554] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:54:20 2022] POST /identity/v3/users => generated 297 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:54:20.583668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae9399-2409-4f4d-9dd9-997ea6cba430 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:20.594366 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae9399-2409-4f4d-9dd9-997ea6cba430 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:20.599679 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9918f62-a692-4c76-b426-3dcc4d0de81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:20.600909 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9918f62-a692-4c76-b426-3dcc4d0de81e admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:20.601191 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9918f62-a692-4c76-b426-3dcc4d0de81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:20.601464 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9918f62-a692-4c76-b426-3dcc4d0de81e admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:20.602186 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9918f62-a692-4c76-b426-3dcc4d0de81e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:20.603819 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9918f62-a692-4c76-b426-3dcc4d0de81e admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:20.614631 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1278/2555] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:54:20.619627 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493ba72-33e8-4104-82e4-f279277c358b admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:20.629439 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493ba72-33e8-4104-82e4-f279277c358b admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:20.635136 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1012890-373f-4841-8b58-b043f19a206f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:20.636281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1012890-373f-4841-8b58-b043f19a206f admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:20.636588 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1012890-373f-4841-8b58-b043f19a206f admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:20.636866 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1012890-373f-4841-8b58-b043f19a206f admin admin] PATH_INFO: `/v3/projects/8870362a2df543ca90801322a93b0b5a/users/85dc7b006dea48a3a8f9d07af10dc65c/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:20.651994 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1012890-373f-4841-8b58-b043f19a206f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8870362a2df543ca90801322a93b0b5a, user_id=85dc7b006dea48a3a8f9d07af10dc65c, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:20.654778 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1012890-373f-4841-8b58-b043f19a206f admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:20.668630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1278/2556] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:54:20 2022] PUT /identity/v3/projects/8870362a2df543ca90801322a93b0b5a/users/85dc7b006dea48a3a8f9d07af10dc65c/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:20.672645 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9918f62-a692-4c76-b426-3dcc4d0de81e admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:20.677794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:20.683979 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9918f62-a692-4c76-b426-3dcc4d0de81e admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:20.744158 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd2cf5-7b54-4e2f-91d0-890b19d67f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:20.744904 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd2cf5-7b54-4e2f-91d0-890b19d67f22 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:20.745171 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd2cf5-7b54-4e2f-91d0-890b19d67f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:20.745584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd2cf5-7b54-4e2f-91d0-890b19d67f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:20.746396 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd2cf5-7b54-4e2f-91d0-890b19d67f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:20.748332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd2cf5-7b54-4e2f-91d0-890b19d67f22 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:20.760089 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1279/2557] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:54:20.764236 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1012890-373f-4841-8b58-b043f19a206f admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:20.775440 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1012890-373f-4841-8b58-b043f19a206f admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:20.780755 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eec45f-4196-4ae0-8736-7d6ba7ce6460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:20.781667 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eec45f-4196-4ae0-8736-7d6ba7ce6460 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:20.782068 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eec45f-4196-4ae0-8736-7d6ba7ce6460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:20.782349 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eec45f-4196-4ae0-8736-7d6ba7ce6460 admin admin] PATH_INFO: `/v3/projects/8870362a2df543ca90801322a93b0b5a/users/85dc7b006dea48a3a8f9d07af10dc65c/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:20.784401 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eec45f-4196-4ae0-8736-7d6ba7ce6460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8870362a2df543ca90801322a93b0b5a, user_id=85dc7b006dea48a3a8f9d07af10dc65c, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:20.787254 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eec45f-4196-4ae0-8736-7d6ba7ce6460 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:20.800127 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1279/2558] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:54:20 2022] PUT /identity/v3/projects/8870362a2df543ca90801322a93b0b5a/users/85dc7b006dea48a3a8f9d07af10dc65c/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:20.811567 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba3432-cd01-4404-939b-ef56e56795f4 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:20.811911 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba3432-cd01-4404-939b-ef56e56795f4 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:20.812226 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba3432-cd01-4404-939b-ef56e56795f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:20.844128 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-06ba3432-cd01-4404-939b-ef56e56795f4 None None] MFA Rules not processed for user `85dc7b006dea48a3a8f9d07af10dc65c`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:20.845330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-06ba3432-cd01-4404-939b-ef56e56795f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:20.912596 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1280/2559] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:54:20.924684 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eec45f-4196-4ae0-8736-7d6ba7ce6460 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:20.926752 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-b6eec45f-4196-4ae0-8736-7d6ba7ce6460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:20.966832 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:20.986193 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eec45f-4196-4ae0-8736-7d6ba7ce6460 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:20.989713 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e9063-4ec1-42d8-b977-5470d7e01106 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:20.990353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e9063-4ec1-42d8-b977-5470d7e01106 service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:20.990631 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e9063-4ec1-42d8-b977-5470d7e01106 service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:20.990967 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e9063-4ec1-42d8-b977-5470d7e01106 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:20.999754 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e9063-4ec1-42d8-b977-5470d7e01106 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:21.001202 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e9063-4ec1-42d8-b977-5470d7e01106 service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:21.011518 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1280/2560] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:54:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:54:21.360853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba3432-cd01-4404-939b-ef56e56795f4 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:21.425665 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba3432-cd01-4404-939b-ef56e56795f4 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:21.430715 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c70289-2230-44ba-a6ba-e57f897ec7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:21.431591 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c70289-2230-44ba-a6ba-e57f897ec7d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:21.431875 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c70289-2230-44ba-a6ba-e57f897ec7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:21.432151 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c70289-2230-44ba-a6ba-e57f897ec7d0 admin admin] PATH_INFO: `/v3/users/2f8144232a9c4995836916d7e0dca15d` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:21.433340 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c70289-2230-44ba-a6ba-e57f897ec7d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f8144232a9c4995836916d7e0dca15d)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:21.435310 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c70289-2230-44ba-a6ba-e57f897ec7d0 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:21.463923 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:21.482720 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e1c70289-2230-44ba-a6ba-e57f897ec7d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f8144232a9c4995836916d7e0dca15d'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:21.483378 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e1c70289-2230-44ba-a6ba-e57f897ec7d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f8144232a9c4995836916d7e0dca15d'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:21.497481 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e1c70289-2230-44ba-a6ba-e57f897ec7d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f8144232a9c4995836916d7e0dca15d'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:21.510791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e1c70289-2230-44ba-a6ba-e57f897ec7d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f8144232a9c4995836916d7e0dca15d'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:21.511539 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e1c70289-2230-44ba-a6ba-e57f897ec7d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f8144232a9c4995836916d7e0dca15d'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:21.527690 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1281/2561] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:54:21 2022] DELETE /identity/v3/users/2f8144232a9c4995836916d7e0dca15d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:21.532845 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e66c45-9b17-491b-be6c-c0eb65bf2ec6 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:21.533355 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e66c45-9b17-491b-be6c-c0eb65bf2ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:21.533676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e66c45-9b17-491b-be6c-c0eb65bf2ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:21.557502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-89e66c45-9b17-491b-be6c-c0eb65bf2ec6 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:21.559703 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-89e66c45-9b17-491b-be6c-c0eb65bf2ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:21.643137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1281/2562] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:54:21.656560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c70289-2230-44ba-a6ba-e57f897ec7d0 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:21.658071 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-e1c70289-2230-44ba-a6ba-e57f897ec7d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:21.726199 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c70289-2230-44ba-a6ba-e57f897ec7d0 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:21.730430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafe0c0-8efb-41c8-aeeb-99535842ee92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:21.731299 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafe0c0-8efb-41c8-aeeb-99535842ee92 service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:21.731709 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafe0c0-8efb-41c8-aeeb-99535842ee92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:21.732095 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafe0c0-8efb-41c8-aeeb-99535842ee92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:21.743863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafe0c0-8efb-41c8-aeeb-99535842ee92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:21.745300 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafe0c0-8efb-41c8-aeeb-99535842ee92 service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:21.756375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1282/2563] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:54:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:54:22.046058 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e66c45-9b17-491b-be6c-c0eb65bf2ec6 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:22.047556 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-89e66c45-9b17-491b-be6c-c0eb65bf2ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:22.062501 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e66c45-9b17-491b-be6c-c0eb65bf2ec6 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:22.068282 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389245e-5078-478d-b85a-45d413bf4c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:22.069151 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389245e-5078-478d-b85a-45d413bf4c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:22.069433 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389245e-5078-478d-b85a-45d413bf4c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:22.069715 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389245e-5078-478d-b85a-45d413bf4c20 admin admin] PATH_INFO: `/v3/projects/b539367b067c4424bad7a1930679f6d0` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:22.070974 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389245e-5078-478d-b85a-45d413bf4c20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b539367b067c4424bad7a1930679f6d0)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:22.073052 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389245e-5078-478d-b85a-45d413bf4c20 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:22.124082 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-a389245e-5078-478d-b85a-45d413bf4c20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b539367b067c4424bad7a1930679f6d0', 'request_id': 'req-a389245e-5078-478d-b85a-45d413bf4c20'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:22.133614 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-a389245e-5078-478d-b85a-45d413bf4c20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b539367b067c4424bad7a1930679f6d0', 'request_id': 'req-a389245e-5078-478d-b85a-45d413bf4c20'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:22.140858 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-a389245e-5078-478d-b85a-45d413bf4c20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b539367b067c4424bad7a1930679f6d0', 'request_id': 'req-a389245e-5078-478d-b85a-45d413bf4c20'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:22.151787 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-a389245e-5078-478d-b85a-45d413bf4c20 admin admin] The token cache is being invalidate because project b539367b067c4424bad7a1930679f6d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:54:22.152072 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-a389245e-5078-478d-b85a-45d413bf4c20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:22.152697 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-a389245e-5078-478d-b85a-45d413bf4c20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:22.154222 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1282/2564] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:54:22 2022] DELETE /identity/v3/projects/b539367b067c4424bad7a1930679f6d0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:22.158182 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafe0c0-8efb-41c8-aeeb-99535842ee92 service neutron] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:22.168224 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafe0c0-8efb-41c8-aeeb-99535842ee92 service neutron] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:22.223396 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab721f-e35c-4aed-b56c-e667ae983804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:22.224262 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab721f-e35c-4aed-b56c-e667ae983804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:22.224544 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab721f-e35c-4aed-b56c-e667ae983804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:22.224820 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab721f-e35c-4aed-b56c-e667ae983804 admin admin] PATH_INFO: `/v3/users/85dc7b006dea48a3a8f9d07af10dc65c` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:22.226843 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab721f-e35c-4aed-b56c-e667ae983804 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85dc7b006dea48a3a8f9d07af10dc65c)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:22.228794 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab721f-e35c-4aed-b56c-e667ae983804 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:22.273617 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-b1ab721f-e35c-4aed-b56c-e667ae983804 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85dc7b006dea48a3a8f9d07af10dc65c'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:22.274202 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-b1ab721f-e35c-4aed-b56c-e667ae983804 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85dc7b006dea48a3a8f9d07af10dc65c'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:22.275375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:22.288728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-b1ab721f-e35c-4aed-b56c-e667ae983804 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85dc7b006dea48a3a8f9d07af10dc65c'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:22.295522 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-b1ab721f-e35c-4aed-b56c-e667ae983804 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85dc7b006dea48a3a8f9d07af10dc65c'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:22.296503 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-b1ab721f-e35c-4aed-b56c-e667ae983804 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85dc7b006dea48a3a8f9d07af10dc65c'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:22.308121 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1283/2565] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:54:22 2022] DELETE /identity/v3/users/85dc7b006dea48a3a8f9d07af10dc65c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:22.570412 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389245e-5078-478d-b85a-45d413bf4c20 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:22.571904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-a389245e-5078-478d-b85a-45d413bf4c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:22.584789 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389245e-5078-478d-b85a-45d413bf4c20 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:22.654566 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c25f9d-5947-49cb-80c7-76fb4e1a213d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:22.655521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c25f9d-5947-49cb-80c7-76fb4e1a213d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:22.655803 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c25f9d-5947-49cb-80c7-76fb4e1a213d admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:22.656078 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c25f9d-5947-49cb-80c7-76fb4e1a213d admin admin] PATH_INFO: `/v3/projects/8870362a2df543ca90801322a93b0b5a` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:22.657258 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c25f9d-5947-49cb-80c7-76fb4e1a213d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8870362a2df543ca90801322a93b0b5a)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:22.659297 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c25f9d-5947-49cb-80c7-76fb4e1a213d admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:22.661626 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:22.710631 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b7c25f9d-5947-49cb-80c7-76fb4e1a213d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8870362a2df543ca90801322a93b0b5a', 'request_id': 'req-b7c25f9d-5947-49cb-80c7-76fb4e1a213d'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:22.718729 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b7c25f9d-5947-49cb-80c7-76fb4e1a213d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8870362a2df543ca90801322a93b0b5a', 'request_id': 'req-b7c25f9d-5947-49cb-80c7-76fb4e1a213d'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:22.725825 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b7c25f9d-5947-49cb-80c7-76fb4e1a213d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8870362a2df543ca90801322a93b0b5a', 'request_id': 'req-b7c25f9d-5947-49cb-80c7-76fb4e1a213d'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:22.737425 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b7c25f9d-5947-49cb-80c7-76fb4e1a213d admin admin] The token cache is being invalidate because project 8870362a2df543ca90801322a93b0b5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:54:22.737719 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b7c25f9d-5947-49cb-80c7-76fb4e1a213d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:22.738396 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b7c25f9d-5947-49cb-80c7-76fb4e1a213d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:22.740188 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1283/2566] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:54:22 2022] DELETE /identity/v3/projects/8870362a2df543ca90801322a93b0b5a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:22.744755 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c631a-1988-45eb-a42d-ab4917bb751c None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:22.745254 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c631a-1988-45eb-a42d-ab4917bb751c None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:22.745344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c631a-1988-45eb-a42d-ab4917bb751c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:22.764096 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-274c631a-1988-45eb-a42d-ab4917bb751c None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:22.765383 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-274c631a-1988-45eb-a42d-ab4917bb751c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:22.830139 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1284/2567] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:54:22.837944 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9c9bb-6821-4986-a0fe-9672cf034b69 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:22.838235 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9c9bb-6821-4986-a0fe-9672cf034b69 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:22.838522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9c9bb-6821-4986-a0fe-9672cf034b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:22.857664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-5cb9c9bb-6821-4986-a0fe-9672cf034b69 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:22.858977 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-5cb9c9bb-6821-4986-a0fe-9672cf034b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:22.867604 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1284/2568] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:54:22.871668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c631a-1988-45eb-a42d-ab4917bb751c None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:22.882088 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c631a-1988-45eb-a42d-ab4917bb751c None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:22.886839 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc0a0e-5740-462f-98c7-d38bf7387b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:22.887488 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc0a0e-5740-462f-98c7-d38bf7387b69 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:22.887763 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc0a0e-5740-462f-98c7-d38bf7387b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:22.888032 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc0a0e-5740-462f-98c7-d38bf7387b69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:22.888740 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc0a0e-5740-462f-98c7-d38bf7387b69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:54:22.889067 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc0a0e-5740-462f-98c7-d38bf7387b69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:22.890722 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc0a0e-5740-462f-98c7-d38bf7387b69 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:22.901981 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1285/2569] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:54:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:54:22.906156 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9c9bb-6821-4986-a0fe-9672cf034b69 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:22.915410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9c9bb-6821-4986-a0fe-9672cf034b69 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:22.920065 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b62914-ca83-453a-9760-348f076c9312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:22.920715 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b62914-ca83-453a-9760-348f076c9312 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:22.920995 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b62914-ca83-453a-9760-348f076c9312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:22.921589 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b62914-ca83-453a-9760-348f076c9312 admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:22.921970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b62914-ca83-453a-9760-348f076c9312 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:22.923915 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b62914-ca83-453a-9760-348f076c9312 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:22.953914 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1285/2570] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:54:22 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:54:22.955040 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc0a0e-5740-462f-98c7-d38bf7387b69 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:22.968009 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc0a0e-5740-462f-98c7-d38bf7387b69 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:23.022939 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe031e-b63f-44bc-a263-be3eab3154b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:23.023604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe031e-b63f-44bc-a263-be3eab3154b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:23.023886 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe031e-b63f-44bc-a263-be3eab3154b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:23.024155 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe031e-b63f-44bc-a263-be3eab3154b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:23.024826 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe031e-b63f-44bc-a263-be3eab3154b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:23.026842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe031e-b63f-44bc-a263-be3eab3154b9 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:23.046705 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1286/2571] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:54:22 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:54:23.050591 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b62914-ca83-453a-9760-348f076c9312 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:23.061253 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b62914-ca83-453a-9760-348f076c9312 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:23.065786 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad5396-b140-4008-a97b-5e31b53679fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:23.066429 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad5396-b140-4008-a97b-5e31b53679fa admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:23.066742 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad5396-b140-4008-a97b-5e31b53679fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:23.067013 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad5396-b140-4008-a97b-5e31b53679fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:23.067723 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad5396-b140-4008-a97b-5e31b53679fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:23.069944 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad5396-b140-4008-a97b-5e31b53679fa admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:23.080108 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1286/2572] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:54:23.083958 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe031e-b63f-44bc-a263-be3eab3154b9 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:23.093719 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe031e-b63f-44bc-a263-be3eab3154b9 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:23.098235 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf3833-7fb5-4264-a92c-9164db7f4f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:23.098910 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf3833-7fb5-4264-a92c-9164db7f4f3c admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:23.099189 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf3833-7fb5-4264-a92c-9164db7f4f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:23.099458 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf3833-7fb5-4264-a92c-9164db7f4f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:23.100164 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf3833-7fb5-4264-a92c-9164db7f4f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:23.101758 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf3833-7fb5-4264-a92c-9164db7f4f3c admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:23.111419 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1287/2573] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:54:23.115370 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad5396-b140-4008-a97b-5e31b53679fa admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:23.125821 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad5396-b140-4008-a97b-5e31b53679fa admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:23.130431 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d5bea-9f20-4f4a-b0e8-3a5a6a2ff8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:23.132104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d5bea-9f20-4f4a-b0e8-3a5a6a2ff8e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:23.132449 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d5bea-9f20-4f4a-b0e8-3a5a6a2ff8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:23.132722 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d5bea-9f20-4f4a-b0e8-3a5a6a2ff8e3 admin admin] PATH_INFO: `/v3/projects/1460e0fd7d774d2e8fd248356d9f075d/users/8f6cd149dbbb4919b31b3261474a342d/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:23.147072 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d5bea-9f20-4f4a-b0e8-3a5a6a2ff8e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1460e0fd7d774d2e8fd248356d9f075d, user_id=8f6cd149dbbb4919b31b3261474a342d, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:23.149710 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d5bea-9f20-4f4a-b0e8-3a5a6a2ff8e3 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:23.162566 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1287/2574] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:54:23 2022] PUT /identity/v3/projects/1460e0fd7d774d2e8fd248356d9f075d/users/8f6cd149dbbb4919b31b3261474a342d/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:54:23.173711 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f88893-cbbe-42a0-b6f5-02a771bc3046 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:23.174001 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f88893-cbbe-42a0-b6f5-02a771bc3046 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:23.174303 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f88893-cbbe-42a0-b6f5-02a771bc3046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:23.200900 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-56f88893-cbbe-42a0-b6f5-02a771bc3046 None None] MFA Rules not processed for user `8f6cd149dbbb4919b31b3261474a342d`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:23.202110 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-56f88893-cbbe-42a0-b6f5-02a771bc3046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:23.220435 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:23.267843 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1288/2575] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:54:23.278808 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d5bea-9f20-4f4a-b0e8-3a5a6a2ff8e3 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:23.280549 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-d41d5bea-9f20-4f4a-b0e8-3a5a6a2ff8e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:23.336656 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d5bea-9f20-4f4a-b0e8-3a5a6a2ff8e3 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:23.340207 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e70c0-8e3f-4d9c-9c1d-eb2ea7c39663 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:23.340846 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e70c0-8e3f-4d9c-9c1d-eb2ea7c39663 service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:23.341132 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e70c0-8e3f-4d9c-9c1d-eb2ea7c39663 service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:23.341410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e70c0-8e3f-4d9c-9c1d-eb2ea7c39663 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:23.349730 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e70c0-8e3f-4d9c-9c1d-eb2ea7c39663 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:23.351738 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e70c0-8e3f-4d9c-9c1d-eb2ea7c39663 service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:23.360517 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1288/2576] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:54:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:54:23.379702 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f88893-cbbe-42a0-b6f5-02a771bc3046 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:23.440889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f88893-cbbe-42a0-b6f5-02a771bc3046 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:23.445368 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2cc324-0984-49f7-ad0b-28f848ce8b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:23.446229 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cc324-0984-49f7-ad0b-28f848ce8b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:23.446502 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cc324-0984-49f7-ad0b-28f848ce8b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:23.446799 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cc324-0984-49f7-ad0b-28f848ce8b65 admin admin] PATH_INFO: `/v3/users/8f6cd149dbbb4919b31b3261474a342d` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:23.447973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2cc324-0984-49f7-ad0b-28f848ce8b65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f6cd149dbbb4919b31b3261474a342d)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:23.449893 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2cc324-0984-49f7-ad0b-28f848ce8b65 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:23.502758 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-cf2cc324-0984-49f7-ad0b-28f848ce8b65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f6cd149dbbb4919b31b3261474a342d'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:23.503422 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-cf2cc324-0984-49f7-ad0b-28f848ce8b65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f6cd149dbbb4919b31b3261474a342d'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:23.515655 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-cf2cc324-0984-49f7-ad0b-28f848ce8b65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f6cd149dbbb4919b31b3261474a342d'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:23.522998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-cf2cc324-0984-49f7-ad0b-28f848ce8b65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f6cd149dbbb4919b31b3261474a342d'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:23.523626 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-cf2cc324-0984-49f7-ad0b-28f848ce8b65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f6cd149dbbb4919b31b3261474a342d'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:23.536337 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1289/2577] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:54:23 2022] DELETE /identity/v3/users/8f6cd149dbbb4919b31b3261474a342d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:54:23.541282 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e96f73-598a-4e6b-b4fc-116b062d1bde None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:23.541575 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e96f73-598a-4e6b-b4fc-116b062d1bde None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:23.541848 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e96f73-598a-4e6b-b4fc-116b062d1bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:23.559501 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-f7e96f73-598a-4e6b-b4fc-116b062d1bde None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:23.560692 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-f7e96f73-598a-4e6b-b4fc-116b062d1bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:23.585571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:23.620638 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1289/2578] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:54:23.630081 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2cc324-0984-49f7-ad0b-28f848ce8b65 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:23.631775 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-cf2cc324-0984-49f7-ad0b-28f848ce8b65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:23.678760 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:23.703300 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2cc324-0984-49f7-ad0b-28f848ce8b65 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:23.707071 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540a049-bb6b-4380-a889-cea63351bf4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:23.707719 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540a049-bb6b-4380-a889-cea63351bf4d service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:23.707995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540a049-bb6b-4380-a889-cea63351bf4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:23.708265 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540a049-bb6b-4380-a889-cea63351bf4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:23.717874 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540a049-bb6b-4380-a889-cea63351bf4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:23.719397 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540a049-bb6b-4380-a889-cea63351bf4d service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:23.730513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1290/2579] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:54:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:54:24.075421 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e96f73-598a-4e6b-b4fc-116b062d1bde None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:24.077000 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-f7e96f73-598a-4e6b-b4fc-116b062d1bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:24.090257 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e96f73-598a-4e6b-b4fc-116b062d1bde None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:24.095143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348678c-4fe6-4b64-a656-e8054672a368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:24.096110 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348678c-4fe6-4b64-a656-e8054672a368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:24.096461 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348678c-4fe6-4b64-a656-e8054672a368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:24.096807 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348678c-4fe6-4b64-a656-e8054672a368 admin admin] PATH_INFO: `/v3/projects/1460e0fd7d774d2e8fd248356d9f075d` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:24.098059 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348678c-4fe6-4b64-a656-e8054672a368 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1460e0fd7d774d2e8fd248356d9f075d)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:24.100084 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348678c-4fe6-4b64-a656-e8054672a368 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:24.148865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-5348678c-4fe6-4b64-a656-e8054672a368 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1460e0fd7d774d2e8fd248356d9f075d', 'request_id': 'req-5348678c-4fe6-4b64-a656-e8054672a368'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:24.156246 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-5348678c-4fe6-4b64-a656-e8054672a368 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1460e0fd7d774d2e8fd248356d9f075d', 'request_id': 'req-5348678c-4fe6-4b64-a656-e8054672a368'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:24.162405 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-5348678c-4fe6-4b64-a656-e8054672a368 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1460e0fd7d774d2e8fd248356d9f075d', 'request_id': 'req-5348678c-4fe6-4b64-a656-e8054672a368'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:24.173246 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-5348678c-4fe6-4b64-a656-e8054672a368 admin admin] The token cache is being invalidate because project 1460e0fd7d774d2e8fd248356d9f075d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:54:24.173530 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-5348678c-4fe6-4b64-a656-e8054672a368 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:24.174177 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-5348678c-4fe6-4b64-a656-e8054672a368 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:24.175797 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1290/2580] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:54:24 2022] DELETE /identity/v3/projects/1460e0fd7d774d2e8fd248356d9f075d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:24.181482 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68f416-35ae-4971-9331-61b91b8d8a94 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:24.181956 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68f416-35ae-4971-9331-61b91b8d8a94 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:24.182155 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68f416-35ae-4971-9331-61b91b8d8a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:24.200449 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-8c68f416-35ae-4971-9331-61b91b8d8a94 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:24.201633 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-8c68f416-35ae-4971-9331-61b91b8d8a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:24.259141 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1291/2581] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:54:24.266816 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020e2fe-6089-409a-9d49-1c795ef55d49 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:24.267130 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020e2fe-6089-409a-9d49-1c795ef55d49 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:24.267411 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020e2fe-6089-409a-9d49-1c795ef55d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:24.286159 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-c020e2fe-6089-409a-9d49-1c795ef55d49 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:24.287388 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-c020e2fe-6089-409a-9d49-1c795ef55d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:24.295319 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1291/2582] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:54:24.299425 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68f416-35ae-4971-9331-61b91b8d8a94 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:24.308884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68f416-35ae-4971-9331-61b91b8d8a94 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:24.313473 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf225dcd-9665-42ca-ae7b-43ed3631b8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:24.314116 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf225dcd-9665-42ca-ae7b-43ed3631b8aa admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:24.314394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf225dcd-9665-42ca-ae7b-43ed3631b8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:24.314696 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf225dcd-9665-42ca-ae7b-43ed3631b8aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:24.315409 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf225dcd-9665-42ca-ae7b-43ed3631b8aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:54:24.315714 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf225dcd-9665-42ca-ae7b-43ed3631b8aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:24.317309 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf225dcd-9665-42ca-ae7b-43ed3631b8aa admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:24.329023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1292/2583] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:54:24.333103 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020e2fe-6089-409a-9d49-1c795ef55d49 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:24.343045 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020e2fe-6089-409a-9d49-1c795ef55d49 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:24.347630 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380037b-1ca7-4fde-aeec-a3952f6dfb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:24.348267 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380037b-1ca7-4fde-aeec-a3952f6dfb62 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:24.348547 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380037b-1ca7-4fde-aeec-a3952f6dfb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:24.348816 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380037b-1ca7-4fde-aeec-a3952f6dfb62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:24.349494 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380037b-1ca7-4fde-aeec-a3952f6dfb62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:24.351420 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380037b-1ca7-4fde-aeec-a3952f6dfb62 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:24.376759 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1292/2584] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:54:24 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:54:24.380904 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf225dcd-9665-42ca-ae7b-43ed3631b8aa admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:24.391575 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf225dcd-9665-42ca-ae7b-43ed3631b8aa admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:24.447382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a48484-814c-4508-844a-88b4c24e566a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:24.448517 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a48484-814c-4508-844a-88b4c24e566a admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:24.449034 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a48484-814c-4508-844a-88b4c24e566a admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:24.449434 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a48484-814c-4508-844a-88b4c24e566a admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:24.450129 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a48484-814c-4508-844a-88b4c24e566a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:24.452326 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a48484-814c-4508-844a-88b4c24e566a admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:24.473211 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1293/2585] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:54:24 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:54:24.477281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380037b-1ca7-4fde-aeec-a3952f6dfb62 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:24.487536 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380037b-1ca7-4fde-aeec-a3952f6dfb62 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:24.492696 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df1d14-7c4c-40e7-8814-88a3acfad7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:24.493351 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df1d14-7c4c-40e7-8814-88a3acfad7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:24.493633 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df1d14-7c4c-40e7-8814-88a3acfad7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:24.493910 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df1d14-7c4c-40e7-8814-88a3acfad7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:24.494667 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df1d14-7c4c-40e7-8814-88a3acfad7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:24.496260 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df1d14-7c4c-40e7-8814-88a3acfad7d0 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:24.507211 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1293/2586] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:54:24.511346 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a48484-814c-4508-844a-88b4c24e566a admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:24.521172 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a48484-814c-4508-844a-88b4c24e566a admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:24.525729 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92c4b3-70f3-4242-b538-d12da0278c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:24.526383 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92c4b3-70f3-4242-b538-d12da0278c7e admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:24.526700 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92c4b3-70f3-4242-b538-d12da0278c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:24.526983 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92c4b3-70f3-4242-b538-d12da0278c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:24.527701 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92c4b3-70f3-4242-b538-d12da0278c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:24.529337 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92c4b3-70f3-4242-b538-d12da0278c7e admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:24.539120 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1294/2587] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:54:24.543280 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df1d14-7c4c-40e7-8814-88a3acfad7d0 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:24.553185 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df1d14-7c4c-40e7-8814-88a3acfad7d0 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:24.558376 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd056a23-614d-4dfa-9077-a5987e610a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:24.559292 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd056a23-614d-4dfa-9077-a5987e610a3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:24.559579 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd056a23-614d-4dfa-9077-a5987e610a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:24.559858 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd056a23-614d-4dfa-9077-a5987e610a3f admin admin] PATH_INFO: `/v3/projects/3b91eaadd55245daa80bfb49e2192d35/users/534b2526c4dc4c4f8ec03d7c305203a7/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:24.575297 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd056a23-614d-4dfa-9077-a5987e610a3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b91eaadd55245daa80bfb49e2192d35, user_id=534b2526c4dc4c4f8ec03d7c305203a7, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:24.577987 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd056a23-614d-4dfa-9077-a5987e610a3f admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:24.590202 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1294/2588] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:54:24 2022] PUT /identity/v3/projects/3b91eaadd55245daa80bfb49e2192d35/users/534b2526c4dc4c4f8ec03d7c305203a7/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:24.600485 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72522f54-691d-49c7-9af2-1edd75e38247 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:24.600779 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72522f54-691d-49c7-9af2-1edd75e38247 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:24.601062 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72522f54-691d-49c7-9af2-1edd75e38247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:24.627952 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-72522f54-691d-49c7-9af2-1edd75e38247 None None] MFA Rules not processed for user `534b2526c4dc4c4f8ec03d7c305203a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:24.629165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-72522f54-691d-49c7-9af2-1edd75e38247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:24.668894 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:24.696313 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1295/2589] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:54:24.700615 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd056a23-614d-4dfa-9077-a5987e610a3f admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:24.762291 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:24.774944 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd056a23-614d-4dfa-9077-a5987e610a3f admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:24.779982 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae040c4-52ff-4aef-9a1e-60cc7b99e208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:24.780672 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae040c4-52ff-4aef-9a1e-60cc7b99e208 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:24.780953 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae040c4-52ff-4aef-9a1e-60cc7b99e208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:24.781372 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae040c4-52ff-4aef-9a1e-60cc7b99e208 admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:24.781919 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae040c4-52ff-4aef-9a1e-60cc7b99e208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:24.783874 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae040c4-52ff-4aef-9a1e-60cc7b99e208 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:24.809196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1295/2590] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:54:24 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:54:24.813261 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72522f54-691d-49c7-9af2-1edd75e38247 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:24.824016 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72522f54-691d-49c7-9af2-1edd75e38247 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:24.880384 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f914a9-6dcb-472c-a198-aa644789d891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:24.881052 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f914a9-6dcb-472c-a198-aa644789d891 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:24.881356 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f914a9-6dcb-472c-a198-aa644789d891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:24.881637 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f914a9-6dcb-472c-a198-aa644789d891 admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:24.882313 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f914a9-6dcb-472c-a198-aa644789d891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:24.884537 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f914a9-6dcb-472c-a198-aa644789d891 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:24.904762 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1296/2591] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:54:24 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:54:24.908926 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae040c4-52ff-4aef-9a1e-60cc7b99e208 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:24.919878 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae040c4-52ff-4aef-9a1e-60cc7b99e208 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:24.925086 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8ceda-58c7-4de4-8214-93abaf5ff8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:24.925771 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8ceda-58c7-4de4-8214-93abaf5ff8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:24.926070 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8ceda-58c7-4de4-8214-93abaf5ff8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:24.926347 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8ceda-58c7-4de4-8214-93abaf5ff8b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:24.927147 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8ceda-58c7-4de4-8214-93abaf5ff8b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:24.929443 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8ceda-58c7-4de4-8214-93abaf5ff8b1 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:24.940013 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1296/2592] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:54:24.943966 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f914a9-6dcb-472c-a198-aa644789d891 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:24.953879 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f914a9-6dcb-472c-a198-aa644789d891 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:24.958464 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9638cc-a719-4b47-a368-2cef4a7de4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:24.959153 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9638cc-a719-4b47-a368-2cef4a7de4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:24.959440 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9638cc-a719-4b47-a368-2cef4a7de4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:24.959749 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9638cc-a719-4b47-a368-2cef4a7de4a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:24.960432 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9638cc-a719-4b47-a368-2cef4a7de4a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:24.962039 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9638cc-a719-4b47-a368-2cef4a7de4a5 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:24.971873 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1297/2593] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:54:24.976350 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8ceda-58c7-4de4-8214-93abaf5ff8b1 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:24.986753 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8ceda-58c7-4de4-8214-93abaf5ff8b1 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:24.992378 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ecdc0-1127-4fe1-84ee-4288fee1f9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:24.993252 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ecdc0-1127-4fe1-84ee-4288fee1f9c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:24.993531 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ecdc0-1127-4fe1-84ee-4288fee1f9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:24.993802 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ecdc0-1127-4fe1-84ee-4288fee1f9c6 admin admin] PATH_INFO: `/v3/projects/d2fac38f2d6c411e8ffe4f1e6ba218c2/users/b86c4cef5b9e479589fdf8c0b348b579/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:25.008569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ecdc0-1127-4fe1-84ee-4288fee1f9c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2fac38f2d6c411e8ffe4f1e6ba218c2, user_id=b86c4cef5b9e479589fdf8c0b348b579, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:25.011264 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ecdc0-1127-4fe1-84ee-4288fee1f9c6 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:25.025311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1297/2594] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:54:24 2022] PUT /identity/v3/projects/d2fac38f2d6c411e8ffe4f1e6ba218c2/users/b86c4cef5b9e479589fdf8c0b348b579/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:25.036149 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918673d7-74ac-49b4-a4e7-518bcee9f7d0 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:25.036655 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918673d7-74ac-49b4-a4e7-518bcee9f7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:25.036940 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918673d7-74ac-49b4-a4e7-518bcee9f7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:25.068088 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-918673d7-74ac-49b4-a4e7-518bcee9f7d0 None None] MFA Rules not processed for user `b86c4cef5b9e479589fdf8c0b348b579`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:25.069515 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-918673d7-74ac-49b4-a4e7-518bcee9f7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:25.154367 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1298/2595] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:54:25.158985 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ecdc0-1127-4fe1-84ee-4288fee1f9c6 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:25.236534 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ecdc0-1127-4fe1-84ee-4288fee1f9c6 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:25.241769 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1e926-9619-41ae-a5a8-d69ac9e09100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:25.242472 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1e926-9619-41ae-a5a8-d69ac9e09100 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:25.242856 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1e926-9619-41ae-a5a8-d69ac9e09100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:25.243226 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1e926-9619-41ae-a5a8-d69ac9e09100 admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:25.243951 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1e926-9619-41ae-a5a8-d69ac9e09100 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:25.245977 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1e926-9619-41ae-a5a8-d69ac9e09100 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:25.275477 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1298/2596] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:54:25 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:54:25.276982 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918673d7-74ac-49b4-a4e7-518bcee9f7d0 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:25.288518 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918673d7-74ac-49b4-a4e7-518bcee9f7d0 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:25.334227 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:25.351865 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1a623-fa03-491e-a454-3c2d4bdc4cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:25.352565 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1a623-fa03-491e-a454-3c2d4bdc4cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:25.352865 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1a623-fa03-491e-a454-3c2d4bdc4cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:25.353164 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1a623-fa03-491e-a454-3c2d4bdc4cb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:25.353867 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1a623-fa03-491e-a454-3c2d4bdc4cb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:25.355996 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1a623-fa03-491e-a454-3c2d4bdc4cb8 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:25.375138 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1299/2597] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:54:25 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:54:25.379341 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1e926-9619-41ae-a5a8-d69ac9e09100 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:25.389959 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1e926-9619-41ae-a5a8-d69ac9e09100 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:25.394914 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb94cae-182e-49c5-ac18-5cd3fb4c2d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:25.395583 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb94cae-182e-49c5-ac18-5cd3fb4c2d5b admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:25.395869 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb94cae-182e-49c5-ac18-5cd3fb4c2d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:25.396152 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb94cae-182e-49c5-ac18-5cd3fb4c2d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:25.396898 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb94cae-182e-49c5-ac18-5cd3fb4c2d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:25.399091 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb94cae-182e-49c5-ac18-5cd3fb4c2d5b admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:25.411037 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1299/2598] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:54:25.416018 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1a623-fa03-491e-a454-3c2d4bdc4cb8 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:25.426687 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1a623-fa03-491e-a454-3c2d4bdc4cb8 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:25.431379 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9aad4c-a03e-4e75-ba7d-934e3a2ee99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:25.432259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9aad4c-a03e-4e75-ba7d-934e3a2ee99c admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:25.432541 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9aad4c-a03e-4e75-ba7d-934e3a2ee99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:25.432835 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9aad4c-a03e-4e75-ba7d-934e3a2ee99c admin admin] PATH_INFO: `/v3/projects/bb750b3691c342c5beb949d416276868/users/a6ab2c8309e34ce099464bfdfba7fe72/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:25.447616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9aad4c-a03e-4e75-ba7d-934e3a2ee99c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb750b3691c342c5beb949d416276868, user_id=a6ab2c8309e34ce099464bfdfba7fe72, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:25.450282 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9aad4c-a03e-4e75-ba7d-934e3a2ee99c admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:25.463234 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1300/2599] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:54:25 2022] PUT /identity/v3/projects/bb750b3691c342c5beb949d416276868/users/a6ab2c8309e34ce099464bfdfba7fe72/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:25.467263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb94cae-182e-49c5-ac18-5cd3fb4c2d5b admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:25.477636 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb94cae-182e-49c5-ac18-5cd3fb4c2d5b admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:25.533779 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b5904-d302-492d-b490-61a1b09e4928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:25.534474 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b5904-d302-492d-b490-61a1b09e4928 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:25.534803 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b5904-d302-492d-b490-61a1b09e4928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:25.535081 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b5904-d302-492d-b490-61a1b09e4928 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:25.535834 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b5904-d302-492d-b490-61a1b09e4928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:25.537447 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b5904-d302-492d-b490-61a1b09e4928 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:25.547484 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1300/2600] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:54:25.551802 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9aad4c-a03e-4e75-ba7d-934e3a2ee99c admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:25.562122 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9aad4c-a03e-4e75-ba7d-934e3a2ee99c admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:25.566598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12991c4e-0d12-419c-8fd9-d36432e60244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:25.567501 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12991c4e-0d12-419c-8fd9-d36432e60244 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:25.567780 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12991c4e-0d12-419c-8fd9-d36432e60244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:25.568051 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12991c4e-0d12-419c-8fd9-d36432e60244 admin admin] PATH_INFO: `/v3/projects/bb750b3691c342c5beb949d416276868/users/a6ab2c8309e34ce099464bfdfba7fe72/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:25.570501 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12991c4e-0d12-419c-8fd9-d36432e60244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb750b3691c342c5beb949d416276868, user_id=a6ab2c8309e34ce099464bfdfba7fe72, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:25.573202 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12991c4e-0d12-419c-8fd9-d36432e60244 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:25.583277 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1301/2601] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:54:25 2022] PUT /identity/v3/projects/bb750b3691c342c5beb949d416276868/users/a6ab2c8309e34ce099464bfdfba7fe72/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:25.593723 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9aef0-ee96-4d92-958a-60d0539af541 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:25.594180 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9aef0-ee96-4d92-958a-60d0539af541 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:25.594262 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9aef0-ee96-4d92-958a-60d0539af541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:25.612736 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:25.621352 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-86d9aef0-ee96-4d92-958a-60d0539af541 None None] MFA Rules not processed for user `a6ab2c8309e34ce099464bfdfba7fe72`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:25.622797 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-86d9aef0-ee96-4d92-958a-60d0539af541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:25.690882 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1301/2602] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:54:25.702451 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12991c4e-0d12-419c-8fd9-d36432e60244 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:25.704170 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-12991c4e-0d12-419c-8fd9-d36432e60244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:25.773190 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12991c4e-0d12-419c-8fd9-d36432e60244 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:25.778183 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a3e0b-fdc3-4317-b628-a0b860728454 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:25.778183 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a3e0b-fdc3-4317-b628-a0b860728454 service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:25.778183 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a3e0b-fdc3-4317-b628-a0b860728454 service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:25.778183 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a3e0b-fdc3-4317-b628-a0b860728454 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:25.846008 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a3e0b-fdc3-4317-b628-a0b860728454 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:25.847542 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a3e0b-fdc3-4317-b628-a0b860728454 service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:25.858707 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1302/2603] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:54:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:54:26.232591 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d9aef0-ee96-4d92-958a-60d0539af541 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:26.233965 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-86d9aef0-ee96-4d92-958a-60d0539af541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:26.302362 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d9aef0-ee96-4d92-958a-60d0539af541 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:26.308178 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2425f-734f-4466-922c-e6a1a2c8cbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:26.309055 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2425f-734f-4466-922c-e6a1a2c8cbb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:26.309333 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2425f-734f-4466-922c-e6a1a2c8cbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:26.309603 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2425f-734f-4466-922c-e6a1a2c8cbb9 admin admin] PATH_INFO: `/v3/users/f0b40276ea0e4f158a9b4931eebe508e` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:26.310837 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2425f-734f-4466-922c-e6a1a2c8cbb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0b40276ea0e4f158a9b4931eebe508e)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:26.312831 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2425f-734f-4466-922c-e6a1a2c8cbb9 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:26.361246 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-79d2425f-734f-4466-922c-e6a1a2c8cbb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0b40276ea0e4f158a9b4931eebe508e'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:26.361907 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-79d2425f-734f-4466-922c-e6a1a2c8cbb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0b40276ea0e4f158a9b4931eebe508e'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:26.374599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-79d2425f-734f-4466-922c-e6a1a2c8cbb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0b40276ea0e4f158a9b4931eebe508e'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:26.375443 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-79d2425f-734f-4466-922c-e6a1a2c8cbb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0b40276ea0e4f158a9b4931eebe508e'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:26.384570 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-79d2425f-734f-4466-922c-e6a1a2c8cbb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0b40276ea0e4f158a9b4931eebe508e'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:26.397596 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1302/2604] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:54:26 2022] DELETE /identity/v3/users/f0b40276ea0e4f158a9b4931eebe508e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:26.401930 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a09e92-d8b2-4884-83fd-47d1de50208e None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:26.402447 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a09e92-d8b2-4884-83fd-47d1de50208e None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:26.402563 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a09e92-d8b2-4884-83fd-47d1de50208e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:26.420591 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-e8a09e92-d8b2-4884-83fd-47d1de50208e None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:26.421788 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-e8a09e92-d8b2-4884-83fd-47d1de50208e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:26.468341 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:26.482130 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1303/2605] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:54:26.495732 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2425f-734f-4466-922c-e6a1a2c8cbb9 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:26.497310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-79d2425f-734f-4466-922c-e6a1a2c8cbb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:26.518412 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:26.559304 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2425f-734f-4466-922c-e6a1a2c8cbb9 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:26.562979 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71d62e-bc67-484b-b3f2-308fd47979e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:26.563625 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71d62e-bc67-484b-b3f2-308fd47979e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:26.563906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71d62e-bc67-484b-b3f2-308fd47979e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:26.564185 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71d62e-bc67-484b-b3f2-308fd47979e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:26.573105 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71d62e-bc67-484b-b3f2-308fd47979e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:26.574532 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71d62e-bc67-484b-b3f2-308fd47979e6 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:26.583921 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1303/2606] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:54:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:54:26.857660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a09e92-d8b2-4884-83fd-47d1de50208e None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:26.860257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-e8a09e92-d8b2-4884-83fd-47d1de50208e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:26.885411 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a09e92-d8b2-4884-83fd-47d1de50208e None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:26.890191 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d0e6b-96b7-483d-898d-d313db583a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:26.891090 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d0e6b-96b7-483d-898d-d313db583a29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:26.891375 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d0e6b-96b7-483d-898d-d313db583a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:26.891650 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d0e6b-96b7-483d-898d-d313db583a29 admin admin] PATH_INFO: `/v3/projects/65a5b074ef7b467bb1e78b35c1384189` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:26.892838 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d0e6b-96b7-483d-898d-d313db583a29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65a5b074ef7b467bb1e78b35c1384189)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:26.894829 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d0e6b-96b7-483d-898d-d313db583a29 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:26.940862 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-ce3d0e6b-96b7-483d-898d-d313db583a29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65a5b074ef7b467bb1e78b35c1384189', 'request_id': 'req-ce3d0e6b-96b7-483d-898d-d313db583a29'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:26.946921 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-ce3d0e6b-96b7-483d-898d-d313db583a29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65a5b074ef7b467bb1e78b35c1384189', 'request_id': 'req-ce3d0e6b-96b7-483d-898d-d313db583a29'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:26.952397 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-ce3d0e6b-96b7-483d-898d-d313db583a29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65a5b074ef7b467bb1e78b35c1384189', 'request_id': 'req-ce3d0e6b-96b7-483d-898d-d313db583a29'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:26.964540 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-ce3d0e6b-96b7-483d-898d-d313db583a29 admin admin] The token cache is being invalidate because project 65a5b074ef7b467bb1e78b35c1384189 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:54:26.964826 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-ce3d0e6b-96b7-483d-898d-d313db583a29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:26.965453 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-ce3d0e6b-96b7-483d-898d-d313db583a29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:26.967089 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1304/2607] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:54:26 2022] DELETE /identity/v3/projects/65a5b074ef7b467bb1e78b35c1384189 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:26.972027 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad8849-3c0d-464e-ba88-41555606dbd7 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:26.972522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad8849-3c0d-464e-ba88-41555606dbd7 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:26.972607 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad8849-3c0d-464e-ba88-41555606dbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:26.991527 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-7cad8849-3c0d-464e-ba88-41555606dbd7 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:26.992873 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-7cad8849-3c0d-464e-ba88-41555606dbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:27.056361 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1304/2608] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:54:27.064185 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3deaf-6a65-4d82-83c3-ee965bd45150 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:27.064481 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3deaf-6a65-4d82-83c3-ee965bd45150 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:27.064767 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3deaf-6a65-4d82-83c3-ee965bd45150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:27.083615 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-eaf3deaf-6a65-4d82-83c3-ee965bd45150 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:27.085553 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-eaf3deaf-6a65-4d82-83c3-ee965bd45150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:27.093478 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1305/2609] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:54:27.097473 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad8849-3c0d-464e-ba88-41555606dbd7 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:27.106883 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad8849-3c0d-464e-ba88-41555606dbd7 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:27.111452 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5f723-03ee-4d2c-bf97-4605d02e7ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:27.112124 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5f723-03ee-4d2c-bf97-4605d02e7ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:27.112401 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5f723-03ee-4d2c-bf97-4605d02e7ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:27.112671 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5f723-03ee-4d2c-bf97-4605d02e7ff9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:27.113381 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5f723-03ee-4d2c-bf97-4605d02e7ff9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:54:27.113686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5f723-03ee-4d2c-bf97-4605d02e7ff9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:27.115369 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5f723-03ee-4d2c-bf97-4605d02e7ff9 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:27.127286 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1305/2610] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:54:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:54:27.131969 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3deaf-6a65-4d82-83c3-ee965bd45150 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:27.141483 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3deaf-6a65-4d82-83c3-ee965bd45150 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:27.146168 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d651c-9151-4eca-a261-799edd99ba6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:27.146854 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d651c-9151-4eca-a261-799edd99ba6d admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:27.147768 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d651c-9151-4eca-a261-799edd99ba6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:27.148046 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d651c-9151-4eca-a261-799edd99ba6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:27.148738 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d651c-9151-4eca-a261-799edd99ba6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:27.150676 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d651c-9151-4eca-a261-799edd99ba6d admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:27.175666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1306/2611] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:54:27 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:54:27.179939 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5f723-03ee-4d2c-bf97-4605d02e7ff9 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:27.190117 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5f723-03ee-4d2c-bf97-4605d02e7ff9 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:27.248000 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c07df-05fa-432e-a692-a9cd82bb69e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:27.248615 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c07df-05fa-432e-a692-a9cd82bb69e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:27.248897 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c07df-05fa-432e-a692-a9cd82bb69e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:27.249176 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c07df-05fa-432e-a692-a9cd82bb69e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:27.249854 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c07df-05fa-432e-a692-a9cd82bb69e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:27.251838 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c07df-05fa-432e-a692-a9cd82bb69e1 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:27.272758 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1306/2612] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:54:27 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:54:27.276942 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d651c-9151-4eca-a261-799edd99ba6d admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:27.287012 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d651c-9151-4eca-a261-799edd99ba6d admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:27.291596 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ef4af-25ab-4f86-945b-697c17b40642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:27.292245 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ef4af-25ab-4f86-945b-697c17b40642 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:27.292527 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ef4af-25ab-4f86-945b-697c17b40642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:27.292806 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ef4af-25ab-4f86-945b-697c17b40642 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:27.293520 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ef4af-25ab-4f86-945b-697c17b40642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:27.295185 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ef4af-25ab-4f86-945b-697c17b40642 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:27.306351 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1307/2613] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:54:27.310217 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c07df-05fa-432e-a692-a9cd82bb69e1 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:27.320938 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c07df-05fa-432e-a692-a9cd82bb69e1 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:27.325521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d7532-e4b1-4379-ab1c-add81fb92731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:27.326171 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d7532-e4b1-4379-ab1c-add81fb92731 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:27.326450 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d7532-e4b1-4379-ab1c-add81fb92731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:27.326762 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d7532-e4b1-4379-ab1c-add81fb92731 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:27.327480 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d7532-e4b1-4379-ab1c-add81fb92731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:27.329066 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d7532-e4b1-4379-ab1c-add81fb92731 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:27.339392 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1307/2614] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:54:27.343422 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ef4af-25ab-4f86-945b-697c17b40642 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:27.353233 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ef4af-25ab-4f86-945b-697c17b40642 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:27.357762 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a822926-d956-4b10-89d7-fa4909eb6c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:27.358741 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a822926-d956-4b10-89d7-fa4909eb6c84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:27.359152 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a822926-d956-4b10-89d7-fa4909eb6c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:27.359293 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a822926-d956-4b10-89d7-fa4909eb6c84 admin admin] PATH_INFO: `/v3/projects/f1596ce0cbaf437699c4d4eba180ff7b/users/2ab423c5002c4b01aeae93f31aa6feec/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:27.373798 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a822926-d956-4b10-89d7-fa4909eb6c84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1596ce0cbaf437699c4d4eba180ff7b, user_id=2ab423c5002c4b01aeae93f31aa6feec, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:27.376564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a822926-d956-4b10-89d7-fa4909eb6c84 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:27.389942 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1308/2615] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:54:27 2022] PUT /identity/v3/projects/f1596ce0cbaf437699c4d4eba180ff7b/users/2ab423c5002c4b01aeae93f31aa6feec/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:54:27.395070 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d7b44-949f-4123-8adc-90ee0e81e6bf None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:27.395343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d7b44-949f-4123-8adc-90ee0e81e6bf None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:27.395615 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d7b44-949f-4123-8adc-90ee0e81e6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:27.412741 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-5b3d7b44-949f-4123-8adc-90ee0e81e6bf None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:27.413922 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-5b3d7b44-949f-4123-8adc-90ee0e81e6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:27.432694 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:27.474719 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1308/2616] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:54:27.484215 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a822926-d956-4b10-89d7-fa4909eb6c84 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:27.485953 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-8a822926-d956-4b10-89d7-fa4909eb6c84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:27.544043 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a822926-d956-4b10-89d7-fa4909eb6c84 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:27.548114 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4eec33-7cd0-4280-9448-265749381fe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:27.548389 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4eec33-7cd0-4280-9448-265749381fe3 service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:27.548673 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4eec33-7cd0-4280-9448-265749381fe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:27.549094 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4eec33-7cd0-4280-9448-265749381fe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:27.559058 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4eec33-7cd0-4280-9448-265749381fe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:27.560514 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4eec33-7cd0-4280-9448-265749381fe3 service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:27.570556 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1309/2617] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:54:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:54:29.515975 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d7b44-949f-4123-8adc-90ee0e81e6bf None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:29.518192 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-5b3d7b44-949f-4123-8adc-90ee0e81e6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:29.591631 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d7b44-949f-4123-8adc-90ee0e81e6bf None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:29.595461 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e53929-58b3-47f1-bc4e-fb29d084346d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:29.596125 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e53929-58b3-47f1-bc4e-fb29d084346d service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:29.596408 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e53929-58b3-47f1-bc4e-fb29d084346d service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:29.596685 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e53929-58b3-47f1-bc4e-fb29d084346d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:29.598686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-73e53929-58b3-47f1-bc4e-fb29d084346d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:29.680295 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e53929-58b3-47f1-bc4e-fb29d084346d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:29.681852 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e53929-58b3-47f1-bc4e-fb29d084346d service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:29.692488 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1309/2618] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:54:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:54:30.456201 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4eec33-7cd0-4280-9448-265749381fe3 service neutron] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:30.467182 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4eec33-7cd0-4280-9448-265749381fe3 service neutron] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:30.471390 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758f233-d1a9-4ca0-90d9-825a319d4474 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:30.472265 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758f233-d1a9-4ca0-90d9-825a319d4474 service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:30.472555 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758f233-d1a9-4ca0-90d9-825a319d4474 service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:30.472834 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758f233-d1a9-4ca0-90d9-825a319d4474 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:30.474696 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-2758f233-d1a9-4ca0-90d9-825a319d4474 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:30.489582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:30.560659 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758f233-d1a9-4ca0-90d9-825a319d4474 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:30.562419 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758f233-d1a9-4ca0-90d9-825a319d4474 service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:30.574087 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1310/2619] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:54:30 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:54:32.446495 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76254e-8cc5-4f3c-9080-19b5b6b6cf4d None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:32.447134 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76254e-8cc5-4f3c-9080-19b5b6b6cf4d None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:32.447134 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76254e-8cc5-4f3c-9080-19b5b6b6cf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:32.480244 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-2c76254e-8cc5-4f3c-9080-19b5b6b6cf4d None None] MFA Rules not processed for user `2ab423c5002c4b01aeae93f31aa6feec`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:32.481488 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-2c76254e-8cc5-4f3c-9080-19b5b6b6cf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:32.581155 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1310/2620] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:54:32.587019 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758f233-d1a9-4ca0-90d9-825a319d4474 service cinder] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:32.599717 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758f233-d1a9-4ca0-90d9-825a319d4474 service cinder] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:32.612274 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7e16d-970d-47a1-9574-953592bce47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:32.613725 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7e16d-970d-47a1-9574-953592bce47d admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:32.614327 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7e16d-970d-47a1-9574-953592bce47d admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:32.614950 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7e16d-970d-47a1-9574-953592bce47d admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:32.616594 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7e16d-970d-47a1-9574-953592bce47d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:32.619709 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7e16d-970d-47a1-9574-953592bce47d admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:32.652890 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1311/2621] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:54:32 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:54:32.656809 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76254e-8cc5-4f3c-9080-19b5b6b6cf4d None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:32.669013 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76254e-8cc5-4f3c-9080-19b5b6b6cf4d None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:32.675100 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:32.740130 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0dc47-92a4-4414-a1eb-426abffa4fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:32.741414 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0dc47-92a4-4414-a1eb-426abffa4fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:32.741720 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0dc47-92a4-4414-a1eb-426abffa4fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:32.742172 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0dc47-92a4-4414-a1eb-426abffa4fe2 admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:32.742906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0dc47-92a4-4414-a1eb-426abffa4fe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:32.744891 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0dc47-92a4-4414-a1eb-426abffa4fe2 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:32.769093 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1311/2622] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:54:32 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:54:32.772819 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7e16d-970d-47a1-9574-953592bce47d admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:32.785542 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7e16d-970d-47a1-9574-953592bce47d admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:32.791181 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475c266-b1ee-4912-b3bf-ce4dde41965a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:32.792535 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475c266-b1ee-4912-b3bf-ce4dde41965a admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:32.792857 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475c266-b1ee-4912-b3bf-ce4dde41965a admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:32.793139 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475c266-b1ee-4912-b3bf-ce4dde41965a admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:32.794323 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475c266-b1ee-4912-b3bf-ce4dde41965a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:32.796155 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475c266-b1ee-4912-b3bf-ce4dde41965a admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:32.808570 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1312/2623] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:54:32.812560 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0dc47-92a4-4414-a1eb-426abffa4fe2 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:32.823448 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0dc47-92a4-4414-a1eb-426abffa4fe2 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:32.828832 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2559d9-7595-435a-b4d0-2bd59bfa9a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:32.829803 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2559d9-7595-435a-b4d0-2bd59bfa9a17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:32.830167 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2559d9-7595-435a-b4d0-2bd59bfa9a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:32.830438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2559d9-7595-435a-b4d0-2bd59bfa9a17 admin admin] PATH_INFO: `/v3/projects/f647b80b40744560813bc546d49a70fa/users/6c287a593c7d4362ac42e369f25c1221/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:32.849762 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2559d9-7595-435a-b4d0-2bd59bfa9a17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f647b80b40744560813bc546d49a70fa, user_id=6c287a593c7d4362ac42e369f25c1221, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:32.852964 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2559d9-7595-435a-b4d0-2bd59bfa9a17 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:32.873030 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1312/2624] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:54:32 2022] PUT /identity/v3/projects/f647b80b40744560813bc546d49a70fa/users/6c287a593c7d4362ac42e369f25c1221/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:32.879138 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475c266-b1ee-4912-b3bf-ce4dde41965a admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:32.891032 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475c266-b1ee-4912-b3bf-ce4dde41965a admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:32.951376 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536ccf7-20fc-470a-9ebd-38851cb9edeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:32.952058 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536ccf7-20fc-470a-9ebd-38851cb9edeb admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:32.952340 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536ccf7-20fc-470a-9ebd-38851cb9edeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:32.952618 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536ccf7-20fc-470a-9ebd-38851cb9edeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:32.953341 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536ccf7-20fc-470a-9ebd-38851cb9edeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:32.955002 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536ccf7-20fc-470a-9ebd-38851cb9edeb admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:32.965440 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1313/2625] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:54:32.969634 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2559d9-7595-435a-b4d0-2bd59bfa9a17 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:32.980669 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2559d9-7595-435a-b4d0-2bd59bfa9a17 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:32.985302 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8452e-ee6f-4130-9fa1-cb59ed7fafdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:32.986185 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8452e-ee6f-4130-9fa1-cb59ed7fafdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:32.986468 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8452e-ee6f-4130-9fa1-cb59ed7fafdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:32.986789 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8452e-ee6f-4130-9fa1-cb59ed7fafdf admin admin] PATH_INFO: `/v3/projects/f647b80b40744560813bc546d49a70fa/users/6c287a593c7d4362ac42e369f25c1221/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:32.988950 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8452e-ee6f-4130-9fa1-cb59ed7fafdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f647b80b40744560813bc546d49a70fa, user_id=6c287a593c7d4362ac42e369f25c1221, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:32.991720 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8452e-ee6f-4130-9fa1-cb59ed7fafdf admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:33.002973 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1313/2626] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:54:32 2022] PUT /identity/v3/projects/f647b80b40744560813bc546d49a70fa/users/6c287a593c7d4362ac42e369f25c1221/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:54:34.757109 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536ccf7-20fc-470a-9ebd-38851cb9edeb admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:34.759267 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-3536ccf7-20fc-470a-9ebd-38851cb9edeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:34.773041 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536ccf7-20fc-470a-9ebd-38851cb9edeb admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:34.886561 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454223f7-1dfb-417d-9648-9432af258ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:34.887710 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454223f7-1dfb-417d-9648-9432af258ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:34.888294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454223f7-1dfb-417d-9648-9432af258ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:34.888768 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454223f7-1dfb-417d-9648-9432af258ae7 admin admin] PATH_INFO: `/v3/users/534b2526c4dc4c4f8ec03d7c305203a7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:34.892959 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454223f7-1dfb-417d-9648-9432af258ae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=534b2526c4dc4c4f8ec03d7c305203a7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:34.898599 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454223f7-1dfb-417d-9648-9432af258ae7 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:34.922208 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:34.987423 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-454223f7-1dfb-417d-9648-9432af258ae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '534b2526c4dc4c4f8ec03d7c305203a7'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:34.988271 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-454223f7-1dfb-417d-9648-9432af258ae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '534b2526c4dc4c4f8ec03d7c305203a7'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:35.012442 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-454223f7-1dfb-417d-9648-9432af258ae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '534b2526c4dc4c4f8ec03d7c305203a7'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:35.031154 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-454223f7-1dfb-417d-9648-9432af258ae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '534b2526c4dc4c4f8ec03d7c305203a7'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:35.032038 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-454223f7-1dfb-417d-9648-9432af258ae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '534b2526c4dc4c4f8ec03d7c305203a7'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:35.066056 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1314/2627] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:54:34 2022] DELETE /identity/v3/users/534b2526c4dc4c4f8ec03d7c305203a7 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:35.071426 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea20f90-237f-46ff-9d37-a168adea0c7a None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:35.071902 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea20f90-237f-46ff-9d37-a168adea0c7a None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:35.072016 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea20f90-237f-46ff-9d37-a168adea0c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:35.113576 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-4ea20f90-237f-46ff-9d37-a168adea0c7a None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:35.119549 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-4ea20f90-237f-46ff-9d37-a168adea0c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:35.301750 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1314/2628] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:54:35.316401 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454223f7-1dfb-417d-9648-9432af258ae7 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:35.318121 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-454223f7-1dfb-417d-9648-9432af258ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:35.442807 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454223f7-1dfb-417d-9648-9432af258ae7 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:35.451864 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fccd69-9c63-4cca-994a-66d32872f4fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:35.453059 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fccd69-9c63-4cca-994a-66d32872f4fd service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:35.453509 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fccd69-9c63-4cca-994a-66d32872f4fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:35.458999 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fccd69-9c63-4cca-994a-66d32872f4fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:35.478513 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fccd69-9c63-4cca-994a-66d32872f4fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:35.480719 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fccd69-9c63-4cca-994a-66d32872f4fd service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:35.509075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1315/2629] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:54:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:54:36.262904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea20f90-237f-46ff-9d37-a168adea0c7a None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:36.266061 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-4ea20f90-237f-46ff-9d37-a168adea0c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:36.292171 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea20f90-237f-46ff-9d37-a168adea0c7a None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:36.308661 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c79f90-5d37-48ee-902f-594c1df17215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:36.309565 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c79f90-5d37-48ee-902f-594c1df17215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:36.309872 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c79f90-5d37-48ee-902f-594c1df17215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:36.310155 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c79f90-5d37-48ee-902f-594c1df17215 admin admin] PATH_INFO: `/v3/projects/3b91eaadd55245daa80bfb49e2192d35` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:36.311625 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c79f90-5d37-48ee-902f-594c1df17215 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b91eaadd55245daa80bfb49e2192d35)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:36.313755 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c79f90-5d37-48ee-902f-594c1df17215 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:36.380007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-85c79f90-5d37-48ee-902f-594c1df17215 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b91eaadd55245daa80bfb49e2192d35', 'request_id': 'req-85c79f90-5d37-48ee-902f-594c1df17215'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:36.394111 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-85c79f90-5d37-48ee-902f-594c1df17215 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b91eaadd55245daa80bfb49e2192d35', 'request_id': 'req-85c79f90-5d37-48ee-902f-594c1df17215'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:36.395534 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:36.408481 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-85c79f90-5d37-48ee-902f-594c1df17215 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b91eaadd55245daa80bfb49e2192d35', 'request_id': 'req-85c79f90-5d37-48ee-902f-594c1df17215'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:36.446569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-85c79f90-5d37-48ee-902f-594c1df17215 admin admin] The token cache is being invalidate because project 3b91eaadd55245daa80bfb49e2192d35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:54:36.447064 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-85c79f90-5d37-48ee-902f-594c1df17215 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:36.447904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-85c79f90-5d37-48ee-902f-594c1df17215 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:36.453446 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1315/2630] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:54:36 2022] DELETE /identity/v3/projects/3b91eaadd55245daa80bfb49e2192d35 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:36.454219 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fccd69-9c63-4cca-994a-66d32872f4fd service neutron] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:36.465943 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fccd69-9c63-4cca-994a-66d32872f4fd service neutron] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:36.572397 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f0dea-de14-4e36-95e1-cd6d4f0042ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:36.573972 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f0dea-de14-4e36-95e1-cd6d4f0042ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:36.574966 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f0dea-de14-4e36-95e1-cd6d4f0042ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:36.575356 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f0dea-de14-4e36-95e1-cd6d4f0042ab admin admin] PATH_INFO: `/v3/users/b86c4cef5b9e479589fdf8c0b348b579` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:36.582241 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f0dea-de14-4e36-95e1-cd6d4f0042ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=b86c4cef5b9e479589fdf8c0b348b579)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:36.586714 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f0dea-de14-4e36-95e1-cd6d4f0042ab admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:36.675424 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:36.709810 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a21f0dea-de14-4e36-95e1-cd6d4f0042ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b86c4cef5b9e479589fdf8c0b348b579'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:36.710521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a21f0dea-de14-4e36-95e1-cd6d4f0042ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b86c4cef5b9e479589fdf8c0b348b579'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:36.746395 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a21f0dea-de14-4e36-95e1-cd6d4f0042ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b86c4cef5b9e479589fdf8c0b348b579'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:36.759035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a21f0dea-de14-4e36-95e1-cd6d4f0042ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b86c4cef5b9e479589fdf8c0b348b579'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:36.759936 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a21f0dea-de14-4e36-95e1-cd6d4f0042ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b86c4cef5b9e479589fdf8c0b348b579'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:36.784081 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1316/2631] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:54:36 2022] DELETE /identity/v3/users/b86c4cef5b9e479589fdf8c0b348b579 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:37.462357 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c79f90-5d37-48ee-902f-594c1df17215 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:37.465697 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-85c79f90-5d37-48ee-902f-594c1df17215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:37.500998 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c79f90-5d37-48ee-902f-594c1df17215 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:37.590074 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63738c-17a5-448d-8e2e-e78a67ab7cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:37.591168 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63738c-17a5-448d-8e2e-e78a67ab7cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:37.591573 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63738c-17a5-448d-8e2e-e78a67ab7cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:37.591977 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63738c-17a5-448d-8e2e-e78a67ab7cff admin admin] PATH_INFO: `/v3/projects/d2fac38f2d6c411e8ffe4f1e6ba218c2` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:37.594432 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f63738c-17a5-448d-8e2e-e78a67ab7cff admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2fac38f2d6c411e8ffe4f1e6ba218c2)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:37.596611 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f63738c-17a5-448d-8e2e-e78a67ab7cff admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:37.697566 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-7f63738c-17a5-448d-8e2e-e78a67ab7cff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2fac38f2d6c411e8ffe4f1e6ba218c2', 'request_id': 'req-7f63738c-17a5-448d-8e2e-e78a67ab7cff'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:37.710238 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-7f63738c-17a5-448d-8e2e-e78a67ab7cff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2fac38f2d6c411e8ffe4f1e6ba218c2', 'request_id': 'req-7f63738c-17a5-448d-8e2e-e78a67ab7cff'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:37.719137 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-7f63738c-17a5-448d-8e2e-e78a67ab7cff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2fac38f2d6c411e8ffe4f1e6ba218c2', 'request_id': 'req-7f63738c-17a5-448d-8e2e-e78a67ab7cff'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:37.732558 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-7f63738c-17a5-448d-8e2e-e78a67ab7cff admin admin] The token cache is being invalidate because project d2fac38f2d6c411e8ffe4f1e6ba218c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:54:37.732921 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-7f63738c-17a5-448d-8e2e-e78a67ab7cff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:37.733662 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-7f63738c-17a5-448d-8e2e-e78a67ab7cff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:37.736390 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1316/2632] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:54:37 2022] DELETE /identity/v3/projects/d2fac38f2d6c411e8ffe4f1e6ba218c2 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:37.740104 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f0dea-de14-4e36-95e1-cd6d4f0042ab admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:37.742360 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-a21f0dea-de14-4e36-95e1-cd6d4f0042ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:37.759785 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f0dea-de14-4e36-95e1-cd6d4f0042ab admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:37.831494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17acda9b-bfc5-46b6-9da6-5936c7ee764e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:37.832647 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acda9b-bfc5-46b6-9da6-5936c7ee764e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:37.833089 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acda9b-bfc5-46b6-9da6-5936c7ee764e admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:37.833559 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acda9b-bfc5-46b6-9da6-5936c7ee764e admin admin] PATH_INFO: `/v3/users/a6ab2c8309e34ce099464bfdfba7fe72` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:37.835361 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63738c-17a5-448d-8e2e-e78a67ab7cff admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:37.836587 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17acda9b-bfc5-46b6-9da6-5936c7ee764e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6ab2c8309e34ce099464bfdfba7fe72)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:37.836771 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-7f63738c-17a5-448d-8e2e-e78a67ab7cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:37.839826 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17acda9b-bfc5-46b6-9da6-5936c7ee764e admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:37.954329 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-17acda9b-bfc5-46b6-9da6-5936c7ee764e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6ab2c8309e34ce099464bfdfba7fe72'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:37.955173 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-17acda9b-bfc5-46b6-9da6-5936c7ee764e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6ab2c8309e34ce099464bfdfba7fe72'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:37.975029 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-17acda9b-bfc5-46b6-9da6-5936c7ee764e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6ab2c8309e34ce099464bfdfba7fe72'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:37.989006 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63738c-17a5-448d-8e2e-e78a67ab7cff admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:37.996190 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-17acda9b-bfc5-46b6-9da6-5936c7ee764e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6ab2c8309e34ce099464bfdfba7fe72'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:37.996858 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-17acda9b-bfc5-46b6-9da6-5936c7ee764e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6ab2c8309e34ce099464bfdfba7fe72'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:38.002544 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3f080-7068-4af4-bc80-85dd95ced038 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:38.005139 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3f080-7068-4af4-bc80-85dd95ced038 service nova] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:38.006313 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3f080-7068-4af4-bc80-85dd95ced038 service nova] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:38.007015 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3f080-7068-4af4-bc80-85dd95ced038 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:38.010878 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-70a3f080-7068-4af4-bc80-85dd95ced038 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:38.020944 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1317/2633] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:54:37 2022] DELETE /identity/v3/users/a6ab2c8309e34ce099464bfdfba7fe72 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:38.049043 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a3f080-7068-4af4-bc80-85dd95ced038 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:38.050677 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a3f080-7068-4af4-bc80-85dd95ced038 service nova] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:38.058418 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:38.064604 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1317/2634] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:54:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:54:38.540067 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17acda9b-bfc5-46b6-9da6-5936c7ee764e admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:38.543398 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-17acda9b-bfc5-46b6-9da6-5936c7ee764e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:38.591667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:38.636447 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17acda9b-bfc5-46b6-9da6-5936c7ee764e admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:38.651293 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1080738-bbd3-4343-9e31-f9ce24671c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:38.652192 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1080738-bbd3-4343-9e31-f9ce24671c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:38.652482 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1080738-bbd3-4343-9e31-f9ce24671c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:38.652760 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1080738-bbd3-4343-9e31-f9ce24671c9e admin admin] PATH_INFO: `/v3/projects/bb750b3691c342c5beb949d416276868` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:38.653975 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1080738-bbd3-4343-9e31-f9ce24671c9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb750b3691c342c5beb949d416276868)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:38.656036 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1080738-bbd3-4343-9e31-f9ce24671c9e admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:38.726222 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-c1080738-bbd3-4343-9e31-f9ce24671c9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb750b3691c342c5beb949d416276868', 'request_id': 'req-c1080738-bbd3-4343-9e31-f9ce24671c9e'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:38.734348 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-c1080738-bbd3-4343-9e31-f9ce24671c9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb750b3691c342c5beb949d416276868', 'request_id': 'req-c1080738-bbd3-4343-9e31-f9ce24671c9e'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:38.742323 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-c1080738-bbd3-4343-9e31-f9ce24671c9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb750b3691c342c5beb949d416276868', 'request_id': 'req-c1080738-bbd3-4343-9e31-f9ce24671c9e'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:38.756380 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-c1080738-bbd3-4343-9e31-f9ce24671c9e admin admin] The token cache is being invalidate because project bb750b3691c342c5beb949d416276868 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:54:38.756679 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-c1080738-bbd3-4343-9e31-f9ce24671c9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:38.757366 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-c1080738-bbd3-4343-9e31-f9ce24671c9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:54:38.759248 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1318/2635] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:54:38 2022] DELETE /identity/v3/projects/bb750b3691c342c5beb949d416276868 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:54:39.277724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d95c4-a3c4-4f8e-9d5f-08212e5040f7 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:39.278210 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d95c4-a3c4-4f8e-9d5f-08212e5040f7 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:39.278297 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d95c4-a3c4-4f8e-9d5f-08212e5040f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:39.315404 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-2e0d95c4-a3c4-4f8e-9d5f-08212e5040f7 None None] MFA Rules not processed for user `6c287a593c7d4362ac42e369f25c1221`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:39.316741 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-2e0d95c4-a3c4-4f8e-9d5f-08212e5040f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:39.398423 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1318/2636] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:39 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:54:39.440642 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1080738-bbd3-4343-9e31-f9ce24671c9e admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:54:39.442305 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-c1080738-bbd3-4343-9e31-f9ce24671c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:39.555065 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1080738-bbd3-4343-9e31-f9ce24671c9e admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:54:39.564920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c818a-4fd3-4bca-915c-da914eabd70d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:54:39.565868 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c818a-4fd3-4bca-915c-da914eabd70d service nova] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:39.566245 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c818a-4fd3-4bca-915c-da914eabd70d service nova] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:39.566758 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c818a-4fd3-4bca-915c-da914eabd70d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:39.569322 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-865c818a-4fd3-4bca-915c-da914eabd70d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:39.654178 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c818a-4fd3-4bca-915c-da914eabd70d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:54:39.656135 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c818a-4fd3-4bca-915c-da914eabd70d service nova] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:54:39.663417 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:54:39.669427 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1319/2637] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:54:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:54:40.680878 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ded82-09b6-4ba8-a707-bad78c65582a None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:54:40.681399 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ded82-09b6-4ba8-a707-bad78c65582a None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:54:40.681575 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ded82-09b6-4ba8-a707-bad78c65582a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:54:40.699652 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-228ded82-09b6-4ba8-a707-bad78c65582a None None] MFA Rules not processed for user `2ab423c5002c4b01aeae93f31aa6feec`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:54:40.700867 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-228ded82-09b6-4ba8-a707-bad78c65582a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:54:40.708133 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1319/2638] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:54:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:54:50.694229 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=37 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:55:02.264243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c818a-4fd3-4bca-915c-da914eabd70d service nova] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:55:02.265755 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-865c818a-4fd3-4bca-915c-da914eabd70d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:55:02.373700 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c818a-4fd3-4bca-915c-da914eabd70d service nova] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:55:02.379503 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59b909-6acc-4514-9ea5-7060c88767b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57c8b894e74c709ea389ed462184fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:55:02.381400 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59b909-6acc-4514-9ea5-7060c88767b8 service placement] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:55:02.381400 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59b909-6acc-4514-9ea5-7060c88767b8 service placement] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:55:02.381400 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59b909-6acc-4514-9ea5-7060c88767b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:55:02.383143 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-5c59b909-6acc-4514-9ea5-7060c88767b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:55:02.395262 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59b909-6acc-4514-9ea5-7060c88767b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:55:02.396900 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59b909-6acc-4514-9ea5-7060c88767b8 service placement] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:55:02.408053 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1320/2639] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:55:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:55:07.032354 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ded82-09b6-4ba8-a707-bad78c65582a None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:55:07.033772 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-228ded82-09b6-4ba8-a707-bad78c65582a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:55:07.094127 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ded82-09b6-4ba8-a707-bad78c65582a None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:55:07.097628 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150931c3-39d2-415a-905f-f8ea3d99dbe8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:55:07.098258 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150931c3-39d2-415a-905f-f8ea3d99dbe8 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:55:07.098538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150931c3-39d2-415a-905f-f8ea3d99dbe8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:55:07.098841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150931c3-39d2-415a-905f-f8ea3d99dbe8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:55:07.101149 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-150931c3-39d2-415a-905f-f8ea3d99dbe8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:55:07.163207 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150931c3-39d2-415a-905f-f8ea3d99dbe8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:55:07.164639 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150931c3-39d2-415a-905f-f8ea3d99dbe8 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:55:07.174232 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1320/2640] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:55:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:55:07.613802 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59b909-6acc-4514-9ea5-7060c88767b8 service placement] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:55:07.624203 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59b909-6acc-4514-9ea5-7060c88767b8 service placement] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:55:07.639230 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099bcbd-7287-4467-8a8d-59dbd064b483 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57c8b894e74c709ea389ed462184fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:55:07.639847 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099bcbd-7287-4467-8a8d-59dbd064b483 service placement] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:55:07.640200 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099bcbd-7287-4467-8a8d-59dbd064b483 service placement] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:55:07.640475 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099bcbd-7287-4467-8a8d-59dbd064b483 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:55:07.642330 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-d099bcbd-7287-4467-8a8d-59dbd064b483 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:55:07.656861 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d099bcbd-7287-4467-8a8d-59dbd064b483 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:55:07.658672 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d099bcbd-7287-4467-8a8d-59dbd064b483 service placement] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:55:07.671695 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1321/2641] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:55:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:55:07.681780 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150931c3-39d2-415a-905f-f8ea3d99dbe8 service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:55:07.683507 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-150931c3-39d2-415a-905f-f8ea3d99dbe8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:55:07.695406 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150931c3-39d2-415a-905f-f8ea3d99dbe8 service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:55:07.700114 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e3d32-6066-49fe-aae3-8a083051bceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:55:07.701260 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e3d32-6066-49fe-aae3-8a083051bceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:55:07.701549 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e3d32-6066-49fe-aae3-8a083051bceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:55:07.701824 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e3d32-6066-49fe-aae3-8a083051bceb admin admin] PATH_INFO: `/v3/users/f156542c7b3a4eed9a41bb1a8c67cdde` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:55:07.703764 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e3d32-6066-49fe-aae3-8a083051bceb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f156542c7b3a4eed9a41bb1a8c67cdde)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:55:07.707185 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e3d32-6066-49fe-aae3-8a083051bceb admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:55:07.766988 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ee2e3d32-6066-49fe-aae3-8a083051bceb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f156542c7b3a4eed9a41bb1a8c67cdde'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:55:07.767646 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ee2e3d32-6066-49fe-aae3-8a083051bceb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f156542c7b3a4eed9a41bb1a8c67cdde'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:55:07.782030 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ee2e3d32-6066-49fe-aae3-8a083051bceb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f156542c7b3a4eed9a41bb1a8c67cdde'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:55:07.782772 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ee2e3d32-6066-49fe-aae3-8a083051bceb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f156542c7b3a4eed9a41bb1a8c67cdde'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:55:07.791192 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ee2e3d32-6066-49fe-aae3-8a083051bceb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f156542c7b3a4eed9a41bb1a8c67cdde'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:55:07.804187 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1321/2642] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:55:07 2022] DELETE /identity/v3/users/f156542c7b3a4eed9a41bb1a8c67cdde => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:55:07.975637 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099bcbd-7287-4467-8a8d-59dbd064b483 service placement] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:55:07.988388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099bcbd-7287-4467-8a8d-59dbd064b483 service placement] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:55:08.045826 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114abb04-713a-4e5a-abbe-1998b8ba66c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:55:08.046779 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114abb04-713a-4e5a-abbe-1998b8ba66c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:55:08.047176 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114abb04-713a-4e5a-abbe-1998b8ba66c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:55:08.047463 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114abb04-713a-4e5a-abbe-1998b8ba66c7 admin admin] PATH_INFO: `/v3/projects/dfae2a64fc144aca94342516c06a562d` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:55:08.048777 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114abb04-713a-4e5a-abbe-1998b8ba66c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfae2a64fc144aca94342516c06a562d)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:55:08.050631 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114abb04-713a-4e5a-abbe-1998b8ba66c7 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:55:08.097184 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-114abb04-713a-4e5a-abbe-1998b8ba66c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfae2a64fc144aca94342516c06a562d', 'request_id': 'req-114abb04-713a-4e5a-abbe-1998b8ba66c7'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:55:08.098281 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:55:08.104778 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-114abb04-713a-4e5a-abbe-1998b8ba66c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfae2a64fc144aca94342516c06a562d', 'request_id': 'req-114abb04-713a-4e5a-abbe-1998b8ba66c7'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:55:08.110864 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-114abb04-713a-4e5a-abbe-1998b8ba66c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfae2a64fc144aca94342516c06a562d', 'request_id': 'req-114abb04-713a-4e5a-abbe-1998b8ba66c7'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:55:08.124436 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-114abb04-713a-4e5a-abbe-1998b8ba66c7 admin admin] The token cache is being invalidate because project dfae2a64fc144aca94342516c06a562d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:55:08.124741 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-114abb04-713a-4e5a-abbe-1998b8ba66c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:55:08.125360 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-114abb04-713a-4e5a-abbe-1998b8ba66c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:55:08.126973 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1322/2643] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:55:07 2022] DELETE /identity/v3/projects/dfae2a64fc144aca94342516c06a562d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:55:17.344533 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e3d32-6066-49fe-aae3-8a083051bceb admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:55:17.346062 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-ee2e3d32-6066-49fe-aae3-8a083051bceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:55:17.372293 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:55:17.404953 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e3d32-6066-49fe-aae3-8a083051bceb admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:55:17.452499 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1040d-12c3-4982-a1ae-f672167e6ff3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:55:17.453143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1040d-12c3-4982-a1ae-f672167e6ff3 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:55:17.453420 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1040d-12c3-4982-a1ae-f672167e6ff3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:55:17.453691 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1040d-12c3-4982-a1ae-f672167e6ff3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:55:17.455476 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-bfe1040d-12c3-4982-a1ae-f672167e6ff3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:55:17.517973 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1040d-12c3-4982-a1ae-f672167e6ff3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:55:17.519437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1040d-12c3-4982-a1ae-f672167e6ff3 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:55:17.529099 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1322/2644] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:55:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:55:18.121014 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=6,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:55:27.524760 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=60 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:56:13.223208 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324850d5-fca1-46d4-8f4f-862871601499 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:56:13.223792 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324850d5-fca1-46d4-8f4f-862871601499 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:56:13.223792 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324850d5-fca1-46d4-8f4f-862871601499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:56:13.242022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-324850d5-fca1-46d4-8f4f-862871601499 None None] MFA Rules not processed for user `ce8138cd63894fe5a66e8c050c42a520`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:56:13.243241 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-324850d5-fca1-46d4-8f4f-862871601499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:56:13.296680 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1323/2645] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:56:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:56:19.414588 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1040d-12c3-4982-a1ae-f672167e6ff3 service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:56:19.416006 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-bfe1040d-12c3-4982-a1ae-f672167e6ff3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:56:19.471086 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1040d-12c3-4982-a1ae-f672167e6ff3 service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:56:19.474653 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb3b9f-d142-4aa6-95ef-698738993794 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:56:19.475809 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb3b9f-d142-4aa6-95ef-698738993794 service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:56:19.476093 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb3b9f-d142-4aa6-95ef-698738993794 service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:56:19.476369 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb3b9f-d142-4aa6-95ef-698738993794 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:56:19.478143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-3feb3b9f-d142-4aa6-95ef-698738993794 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:56:19.546219 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb3b9f-d142-4aa6-95ef-698738993794 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:56:19.547629 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb3b9f-d142-4aa6-95ef-698738993794 service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:56:19.560340 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1323/2646] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:56:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:56:23.290016 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=25 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:56:29.558315 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=54 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:56:56.980948 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324850d5-fca1-46d4-8f4f-862871601499 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:56:56.982290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-324850d5-fca1-46d4-8f4f-862871601499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:56:57.046235 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324850d5-fca1-46d4-8f4f-862871601499 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:56:57.049839 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afad893-427c-455a-a8ec-e4dd5afe4cb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:56:57.050481 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afad893-427c-455a-a8ec-e4dd5afe4cb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:56:57.050792 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afad893-427c-455a-a8ec-e4dd5afe4cb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:56:57.051069 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afad893-427c-455a-a8ec-e4dd5afe4cb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:56:57.052840 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-4afad893-427c-455a-a8ec-e4dd5afe4cb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:56:57.062010 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afad893-427c-455a-a8ec-e4dd5afe4cb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:56:57.063454 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afad893-427c-455a-a8ec-e4dd5afe4cb4 service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:56:57.071782 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1324/2647] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:56:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:57:07.068227 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=28 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:57:28.971171 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb3b9f-d142-4aa6-95ef-698738993794 service cinder] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:28.972625 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-3feb3b9f-d142-4aa6-95ef-698738993794 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:29.050183 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb3b9f-d142-4aa6-95ef-698738993794 service cinder] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:29.055611 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0162d-ecc5-4726-a728-30503c395fb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:29.056253 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0162d-ecc5-4726-a728-30503c395fb7 service nova] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:29.056539 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0162d-ecc5-4726-a728-30503c395fb7 service nova] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:29.056814 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0162d-ecc5-4726-a728-30503c395fb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:29.058584 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-6af0162d-ecc5-4726-a728-30503c395fb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:29.069128 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0162d-ecc5-4726-a728-30503c395fb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:29.070741 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0162d-ecc5-4726-a728-30503c395fb7 service nova] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:29.079489 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1324/2648] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:57:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:57:31.252274 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afad893-427c-455a-a8ec-e4dd5afe4cb4 service neutron] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:31.254784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-4afad893-427c-455a-a8ec-e4dd5afe4cb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:31.264935 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afad893-427c-455a-a8ec-e4dd5afe4cb4 service neutron] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:31.268562 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9d90e-4b6d-456d-b058-b2158a7cd5f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:31.269225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9d90e-4b6d-456d-b058-b2158a7cd5f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:31.269507 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9d90e-4b6d-456d-b058-b2158a7cd5f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:31.269783 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9d90e-4b6d-456d-b058-b2158a7cd5f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:31.271512 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-2cc9d90e-4b6d-456d-b058-b2158a7cd5f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:31.282162 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9d90e-4b6d-456d-b058-b2158a7cd5f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:31.283785 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9d90e-4b6d-456d-b058-b2158a7cd5f5 service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:31.292842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1325/2649] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:57:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:57:31.396620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba015b-2bfe-4d44-afeb-1d8ad5b9406c None None] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:31.397190 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba015b-2bfe-4d44-afeb-1d8ad5b9406c None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:31.397634 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba015b-2bfe-4d44-afeb-1d8ad5b9406c None None] PATH_INFO: `/` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:31.399306 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1325/2650] 10.222.0.13 () {54 vars in 921 bytes} [Wed Jun 29 12:57:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:57:31.406326 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb3a61-d46c-4532-af9a-812ef87177ef None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:31.406850 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb3a61-d46c-4532-af9a-812ef87177ef None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:31.407303 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb3a61-d46c-4532-af9a-812ef87177ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:31.463661 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-cfeb3a61-d46c-4532-af9a-812ef87177ef None None] MFA Rules not processed for user `50f5cc247f6b445f81fc3715d7bce92d`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:57:31.464881 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-cfeb3a61-d46c-4532-af9a-812ef87177ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:31.472154 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1326/2651] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Jun 29 12:57:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:57:31.484697 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba015b-2bfe-4d44-afeb-1d8ad5b9406c None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:31.497049 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba015b-2bfe-4d44-afeb-1d8ad5b9406c None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:31.502230 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9baf24e-b434-4380-9b2d-c9c34e1783d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:31.503116 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9baf24e-b434-4380-9b2d-c9c34e1783d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:31.503653 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9baf24e-b434-4380-9b2d-c9c34e1783d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:31.504420 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9baf24e-b434-4380-9b2d-c9c34e1783d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:31.513269 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9baf24e-b434-4380-9b2d-c9c34e1783d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:31.514903 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9baf24e-b434-4380-9b2d-c9c34e1783d0 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:31.523283 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1326/2652] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:57:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:57:31.607608 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d94a46-74f0-425a-996b-81c833279260 None None] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:31.607904 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d94a46-74f0-425a-996b-81c833279260 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:31.608218 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d94a46-74f0-425a-996b-81c833279260 None None] PATH_INFO: `/` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:31.609597 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1327/2653] 10.222.0.13 () {54 vars in 921 bytes} [Wed Jun 29 12:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:57:31.616506 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9bcf2-70e4-469c-8ed4-abdde1e2bf2b None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:31.616796 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9bcf2-70e4-469c-8ed4-abdde1e2bf2b None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:31.617075 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9bcf2-70e4-469c-8ed4-abdde1e2bf2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:31.654355 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-cfa9bcf2-70e4-469c-8ed4-abdde1e2bf2b None None] MFA Rules not processed for user `3fbcf547421b42e4b520f9246326bff8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:57:31.655624 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-cfa9bcf2-70e4-469c-8ed4-abdde1e2bf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:31.665389 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1327/2654] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Jun 29 12:57:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:57:31.676563 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d94a46-74f0-425a-996b-81c833279260 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:31.687558 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d94a46-74f0-425a-996b-81c833279260 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:31.691130 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207d04e-0485-4a19-b4f4-026621157dea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:31.691766 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207d04e-0485-4a19-b4f4-026621157dea service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:31.692048 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207d04e-0485-4a19-b4f4-026621157dea service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:31.692325 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207d04e-0485-4a19-b4f4-026621157dea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:31.702604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207d04e-0485-4a19-b4f4-026621157dea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:31.704059 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207d04e-0485-4a19-b4f4-026621157dea service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:31.714540 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1328/2655] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:57:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:57:31.779239 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9bcf2-70e4-469c-8ed4-abdde1e2bf2b None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:31.780614 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-cfa9bcf2-70e4-469c-8ed4-abdde1e2bf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:31.853028 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9bcf2-70e4-469c-8ed4-abdde1e2bf2b None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:31.857977 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50489e8b-4f8f-48b5-852d-01b6504d2028 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57c8b894e74c709ea389ed462184fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:31.858619 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50489e8b-4f8f-48b5-852d-01b6504d2028 service placement] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:31.858926 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50489e8b-4f8f-48b5-852d-01b6504d2028 service placement] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:31.859204 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50489e8b-4f8f-48b5-852d-01b6504d2028 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:31.860942 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-50489e8b-4f8f-48b5-852d-01b6504d2028 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:31.872546 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50489e8b-4f8f-48b5-852d-01b6504d2028 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:31.874133 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50489e8b-4f8f-48b5-852d-01b6504d2028 service placement] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:31.884222 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1328/2656] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:57:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:57:33.278125 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207d04e-0485-4a19-b4f4-026621157dea service neutron] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:33.287338 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207d04e-0485-4a19-b4f4-026621157dea service neutron] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:33.290954 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d62e3-acac-499a-addc-470329a2e8a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:33.291595 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d62e3-acac-499a-addc-470329a2e8a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:33.291881 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d62e3-acac-499a-addc-470329a2e8a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:33.292161 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d62e3-acac-499a-addc-470329a2e8a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:33.293931 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-125d62e3-acac-499a-addc-470329a2e8a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:33.359351 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d62e3-acac-499a-addc-470329a2e8a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:33.360828 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d62e3-acac-499a-addc-470329a2e8a0 service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:33.370926 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1329/2657] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:57:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:57:36.481833 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50489e8b-4f8f-48b5-852d-01b6504d2028 service placement] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:36.492768 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50489e8b-4f8f-48b5-852d-01b6504d2028 service placement] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:36.500511 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc4116-ea25-4c00-b2cd-e50aba239685 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57c8b894e74c709ea389ed462184fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:36.501254 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc4116-ea25-4c00-b2cd-e50aba239685 service placement] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:36.501540 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc4116-ea25-4c00-b2cd-e50aba239685 service placement] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:36.501816 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc4116-ea25-4c00-b2cd-e50aba239685 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:36.503675 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-b6bc4116-ea25-4c00-b2cd-e50aba239685 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:36.516179 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bc4116-ea25-4c00-b2cd-e50aba239685 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:36.517770 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bc4116-ea25-4c00-b2cd-e50aba239685 service placement] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:36.528437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1329/2658] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:57:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:57:36.550303 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d62e3-acac-499a-addc-470329a2e8a0 service neutron] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:36.552369 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-125d62e3-acac-499a-addc-470329a2e8a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:36.564673 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d62e3-acac-499a-addc-470329a2e8a0 service neutron] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:36.569471 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b972043-4bff-40b4-a759-a416c4a657b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:36.570344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b972043-4bff-40b4-a759-a416c4a657b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:36.570648 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b972043-4bff-40b4-a759-a416c4a657b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:36.571052 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b972043-4bff-40b4-a759-a416c4a657b2 admin admin] PATH_INFO: `/v3/users/ce8138cd63894fe5a66e8c050c42a520` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:36.572231 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b972043-4bff-40b4-a759-a416c4a657b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce8138cd63894fe5a66e8c050c42a520)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:36.574187 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b972043-4bff-40b4-a759-a416c4a657b2 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:36.623329 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-0b972043-4bff-40b4-a759-a416c4a657b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce8138cd63894fe5a66e8c050c42a520'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:36.623994 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-0b972043-4bff-40b4-a759-a416c4a657b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce8138cd63894fe5a66e8c050c42a520'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:36.636656 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-0b972043-4bff-40b4-a759-a416c4a657b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce8138cd63894fe5a66e8c050c42a520'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:36.644303 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-0b972043-4bff-40b4-a759-a416c4a657b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce8138cd63894fe5a66e8c050c42a520'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:36.644926 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-0b972043-4bff-40b4-a759-a416c4a657b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce8138cd63894fe5a66e8c050c42a520'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:36.658173 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1330/2659] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:57:36 2022] DELETE /identity/v3/users/ce8138cd63894fe5a66e8c050c42a520 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:57:36.831309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc4116-ea25-4c00-b2cd-e50aba239685 service placement] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:36.841964 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc4116-ea25-4c00-b2cd-e50aba239685 service placement] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:36.864090 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:57:36.902830 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce46e3-4554-48fc-8a79-752c5a9eeb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:36.903686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce46e3-4554-48fc-8a79-752c5a9eeb51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:36.903962 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce46e3-4554-48fc-8a79-752c5a9eeb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:36.904230 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce46e3-4554-48fc-8a79-752c5a9eeb51 admin admin] PATH_INFO: `/v3/projects/dc18d4bf3224406d8ff9382d5bbde540` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:36.905394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce46e3-4554-48fc-8a79-752c5a9eeb51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc18d4bf3224406d8ff9382d5bbde540)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:36.907335 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce46e3-4554-48fc-8a79-752c5a9eeb51 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:36.950701 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-53ce46e3-4554-48fc-8a79-752c5a9eeb51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc18d4bf3224406d8ff9382d5bbde540', 'request_id': 'req-53ce46e3-4554-48fc-8a79-752c5a9eeb51'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:36.958342 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-53ce46e3-4554-48fc-8a79-752c5a9eeb51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc18d4bf3224406d8ff9382d5bbde540', 'request_id': 'req-53ce46e3-4554-48fc-8a79-752c5a9eeb51'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:36.964384 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-53ce46e3-4554-48fc-8a79-752c5a9eeb51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc18d4bf3224406d8ff9382d5bbde540', 'request_id': 'req-53ce46e3-4554-48fc-8a79-752c5a9eeb51'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:36.974654 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-53ce46e3-4554-48fc-8a79-752c5a9eeb51 admin admin] The token cache is being invalidate because project dc18d4bf3224406d8ff9382d5bbde540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:57:36.974943 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-53ce46e3-4554-48fc-8a79-752c5a9eeb51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:36.975553 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-53ce46e3-4554-48fc-8a79-752c5a9eeb51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:36.977058 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1330/2660] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:57:36 2022] DELETE /identity/v3/projects/dc18d4bf3224406d8ff9382d5bbde540 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:57:36.981985 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710a795-c9d8-4c58-b3ed-5af0e5026d31 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:36.982261 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710a795-c9d8-4c58-b3ed-5af0e5026d31 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:36.982542 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710a795-c9d8-4c58-b3ed-5af0e5026d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:37.000755 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-7710a795-c9d8-4c58-b3ed-5af0e5026d31 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:57:37.001944 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-7710a795-c9d8-4c58-b3ed-5af0e5026d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:37.008297 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:57:37.060972 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1331/2661] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:57:37.069488 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9165f7-e4e5-475d-8a90-c186e61c0973 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:37.069782 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9165f7-e4e5-475d-8a90-c186e61c0973 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:37.070065 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9165f7-e4e5-475d-8a90-c186e61c0973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:37.088000 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-bb9165f7-e4e5-475d-8a90-c186e61c0973 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:57:37.089201 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-bb9165f7-e4e5-475d-8a90-c186e61c0973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:37.097077 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1331/2662] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:57:37.101022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710a795-c9d8-4c58-b3ed-5af0e5026d31 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:37.110473 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710a795-c9d8-4c58-b3ed-5af0e5026d31 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:37.115590 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08503bb-04dd-481e-a592-889520507354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:37.116237 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08503bb-04dd-481e-a592-889520507354 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:37.116518 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08503bb-04dd-481e-a592-889520507354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:37.116795 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08503bb-04dd-481e-a592-889520507354 admin admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:37.117512 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08503bb-04dd-481e-a592-889520507354 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:57:37.117820 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08503bb-04dd-481e-a592-889520507354 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:37.119451 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08503bb-04dd-481e-a592-889520507354 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:37.131828 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1332/2663] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:57:37.135926 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9165f7-e4e5-475d-8a90-c186e61c0973 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:37.145880 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9165f7-e4e5-475d-8a90-c186e61c0973 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:37.151814 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa6ada-e0f8-40dd-87db-ab10e66ba94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:37.152549 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa6ada-e0f8-40dd-87db-ab10e66ba94d admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:37.153072 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa6ada-e0f8-40dd-87db-ab10e66ba94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:37.153581 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa6ada-e0f8-40dd-87db-ab10e66ba94d admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:37.154985 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa6ada-e0f8-40dd-87db-ab10e66ba94d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:37.157361 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa6ada-e0f8-40dd-87db-ab10e66ba94d admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:37.183156 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1332/2664] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:57:37 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:57:37.187646 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08503bb-04dd-481e-a592-889520507354 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:37.197377 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08503bb-04dd-481e-a592-889520507354 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:37.254869 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf0fda-5a79-47ee-8068-4773c5727f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:37.255546 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf0fda-5a79-47ee-8068-4773c5727f89 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:37.255836 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf0fda-5a79-47ee-8068-4773c5727f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:37.256115 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf0fda-5a79-47ee-8068-4773c5727f89 admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:37.256833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf0fda-5a79-47ee-8068-4773c5727f89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:37.258795 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf0fda-5a79-47ee-8068-4773c5727f89 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:37.284985 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1333/2665] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:57:37 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:57:37.289234 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa6ada-e0f8-40dd-87db-ab10e66ba94d admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:37.299540 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa6ada-e0f8-40dd-87db-ab10e66ba94d admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:37.304130 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23883591-c871-4683-877d-ad6a5d83eea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:37.304785 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23883591-c871-4683-877d-ad6a5d83eea5 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:37.305079 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23883591-c871-4683-877d-ad6a5d83eea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:37.305344 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23883591-c871-4683-877d-ad6a5d83eea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:37.306069 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23883591-c871-4683-877d-ad6a5d83eea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:37.307708 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23883591-c871-4683-877d-ad6a5d83eea5 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:37.318122 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1333/2666] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:57:37.322150 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf0fda-5a79-47ee-8068-4773c5727f89 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:37.332688 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf0fda-5a79-47ee-8068-4773c5727f89 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:37.337828 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c5b03d-6ea4-483f-b28d-bedd889598cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:37.338501 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5b03d-6ea4-483f-b28d-bedd889598cf admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:37.339053 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5b03d-6ea4-483f-b28d-bedd889598cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:37.339175 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5b03d-6ea4-483f-b28d-bedd889598cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:37.339813 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c5b03d-6ea4-483f-b28d-bedd889598cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:37.341416 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c5b03d-6ea4-483f-b28d-bedd889598cf admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:37.352777 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1334/2667] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:57:37.357048 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23883591-c871-4683-877d-ad6a5d83eea5 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:37.369181 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23883591-c871-4683-877d-ad6a5d83eea5 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:37.374831 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99028d82-a66f-4699-9ec4-cdd6a0b2ace8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:37.375744 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99028d82-a66f-4699-9ec4-cdd6a0b2ace8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:37.376343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99028d82-a66f-4699-9ec4-cdd6a0b2ace8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:37.376343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99028d82-a66f-4699-9ec4-cdd6a0b2ace8 admin admin] PATH_INFO: `/v3/projects/2b6c713d9bd74e998ff655d461ba8646/users/eece5265b89d49ff9dc287ee3d103b2a/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:37.396354 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99028d82-a66f-4699-9ec4-cdd6a0b2ace8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b6c713d9bd74e998ff655d461ba8646, user_id=eece5265b89d49ff9dc287ee3d103b2a, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:37.399204 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99028d82-a66f-4699-9ec4-cdd6a0b2ace8 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:37.414682 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1334/2668] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:57:37 2022] PUT /identity/v3/projects/2b6c713d9bd74e998ff655d461ba8646/users/eece5265b89d49ff9dc287ee3d103b2a/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:57:37.425550 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e35cf4-ca97-4295-aac0-06f79b1128a8 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:37.425853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e35cf4-ca97-4295-aac0-06f79b1128a8 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:37.426136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e35cf4-ca97-4295-aac0-06f79b1128a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:37.455083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-f7e35cf4-ca97-4295-aac0-06f79b1128a8 None None] MFA Rules not processed for user `eece5265b89d49ff9dc287ee3d103b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:57:37.456876 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-f7e35cf4-ca97-4295-aac0-06f79b1128a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:37.522324 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1335/2669] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:57:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:57:37.526613 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99028d82-a66f-4699-9ec4-cdd6a0b2ace8 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:37.573644 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:57:37.588549 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99028d82-a66f-4699-9ec4-cdd6a0b2ace8 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:37.593184 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da4ecd-ed56-4d9c-9b44-359595fe6b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:37.593849 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da4ecd-ed56-4d9c-9b44-359595fe6b66 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:37.594129 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da4ecd-ed56-4d9c-9b44-359595fe6b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:37.594401 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da4ecd-ed56-4d9c-9b44-359595fe6b66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:37.595124 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da4ecd-ed56-4d9c-9b44-359595fe6b66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:37.597164 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da4ecd-ed56-4d9c-9b44-359595fe6b66 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:37.626194 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1335/2670] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:57:37 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:57:37.627940 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e35cf4-ca97-4295-aac0-06f79b1128a8 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:37.639344 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e35cf4-ca97-4295-aac0-06f79b1128a8 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:37.643495 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:57:37.697923 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297805b-d29e-40d5-b899-aeb107e62b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:37.698600 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297805b-d29e-40d5-b899-aeb107e62b50 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:37.698913 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297805b-d29e-40d5-b899-aeb107e62b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:37.699218 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297805b-d29e-40d5-b899-aeb107e62b50 admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:37.699899 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297805b-d29e-40d5-b899-aeb107e62b50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:37.701885 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297805b-d29e-40d5-b899-aeb107e62b50 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:37.727684 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1336/2671] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:57:37 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:57:37.729029 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da4ecd-ed56-4d9c-9b44-359595fe6b66 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:37.739810 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da4ecd-ed56-4d9c-9b44-359595fe6b66 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:37.744341 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50abf9b2-bdf6-4177-80d1-b08a81c0fd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:37.744995 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abf9b2-bdf6-4177-80d1-b08a81c0fd19 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:37.745275 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abf9b2-bdf6-4177-80d1-b08a81c0fd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:37.745554 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abf9b2-bdf6-4177-80d1-b08a81c0fd19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:37.746272 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50abf9b2-bdf6-4177-80d1-b08a81c0fd19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:37.747893 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50abf9b2-bdf6-4177-80d1-b08a81c0fd19 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:37.759425 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1336/2672] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:57:37.763357 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297805b-d29e-40d5-b899-aeb107e62b50 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:37.773418 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297805b-d29e-40d5-b899-aeb107e62b50 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:37.778348 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd10ad-63cd-46f0-adda-0a99601f26c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:37.779255 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd10ad-63cd-46f0-adda-0a99601f26c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:37.779536 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd10ad-63cd-46f0-adda-0a99601f26c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:37.779814 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd10ad-63cd-46f0-adda-0a99601f26c4 admin admin] PATH_INFO: `/v3/projects/97da30c7ea5243ee9e54ecde86981be3/users/3d40d90c3b5940a8bf8cab101d2645d2/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:37.793976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd10ad-63cd-46f0-adda-0a99601f26c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97da30c7ea5243ee9e54ecde86981be3, user_id=3d40d90c3b5940a8bf8cab101d2645d2, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:37.796666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd10ad-63cd-46f0-adda-0a99601f26c4 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:37.809923 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1337/2673] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:57:37 2022] PUT /identity/v3/projects/97da30c7ea5243ee9e54ecde86981be3/users/3d40d90c3b5940a8bf8cab101d2645d2/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:57:37.813799 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50abf9b2-bdf6-4177-80d1-b08a81c0fd19 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:37.824439 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50abf9b2-bdf6-4177-80d1-b08a81c0fd19 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:37.879812 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec96ce8-0557-48cc-b75d-bf35a6ba801a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:37.880497 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec96ce8-0557-48cc-b75d-bf35a6ba801a admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:37.880780 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec96ce8-0557-48cc-b75d-bf35a6ba801a admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:37.881053 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec96ce8-0557-48cc-b75d-bf35a6ba801a admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:37.881766 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec96ce8-0557-48cc-b75d-bf35a6ba801a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:37.883395 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec96ce8-0557-48cc-b75d-bf35a6ba801a admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:37.892976 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1337/2674] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:57:37.896952 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd10ad-63cd-46f0-adda-0a99601f26c4 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:37.907043 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd10ad-63cd-46f0-adda-0a99601f26c4 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:37.911586 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6beb1a9-5eee-4f41-ba4b-e251f4595d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:37.912457 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6beb1a9-5eee-4f41-ba4b-e251f4595d6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:37.912741 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6beb1a9-5eee-4f41-ba4b-e251f4595d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:37.913015 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6beb1a9-5eee-4f41-ba4b-e251f4595d6f admin admin] PATH_INFO: `/v3/projects/97da30c7ea5243ee9e54ecde86981be3/users/3d40d90c3b5940a8bf8cab101d2645d2/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:37.915012 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6beb1a9-5eee-4f41-ba4b-e251f4595d6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=97da30c7ea5243ee9e54ecde86981be3, user_id=3d40d90c3b5940a8bf8cab101d2645d2, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:37.917665 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6beb1a9-5eee-4f41-ba4b-e251f4595d6f admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:37.928165 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1338/2675] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:57:37 2022] PUT /identity/v3/projects/97da30c7ea5243ee9e54ecde86981be3/users/3d40d90c3b5940a8bf8cab101d2645d2/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:57:37.937898 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b9ec6-01e6-49c7-836c-54952435dcc4 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:37.938194 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b9ec6-01e6-49c7-836c-54952435dcc4 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:37.938473 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b9ec6-01e6-49c7-836c-54952435dcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:37.965913 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-a43b9ec6-01e6-49c7-836c-54952435dcc4 None None] MFA Rules not processed for user `3d40d90c3b5940a8bf8cab101d2645d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:57:37.967139 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-a43b9ec6-01e6-49c7-836c-54952435dcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:38.035149 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1338/2676] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:57:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:57:38.047198 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6beb1a9-5eee-4f41-ba4b-e251f4595d6f admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:38.048893 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-b6beb1a9-5eee-4f41-ba4b-e251f4595d6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:38.117214 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6beb1a9-5eee-4f41-ba4b-e251f4595d6f admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:38.120826 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f9523-1fb6-4f28-bf19-4dfae80104b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:38.121459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f9523-1fb6-4f28-bf19-4dfae80104b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:38.121741 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f9523-1fb6-4f28-bf19-4dfae80104b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:38.122017 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f9523-1fb6-4f28-bf19-4dfae80104b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:38.131716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f9523-1fb6-4f28-bf19-4dfae80104b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:38.133146 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f9523-1fb6-4f28-bf19-4dfae80104b6 service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:38.142437 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1339/2677] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:57:38 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:57:38.448352 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b9ec6-01e6-49c7-836c-54952435dcc4 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:38.458136 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b9ec6-01e6-49c7-836c-54952435dcc4 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:38.462883 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43168402-0c78-460e-af1a-47a57648cc42 tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d40d90c3b5940a8bf8cab101d2645d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97da30c7ea5243ee9e54ecde86981be3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:38.463556 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43168402-0c78-460e-af1a-47a57648cc42 tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:38.463843 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43168402-0c78-460e-af1a-47a57648cc42 tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:38.464123 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43168402-0c78-460e-af1a-47a57648cc42 tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:38.464854 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43168402-0c78-460e-af1a-47a57648cc42 tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:57:38.465167 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43168402-0c78-460e-af1a-47a57648cc42 tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:38.467436 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43168402-0c78-460e-af1a-47a57648cc42 tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:38.480847 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1339/2678] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:57:38.485058 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f9523-1fb6-4f28-bf19-4dfae80104b6 service cinder] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:38.494621 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f9523-1fb6-4f28-bf19-4dfae80104b6 service cinder] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:38.499141 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a083a-3328-4a43-a3e2-7635d817324a tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d40d90c3b5940a8bf8cab101d2645d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97da30c7ea5243ee9e54ecde86981be3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:38.499781 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a083a-3328-4a43-a3e2-7635d817324a tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:38.500067 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a083a-3328-4a43-a3e2-7635d817324a tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:38.500660 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a083a-3328-4a43-a3e2-7635d817324a tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:38.501380 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a083a-3328-4a43-a3e2-7635d817324a tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:38.504208 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a083a-3328-4a43-a3e2-7635d817324a tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:38.529009 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1340/2679] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:57:38 2022] POST /identity/v3/projects => generated 353 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:57:38.533177 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43168402-0c78-460e-af1a-47a57648cc42 tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:38.543128 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43168402-0c78-460e-af1a-47a57648cc42 tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:38.573844 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:57:38.603119 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44c067-9feb-48d4-98a8-d88a6d5517c8 tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d40d90c3b5940a8bf8cab101d2645d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97da30c7ea5243ee9e54ecde86981be3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:38.603887 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44c067-9feb-48d4-98a8-d88a6d5517c8 tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:38.604248 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44c067-9feb-48d4-98a8-d88a6d5517c8 tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:38.604599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44c067-9feb-48d4-98a8-d88a6d5517c8 tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:38.605405 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44c067-9feb-48d4-98a8-d88a6d5517c8 tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:57:38.605792 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44c067-9feb-48d4-98a8-d88a6d5517c8 tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:38.607517 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44c067-9feb-48d4-98a8-d88a6d5517c8 tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:38.620787 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1340/2680] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:57:38.658099 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a083a-3328-4a43-a3e2-7635d817324a tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:38.668760 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a083a-3328-4a43-a3e2-7635d817324a tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:38.673674 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac435bf-c685-4440-bd8c-dfdbd0606b2b tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d40d90c3b5940a8bf8cab101d2645d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97da30c7ea5243ee9e54ecde86981be3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:38.675147 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac435bf-c685-4440-bd8c-dfdbd0606b2b tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:38.675440 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac435bf-c685-4440-bd8c-dfdbd0606b2b tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:38.675834 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac435bf-c685-4440-bd8c-dfdbd0606b2b tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] PATH_INFO: `/v3/projects/2f82beaa7ae0451f9938ba0a76b325f3` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:38.677112 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac435bf-c685-4440-bd8c-dfdbd0606b2b tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2f82beaa7ae0451f9938ba0a76b325f3)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:38.679771 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac435bf-c685-4440-bd8c-dfdbd0606b2b tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:38.706428 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:57:38.730838 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-fac435bf-c685-4440-bd8c-dfdbd0606b2b tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f82beaa7ae0451f9938ba0a76b325f3', 'request_id': 'req-fac435bf-c685-4440-bd8c-dfdbd0606b2b'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:38.738215 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-fac435bf-c685-4440-bd8c-dfdbd0606b2b tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f82beaa7ae0451f9938ba0a76b325f3', 'request_id': 'req-fac435bf-c685-4440-bd8c-dfdbd0606b2b'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:38.743980 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-fac435bf-c685-4440-bd8c-dfdbd0606b2b tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f82beaa7ae0451f9938ba0a76b325f3', 'request_id': 'req-fac435bf-c685-4440-bd8c-dfdbd0606b2b'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:38.758224 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-fac435bf-c685-4440-bd8c-dfdbd0606b2b tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] The token cache is being invalidate because project 2f82beaa7ae0451f9938ba0a76b325f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:57:38.758510 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-fac435bf-c685-4440-bd8c-dfdbd0606b2b tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:38.759187 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-fac435bf-c685-4440-bd8c-dfdbd0606b2b tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:38.760851 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1341/2681] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:57:38 2022] DELETE /identity/v3/projects/2f82beaa7ae0451f9938ba0a76b325f3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:57:38.953017 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44c067-9feb-48d4-98a8-d88a6d5517c8 tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:38.954774 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-5f44c067-9feb-48d4-98a8-d88a6d5517c8 tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:39.018387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44c067-9feb-48d4-98a8-d88a6d5517c8 tempest-VolumeQuotaClassesTest-32216554 tempest-VolumeQuotaClassesTest-32216554-project-admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:39.073229 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee680e67-6643-4c0b-8c7d-a955245d6953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:39.074103 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee680e67-6643-4c0b-8c7d-a955245d6953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:39.074389 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee680e67-6643-4c0b-8c7d-a955245d6953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:39.074690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee680e67-6643-4c0b-8c7d-a955245d6953 admin admin] PATH_INFO: `/v3/users/eece5265b89d49ff9dc287ee3d103b2a` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:39.075944 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee680e67-6643-4c0b-8c7d-a955245d6953 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eece5265b89d49ff9dc287ee3d103b2a)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:39.077902 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee680e67-6643-4c0b-8c7d-a955245d6953 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:39.124601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ee680e67-6643-4c0b-8c7d-a955245d6953 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eece5265b89d49ff9dc287ee3d103b2a'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:39.125238 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ee680e67-6643-4c0b-8c7d-a955245d6953 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eece5265b89d49ff9dc287ee3d103b2a'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:39.137599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ee680e67-6643-4c0b-8c7d-a955245d6953 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eece5265b89d49ff9dc287ee3d103b2a'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:39.138163 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ee680e67-6643-4c0b-8c7d-a955245d6953 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eece5265b89d49ff9dc287ee3d103b2a'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:39.145308 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ee680e67-6643-4c0b-8c7d-a955245d6953 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eece5265b89d49ff9dc287ee3d103b2a'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:39.147383 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:57:39.160585 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1341/2682] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:57:38 2022] DELETE /identity/v3/users/eece5265b89d49ff9dc287ee3d103b2a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:57:39.165000 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13c687-2000-4edd-a848-cec909b0ce17 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:39.165281 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13c687-2000-4edd-a848-cec909b0ce17 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:39.165549 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13c687-2000-4edd-a848-cec909b0ce17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:39.182971 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-ba13c687-2000-4edd-a848-cec909b0ce17 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:57:39.184147 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-ba13c687-2000-4edd-a848-cec909b0ce17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:39.241595 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1342/2683] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:57:39.251019 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee680e67-6643-4c0b-8c7d-a955245d6953 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:39.252487 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-ee680e67-6643-4c0b-8c7d-a955245d6953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:39.309382 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee680e67-6643-4c0b-8c7d-a955245d6953 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:39.312980 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30357e76-35fc-4783-ae40-78bb7e800d75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:39.313624 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30357e76-35fc-4783-ae40-78bb7e800d75 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:39.313913 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30357e76-35fc-4783-ae40-78bb7e800d75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:39.314192 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30357e76-35fc-4783-ae40-78bb7e800d75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:39.323720 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30357e76-35fc-4783-ae40-78bb7e800d75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:39.325237 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30357e76-35fc-4783-ae40-78bb7e800d75 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:39.335870 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1342/2684] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:57:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:57:39.603919 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13c687-2000-4edd-a848-cec909b0ce17 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:39.605402 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-ba13c687-2000-4edd-a848-cec909b0ce17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:39.618679 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13c687-2000-4edd-a848-cec909b0ce17 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:39.623448 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899f99a-7f76-46f6-b637-0f51296dac7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:39.624424 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899f99a-7f76-46f6-b637-0f51296dac7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:39.624700 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899f99a-7f76-46f6-b637-0f51296dac7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:39.624981 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899f99a-7f76-46f6-b637-0f51296dac7a admin admin] PATH_INFO: `/v3/projects/2b6c713d9bd74e998ff655d461ba8646` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:39.626335 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899f99a-7f76-46f6-b637-0f51296dac7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b6c713d9bd74e998ff655d461ba8646)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:39.628661 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899f99a-7f76-46f6-b637-0f51296dac7a admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:39.675076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-4899f99a-7f76-46f6-b637-0f51296dac7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b6c713d9bd74e998ff655d461ba8646', 'request_id': 'req-4899f99a-7f76-46f6-b637-0f51296dac7a'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:39.681168 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-4899f99a-7f76-46f6-b637-0f51296dac7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b6c713d9bd74e998ff655d461ba8646', 'request_id': 'req-4899f99a-7f76-46f6-b637-0f51296dac7a'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:39.686872 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-4899f99a-7f76-46f6-b637-0f51296dac7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b6c713d9bd74e998ff655d461ba8646', 'request_id': 'req-4899f99a-7f76-46f6-b637-0f51296dac7a'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:39.699470 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-4899f99a-7f76-46f6-b637-0f51296dac7a admin admin] The token cache is being invalidate because project 2b6c713d9bd74e998ff655d461ba8646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:57:39.699761 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-4899f99a-7f76-46f6-b637-0f51296dac7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:39.700382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-4899f99a-7f76-46f6-b637-0f51296dac7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:39.701939 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1343/2685] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:57:39 2022] DELETE /identity/v3/projects/2b6c713d9bd74e998ff655d461ba8646 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:57:39.706510 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30357e76-35fc-4783-ae40-78bb7e800d75 service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:39.716192 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30357e76-35fc-4783-ae40-78bb7e800d75 service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:39.787235 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca40acb-6d82-4055-9eab-b557ffd0cde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:39.789557 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca40acb-6d82-4055-9eab-b557ffd0cde8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:39.789920 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca40acb-6d82-4055-9eab-b557ffd0cde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:39.790268 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca40acb-6d82-4055-9eab-b557ffd0cde8 admin admin] PATH_INFO: `/v3/users/3d40d90c3b5940a8bf8cab101d2645d2` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:39.791608 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca40acb-6d82-4055-9eab-b557ffd0cde8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d40d90c3b5940a8bf8cab101d2645d2)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:39.793620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca40acb-6d82-4055-9eab-b557ffd0cde8 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:39.844546 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-eca40acb-6d82-4055-9eab-b557ffd0cde8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d40d90c3b5940a8bf8cab101d2645d2'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:39.845211 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-eca40acb-6d82-4055-9eab-b557ffd0cde8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d40d90c3b5940a8bf8cab101d2645d2'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:39.857435 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-eca40acb-6d82-4055-9eab-b557ffd0cde8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d40d90c3b5940a8bf8cab101d2645d2'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:39.858090 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-eca40acb-6d82-4055-9eab-b557ffd0cde8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d40d90c3b5940a8bf8cab101d2645d2'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:39.868966 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-eca40acb-6d82-4055-9eab-b557ffd0cde8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d40d90c3b5940a8bf8cab101d2645d2'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:39.882880 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1343/2686] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:57:39 2022] DELETE /identity/v3/users/3d40d90c3b5940a8bf8cab101d2645d2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:57:40.172826 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899f99a-7f76-46f6-b637-0f51296dac7a admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:40.174822 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-4899f99a-7f76-46f6-b637-0f51296dac7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:40.187577 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899f99a-7f76-46f6-b637-0f51296dac7a admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:40.220427 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:57:40.245728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18cd96f-783d-416c-ac91-e105951d1b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:40.246512 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cd96f-783d-416c-ac91-e105951d1b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:40.246820 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cd96f-783d-416c-ac91-e105951d1b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:40.247093 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cd96f-783d-416c-ac91-e105951d1b7b admin admin] PATH_INFO: `/v3/projects/97da30c7ea5243ee9e54ecde86981be3` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:40.248262 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18cd96f-783d-416c-ac91-e105951d1b7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=97da30c7ea5243ee9e54ecde86981be3)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:40.250158 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18cd96f-783d-416c-ac91-e105951d1b7b admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:40.293847 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e18cd96f-783d-416c-ac91-e105951d1b7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97da30c7ea5243ee9e54ecde86981be3', 'request_id': 'req-e18cd96f-783d-416c-ac91-e105951d1b7b'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:40.300242 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e18cd96f-783d-416c-ac91-e105951d1b7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97da30c7ea5243ee9e54ecde86981be3', 'request_id': 'req-e18cd96f-783d-416c-ac91-e105951d1b7b'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:40.305539 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e18cd96f-783d-416c-ac91-e105951d1b7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97da30c7ea5243ee9e54ecde86981be3', 'request_id': 'req-e18cd96f-783d-416c-ac91-e105951d1b7b'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:40.317533 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e18cd96f-783d-416c-ac91-e105951d1b7b admin admin] The token cache is being invalidate because project 97da30c7ea5243ee9e54ecde86981be3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:57:40.317816 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e18cd96f-783d-416c-ac91-e105951d1b7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:40.318421 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e18cd96f-783d-416c-ac91-e105951d1b7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:40.319946 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1344/2687] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:57:40 2022] DELETE /identity/v3/projects/97da30c7ea5243ee9e54ecde86981be3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:57:40.325253 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139bb15-2c97-451e-9aa9-8b0c46fcc1ba None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:40.325544 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139bb15-2c97-451e-9aa9-8b0c46fcc1ba None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:40.325821 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139bb15-2c97-451e-9aa9-8b0c46fcc1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:40.343351 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-4139bb15-2c97-451e-9aa9-8b0c46fcc1ba None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:57:40.344535 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-4139bb15-2c97-451e-9aa9-8b0c46fcc1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:40.352688 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:57:40.407289 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1344/2688] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:57:40.415505 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0689692-5d17-44e9-a3d5-94d3bf3ea433 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:40.415795 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0689692-5d17-44e9-a3d5-94d3bf3ea433 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:40.416098 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0689692-5d17-44e9-a3d5-94d3bf3ea433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:40.434547 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-f0689692-5d17-44e9-a3d5-94d3bf3ea433 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:57:40.435812 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-f0689692-5d17-44e9-a3d5-94d3bf3ea433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:40.443975 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1345/2689] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:57:40.447926 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139bb15-2c97-451e-9aa9-8b0c46fcc1ba None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:40.457559 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139bb15-2c97-451e-9aa9-8b0c46fcc1ba None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:40.462145 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a830d2-0df5-4394-9f09-466b892dbda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:40.462840 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a830d2-0df5-4394-9f09-466b892dbda4 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:40.463122 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a830d2-0df5-4394-9f09-466b892dbda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:40.463393 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a830d2-0df5-4394-9f09-466b892dbda4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:40.464116 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a830d2-0df5-4394-9f09-466b892dbda4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:57:40.464421 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a830d2-0df5-4394-9f09-466b892dbda4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:40.466013 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a830d2-0df5-4394-9f09-466b892dbda4 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:40.477847 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1345/2690] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:57:40.481922 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0689692-5d17-44e9-a3d5-94d3bf3ea433 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:40.491818 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0689692-5d17-44e9-a3d5-94d3bf3ea433 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:40.496468 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a823c0-ff8b-4fe6-ae73-2b3d63afe011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:40.497047 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a823c0-ff8b-4fe6-ae73-2b3d63afe011 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:40.497327 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a823c0-ff8b-4fe6-ae73-2b3d63afe011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:40.497603 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a823c0-ff8b-4fe6-ae73-2b3d63afe011 admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:40.498286 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a823c0-ff8b-4fe6-ae73-2b3d63afe011 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:40.500211 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a823c0-ff8b-4fe6-ae73-2b3d63afe011 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:40.525805 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1346/2691] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:57:40 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:57:40.529768 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a830d2-0df5-4394-9f09-466b892dbda4 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:40.540689 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a830d2-0df5-4394-9f09-466b892dbda4 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:40.593983 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb54bb4-bc84-4a66-b0b9-aa985286fc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:40.594660 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb54bb4-bc84-4a66-b0b9-aa985286fc11 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:40.595009 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb54bb4-bc84-4a66-b0b9-aa985286fc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:40.595284 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb54bb4-bc84-4a66-b0b9-aa985286fc11 admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:40.596451 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb54bb4-bc84-4a66-b0b9-aa985286fc11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:40.598356 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb54bb4-bc84-4a66-b0b9-aa985286fc11 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:40.618473 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1346/2692] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:57:40 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:57:40.622556 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a823c0-ff8b-4fe6-ae73-2b3d63afe011 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:40.632806 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a823c0-ff8b-4fe6-ae73-2b3d63afe011 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:40.637701 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb7b5d-9f47-4ef2-8bf5-16239cb08328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:40.638358 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb7b5d-9f47-4ef2-8bf5-16239cb08328 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:40.638661 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb7b5d-9f47-4ef2-8bf5-16239cb08328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:40.638947 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb7b5d-9f47-4ef2-8bf5-16239cb08328 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:40.639661 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb7b5d-9f47-4ef2-8bf5-16239cb08328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:40.641266 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb7b5d-9f47-4ef2-8bf5-16239cb08328 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:40.652286 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1347/2693] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:57:40.656087 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb54bb4-bc84-4a66-b0b9-aa985286fc11 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:40.666248 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb54bb4-bc84-4a66-b0b9-aa985286fc11 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:40.670820 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc65d81-f384-40d6-9853-d343efa86f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:40.671465 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc65d81-f384-40d6-9853-d343efa86f43 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:40.671748 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc65d81-f384-40d6-9853-d343efa86f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:40.672021 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc65d81-f384-40d6-9853-d343efa86f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:40.672737 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc65d81-f384-40d6-9853-d343efa86f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:40.675043 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc65d81-f384-40d6-9853-d343efa86f43 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:40.684738 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1347/2694] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:57:40.688652 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb7b5d-9f47-4ef2-8bf5-16239cb08328 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:40.698482 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb7b5d-9f47-4ef2-8bf5-16239cb08328 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:40.703119 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2284e-4f0d-4f83-81b3-abb90291b608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:40.703989 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2284e-4f0d-4f83-81b3-abb90291b608 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:40.704272 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2284e-4f0d-4f83-81b3-abb90291b608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:40.704547 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2284e-4f0d-4f83-81b3-abb90291b608 admin admin] PATH_INFO: `/v3/projects/4bfd608494e3461ca37b3b465d8500ff/users/ced80aa6ab2b4c459d41fbec39574b13/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:40.718779 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2284e-4f0d-4f83-81b3-abb90291b608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bfd608494e3461ca37b3b465d8500ff, user_id=ced80aa6ab2b4c459d41fbec39574b13, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:40.721974 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2284e-4f0d-4f83-81b3-abb90291b608 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:40.735329 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1348/2695] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:57:40 2022] PUT /identity/v3/projects/4bfd608494e3461ca37b3b465d8500ff/users/ced80aa6ab2b4c459d41fbec39574b13/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:57:40.747461 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743fbe8-87ba-4267-a5c3-d44e03bb89ef None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:40.747905 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743fbe8-87ba-4267-a5c3-d44e03bb89ef None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:40.748016 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743fbe8-87ba-4267-a5c3-d44e03bb89ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:40.774469 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-c743fbe8-87ba-4267-a5c3-d44e03bb89ef None None] MFA Rules not processed for user `ced80aa6ab2b4c459d41fbec39574b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:57:40.775721 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-c743fbe8-87ba-4267-a5c3-d44e03bb89ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:40.838998 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1348/2696] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:57:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:57:40.843409 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2284e-4f0d-4f83-81b3-abb90291b608 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:40.909692 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2284e-4f0d-4f83-81b3-abb90291b608 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:40.914337 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39007ea6-36d1-4b5a-81c6-4108e4d150ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:40.915061 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39007ea6-36d1-4b5a-81c6-4108e4d150ba admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:40.915393 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39007ea6-36d1-4b5a-81c6-4108e4d150ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:40.915682 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39007ea6-36d1-4b5a-81c6-4108e4d150ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:40.916332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39007ea6-36d1-4b5a-81c6-4108e4d150ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:40.918925 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39007ea6-36d1-4b5a-81c6-4108e4d150ba admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:40.924503 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:57:40.951896 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1349/2697] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:57:40 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:57:40.953065 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743fbe8-87ba-4267-a5c3-d44e03bb89ef None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:40.964475 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743fbe8-87ba-4267-a5c3-d44e03bb89ef None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:40.969240 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:57:41.024251 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a569cf-f7ca-4689-8216-f0b20ca0e30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:41.024842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a569cf-f7ca-4689-8216-f0b20ca0e30b admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:41.025128 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a569cf-f7ca-4689-8216-f0b20ca0e30b admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:41.025408 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a569cf-f7ca-4689-8216-f0b20ca0e30b admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:41.026104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a569cf-f7ca-4689-8216-f0b20ca0e30b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:41.028067 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a569cf-f7ca-4689-8216-f0b20ca0e30b admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:41.052281 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1349/2698] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:57:40 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:57:41.053472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39007ea6-36d1-4b5a-81c6-4108e4d150ba admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:41.063545 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39007ea6-36d1-4b5a-81c6-4108e4d150ba admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:41.068061 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44671c18-dc8c-4fd0-ba4e-2b22283330ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:41.068707 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44671c18-dc8c-4fd0-ba4e-2b22283330ea admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:41.068988 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44671c18-dc8c-4fd0-ba4e-2b22283330ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:41.069261 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44671c18-dc8c-4fd0-ba4e-2b22283330ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:41.069976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44671c18-dc8c-4fd0-ba4e-2b22283330ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:41.071598 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44671c18-dc8c-4fd0-ba4e-2b22283330ea admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:41.082242 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1350/2699] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:57:41.086007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a569cf-f7ca-4689-8216-f0b20ca0e30b admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:41.097747 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a569cf-f7ca-4689-8216-f0b20ca0e30b admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:41.102938 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925d6be-a4f3-43b6-a805-f5003f1debe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:41.103160 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925d6be-a4f3-43b6-a805-f5003f1debe0 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:41.103450 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925d6be-a4f3-43b6-a805-f5003f1debe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:41.103723 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925d6be-a4f3-43b6-a805-f5003f1debe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:41.104454 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925d6be-a4f3-43b6-a805-f5003f1debe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:41.107216 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925d6be-a4f3-43b6-a805-f5003f1debe0 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:41.117469 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1350/2700] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:57:41.121618 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44671c18-dc8c-4fd0-ba4e-2b22283330ea admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:41.132178 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44671c18-dc8c-4fd0-ba4e-2b22283330ea admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:41.136740 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241b247-0c26-4e09-b7f9-8dd2e44bdafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:41.137605 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241b247-0c26-4e09-b7f9-8dd2e44bdafa admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:41.137882 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241b247-0c26-4e09-b7f9-8dd2e44bdafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:41.138154 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241b247-0c26-4e09-b7f9-8dd2e44bdafa admin admin] PATH_INFO: `/v3/projects/b49cee525821401d92e8fd8e37329f0b/users/37a57b68a0f9446289ccf474a0dd734a/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:41.153611 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241b247-0c26-4e09-b7f9-8dd2e44bdafa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b49cee525821401d92e8fd8e37329f0b, user_id=37a57b68a0f9446289ccf474a0dd734a, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:41.156315 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241b247-0c26-4e09-b7f9-8dd2e44bdafa admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:41.168488 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1351/2701] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:57:41 2022] PUT /identity/v3/projects/b49cee525821401d92e8fd8e37329f0b/users/37a57b68a0f9446289ccf474a0dd734a/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:57:41.178367 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66d1c4-c87a-48b7-96df-571c128b1ae9 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:41.178693 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66d1c4-c87a-48b7-96df-571c128b1ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:41.178985 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66d1c4-c87a-48b7-96df-571c128b1ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:41.207162 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-fe66d1c4-c87a-48b7-96df-571c128b1ae9 None None] MFA Rules not processed for user `37a57b68a0f9446289ccf474a0dd734a`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:57:41.208378 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-fe66d1c4-c87a-48b7-96df-571c128b1ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:41.271302 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1351/2702] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:57:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:57:41.275700 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241b247-0c26-4e09-b7f9-8dd2e44bdafa admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:41.336058 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241b247-0c26-4e09-b7f9-8dd2e44bdafa admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:41.340685 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56b14e-6de7-44fc-8fd8-1f5e280422b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:41.341336 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56b14e-6de7-44fc-8fd8-1f5e280422b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:41.341618 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56b14e-6de7-44fc-8fd8-1f5e280422b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:41.341893 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56b14e-6de7-44fc-8fd8-1f5e280422b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:41.342572 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56b14e-6de7-44fc-8fd8-1f5e280422b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:41.344517 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56b14e-6de7-44fc-8fd8-1f5e280422b8 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:41.369572 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1352/2703] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:57:41 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:57:41.373731 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66d1c4-c87a-48b7-96df-571c128b1ae9 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:41.385183 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66d1c4-c87a-48b7-96df-571c128b1ae9 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:41.441645 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c44446-c2c6-426f-8655-10c793d6950f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:41.442313 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c44446-c2c6-426f-8655-10c793d6950f admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:41.442600 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c44446-c2c6-426f-8655-10c793d6950f admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:41.442915 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c44446-c2c6-426f-8655-10c793d6950f admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:41.443621 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c44446-c2c6-426f-8655-10c793d6950f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:41.445575 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c44446-c2c6-426f-8655-10c793d6950f admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:41.465997 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1352/2704] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:57:41 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:57:41.470003 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56b14e-6de7-44fc-8fd8-1f5e280422b8 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:41.480248 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56b14e-6de7-44fc-8fd8-1f5e280422b8 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:41.484847 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dd8f5-9f1b-47e5-bf3e-f5c89a78cec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:41.485496 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dd8f5-9f1b-47e5-bf3e-f5c89a78cec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:41.485777 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dd8f5-9f1b-47e5-bf3e-f5c89a78cec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:41.486051 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dd8f5-9f1b-47e5-bf3e-f5c89a78cec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:41.487323 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83dd8f5-9f1b-47e5-bf3e-f5c89a78cec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:41.488937 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83dd8f5-9f1b-47e5-bf3e-f5c89a78cec4 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:41.499179 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1353/2705] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:57:41.503906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c44446-c2c6-426f-8655-10c793d6950f admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:41.513705 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c44446-c2c6-426f-8655-10c793d6950f admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:41.518428 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48ff61-7ec4-433a-9256-5f2b770860e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:41.519338 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48ff61-7ec4-433a-9256-5f2b770860e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:41.519672 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48ff61-7ec4-433a-9256-5f2b770860e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:41.519987 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48ff61-7ec4-433a-9256-5f2b770860e6 admin admin] PATH_INFO: `/v3/projects/e2d236f2c17048069ed60d3ad6892174/users/caadc0250b3d4cb6bb8510d7ef34ea44/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:41.522319 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:57:41.536823 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48ff61-7ec4-433a-9256-5f2b770860e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2d236f2c17048069ed60d3ad6892174, user_id=caadc0250b3d4cb6bb8510d7ef34ea44, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:41.539473 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48ff61-7ec4-433a-9256-5f2b770860e6 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:41.552482 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1353/2706] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:57:41 2022] PUT /identity/v3/projects/e2d236f2c17048069ed60d3ad6892174/users/caadc0250b3d4cb6bb8510d7ef34ea44/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:57:41.556374 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dd8f5-9f1b-47e5-bf3e-f5c89a78cec4 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:41.566899 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dd8f5-9f1b-47e5-bf3e-f5c89a78cec4 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:41.621990 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241754a-8032-4273-adba-ac3035cbafc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:41.622716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241754a-8032-4273-adba-ac3035cbafc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:41.623178 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241754a-8032-4273-adba-ac3035cbafc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:41.623471 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241754a-8032-4273-adba-ac3035cbafc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:41.623991 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241754a-8032-4273-adba-ac3035cbafc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:41.625632 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241754a-8032-4273-adba-ac3035cbafc2 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:41.636063 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1354/2707] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:57:41.640178 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48ff61-7ec4-433a-9256-5f2b770860e6 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:41.651114 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48ff61-7ec4-433a-9256-5f2b770860e6 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:41.655836 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab1341-2951-454b-95a9-b76c053a066f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:41.657008 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab1341-2951-454b-95a9-b76c053a066f admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:41.657299 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab1341-2951-454b-95a9-b76c053a066f admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:41.657580 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab1341-2951-454b-95a9-b76c053a066f admin admin] PATH_INFO: `/v3/projects/e2d236f2c17048069ed60d3ad6892174/users/caadc0250b3d4cb6bb8510d7ef34ea44/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:41.659601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab1341-2951-454b-95a9-b76c053a066f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2d236f2c17048069ed60d3ad6892174, user_id=caadc0250b3d4cb6bb8510d7ef34ea44, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:41.662252 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab1341-2951-454b-95a9-b76c053a066f admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:41.672625 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1354/2708] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:57:41 2022] PUT /identity/v3/projects/e2d236f2c17048069ed60d3ad6892174/users/caadc0250b3d4cb6bb8510d7ef34ea44/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:57:41.684565 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77220da9-51cd-498b-8797-647b66dfdbee None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:41.684859 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77220da9-51cd-498b-8797-647b66dfdbee None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:41.685163 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77220da9-51cd-498b-8797-647b66dfdbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:41.711309 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-77220da9-51cd-498b-8797-647b66dfdbee None None] MFA Rules not processed for user `caadc0250b3d4cb6bb8510d7ef34ea44`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:57:41.712504 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-77220da9-51cd-498b-8797-647b66dfdbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:41.722020 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:57:41.782599 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1355/2709] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:57:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:57:41.793316 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab1341-2951-454b-95a9-b76c053a066f admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:41.795139 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-78ab1341-2951-454b-95a9-b76c053a066f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:41.851837 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab1341-2951-454b-95a9-b76c053a066f admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:41.855521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338ba1e-6e1a-4770-be49-feab10394176 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:41.856144 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338ba1e-6e1a-4770-be49-feab10394176 service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:41.856431 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338ba1e-6e1a-4770-be49-feab10394176 service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:41.856707 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338ba1e-6e1a-4770-be49-feab10394176 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:41.866371 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338ba1e-6e1a-4770-be49-feab10394176 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:41.867837 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338ba1e-6e1a-4770-be49-feab10394176 service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:41.877782 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1355/2710] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:57:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:57:42.363735 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77220da9-51cd-498b-8797-647b66dfdbee None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:42.365121 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-77220da9-51cd-498b-8797-647b66dfdbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:42.376754 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77220da9-51cd-498b-8797-647b66dfdbee None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:42.381113 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5dc10-4bf3-483c-aa9d-6b2e3497f128 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:42.381748 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5dc10-4bf3-483c-aa9d-6b2e3497f128 service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:42.382029 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5dc10-4bf3-483c-aa9d-6b2e3497f128 service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:42.382302 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5dc10-4bf3-483c-aa9d-6b2e3497f128 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:42.436705 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5dc10-4bf3-483c-aa9d-6b2e3497f128 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:42.438148 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5dc10-4bf3-483c-aa9d-6b2e3497f128 service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:42.447514 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1356/2711] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:57:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:57:45.399997 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338ba1e-6e1a-4770-be49-feab10394176 service cinder] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:45.401471 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-7338ba1e-6e1a-4770-be49-feab10394176 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:45.478396 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338ba1e-6e1a-4770-be49-feab10394176 service cinder] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:45.484062 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb166d-ce66-4168-82f0-d45ded90afcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:45.484727 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb166d-ce66-4168-82f0-d45ded90afcd service nova] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:45.484998 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb166d-ce66-4168-82f0-d45ded90afcd service nova] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:45.485277 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb166d-ce66-4168-82f0-d45ded90afcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:45.487571 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-30bb166d-ce66-4168-82f0-d45ded90afcd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:45.500643 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb166d-ce66-4168-82f0-d45ded90afcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:45.502788 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb166d-ce66-4168-82f0-d45ded90afcd service nova] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:45.514278 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1356/2712] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:57:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:57:46.413882 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5dc10-4bf3-483c-aa9d-6b2e3497f128 service cinder] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:46.423504 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5dc10-4bf3-483c-aa9d-6b2e3497f128 service cinder] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:46.427438 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117bad6-d1a1-40bc-92fe-037fa80d7730 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:46.428073 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117bad6-d1a1-40bc-92fe-037fa80d7730 service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:46.428361 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117bad6-d1a1-40bc-92fe-037fa80d7730 service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:46.428637 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117bad6-d1a1-40bc-92fe-037fa80d7730 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:46.483819 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8117bad6-d1a1-40bc-92fe-037fa80d7730 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:46.485185 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8117bad6-d1a1-40bc-92fe-037fa80d7730 service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:46.494091 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1357/2713] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:57:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:57:48.555842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb166d-ce66-4168-82f0-d45ded90afcd service nova] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:48.617069 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:57:48.621538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb166d-ce66-4168-82f0-d45ded90afcd service nova] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:48.627687 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e390ae0-9fbf-43d1-b1b0-3fb0221fce7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:48.628842 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e390ae0-9fbf-43d1-b1b0-3fb0221fce7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:48.629125 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e390ae0-9fbf-43d1-b1b0-3fb0221fce7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:48.629398 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e390ae0-9fbf-43d1-b1b0-3fb0221fce7d admin admin] PATH_INFO: `/v3/users/ced80aa6ab2b4c459d41fbec39574b13` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:48.630585 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e390ae0-9fbf-43d1-b1b0-3fb0221fce7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ced80aa6ab2b4c459d41fbec39574b13)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:48.632539 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e390ae0-9fbf-43d1-b1b0-3fb0221fce7d admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:48.677514 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-7e390ae0-9fbf-43d1-b1b0-3fb0221fce7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ced80aa6ab2b4c459d41fbec39574b13'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:48.678150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-7e390ae0-9fbf-43d1-b1b0-3fb0221fce7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ced80aa6ab2b4c459d41fbec39574b13'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:48.689683 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-7e390ae0-9fbf-43d1-b1b0-3fb0221fce7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ced80aa6ab2b4c459d41fbec39574b13'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:48.690302 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-7e390ae0-9fbf-43d1-b1b0-3fb0221fce7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ced80aa6ab2b4c459d41fbec39574b13'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:48.697521 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-7e390ae0-9fbf-43d1-b1b0-3fb0221fce7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ced80aa6ab2b4c459d41fbec39574b13'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:48.709627 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1357/2714] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:57:48 2022] DELETE /identity/v3/users/ced80aa6ab2b4c459d41fbec39574b13 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:57:48.714174 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1ede8-21bf-4609-8f8b-f01b03eeb34b None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:48.714707 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1ede8-21bf-4609-8f8b-f01b03eeb34b None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:48.714820 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1ede8-21bf-4609-8f8b-f01b03eeb34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:48.732731 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-26a1ede8-21bf-4609-8f8b-f01b03eeb34b None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:57:48.733919 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-26a1ede8-21bf-4609-8f8b-f01b03eeb34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:48.778131 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=100 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:57:48.800170 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1358/2715] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:57:48.809502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e390ae0-9fbf-43d1-b1b0-3fb0221fce7d admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:48.810919 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-7e390ae0-9fbf-43d1-b1b0-3fb0221fce7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:48.866886 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e390ae0-9fbf-43d1-b1b0-3fb0221fce7d admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:48.870508 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a763cee-8bcd-4c81-aa54-9cb2cdf6ea81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:48.871179 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a763cee-8bcd-4c81-aa54-9cb2cdf6ea81 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:48.871465 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a763cee-8bcd-4c81-aa54-9cb2cdf6ea81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:48.871742 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a763cee-8bcd-4c81-aa54-9cb2cdf6ea81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:48.880864 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a763cee-8bcd-4c81-aa54-9cb2cdf6ea81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:48.882287 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a763cee-8bcd-4c81-aa54-9cb2cdf6ea81 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:48.891581 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1358/2716] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:57:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:57:49.153992 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1ede8-21bf-4609-8f8b-f01b03eeb34b None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:49.155597 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-26a1ede8-21bf-4609-8f8b-f01b03eeb34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:49.168205 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1ede8-21bf-4609-8f8b-f01b03eeb34b None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:49.172894 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71750c0-7bba-496e-9d11-68b1ac75067e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:49.173751 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71750c0-7bba-496e-9d11-68b1ac75067e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:49.174026 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71750c0-7bba-496e-9d11-68b1ac75067e admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:49.174300 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71750c0-7bba-496e-9d11-68b1ac75067e admin admin] PATH_INFO: `/v3/projects/4bfd608494e3461ca37b3b465d8500ff` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:49.175480 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71750c0-7bba-496e-9d11-68b1ac75067e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bfd608494e3461ca37b3b465d8500ff)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:49.177411 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71750c0-7bba-496e-9d11-68b1ac75067e admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:49.224580 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-f71750c0-7bba-496e-9d11-68b1ac75067e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bfd608494e3461ca37b3b465d8500ff', 'request_id': 'req-f71750c0-7bba-496e-9d11-68b1ac75067e'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:49.230964 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-f71750c0-7bba-496e-9d11-68b1ac75067e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bfd608494e3461ca37b3b465d8500ff', 'request_id': 'req-f71750c0-7bba-496e-9d11-68b1ac75067e'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:49.236998 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-f71750c0-7bba-496e-9d11-68b1ac75067e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bfd608494e3461ca37b3b465d8500ff', 'request_id': 'req-f71750c0-7bba-496e-9d11-68b1ac75067e'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:49.248985 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-f71750c0-7bba-496e-9d11-68b1ac75067e admin admin] The token cache is being invalidate because project 4bfd608494e3461ca37b3b465d8500ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:57:49.249271 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-f71750c0-7bba-496e-9d11-68b1ac75067e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:49.249884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-f71750c0-7bba-496e-9d11-68b1ac75067e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:49.251449 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1359/2717] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:57:49 2022] DELETE /identity/v3/projects/4bfd608494e3461ca37b3b465d8500ff => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:57:49.255636 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a763cee-8bcd-4c81-aa54-9cb2cdf6ea81 service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:49.264963 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a763cee-8bcd-4c81-aa54-9cb2cdf6ea81 service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:49.319547 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed593115-5fa5-4422-b7f0-cc6a06969d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:49.320336 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed593115-5fa5-4422-b7f0-cc6a06969d7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:49.320619 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed593115-5fa5-4422-b7f0-cc6a06969d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:49.320897 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed593115-5fa5-4422-b7f0-cc6a06969d7a admin admin] PATH_INFO: `/v3/users/37a57b68a0f9446289ccf474a0dd734a` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:49.322081 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed593115-5fa5-4422-b7f0-cc6a06969d7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=37a57b68a0f9446289ccf474a0dd734a)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:49.324034 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed593115-5fa5-4422-b7f0-cc6a06969d7a admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:49.346099 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:57:49.370276 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ed593115-5fa5-4422-b7f0-cc6a06969d7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37a57b68a0f9446289ccf474a0dd734a'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:49.370958 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ed593115-5fa5-4422-b7f0-cc6a06969d7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37a57b68a0f9446289ccf474a0dd734a'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:49.383250 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ed593115-5fa5-4422-b7f0-cc6a06969d7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37a57b68a0f9446289ccf474a0dd734a'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:49.383879 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ed593115-5fa5-4422-b7f0-cc6a06969d7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37a57b68a0f9446289ccf474a0dd734a'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:49.390792 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-ed593115-5fa5-4422-b7f0-cc6a06969d7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37a57b68a0f9446289ccf474a0dd734a'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:49.403254 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1359/2718] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:57:49 2022] DELETE /identity/v3/users/37a57b68a0f9446289ccf474a0dd734a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:57:49.670966 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71750c0-7bba-496e-9d11-68b1ac75067e admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:49.672463 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-f71750c0-7bba-496e-9d11-68b1ac75067e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:49.685683 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71750c0-7bba-496e-9d11-68b1ac75067e admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:49.743649 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce3710-21df-4ca2-a73c-5730726e1a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:49.744523 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce3710-21df-4ca2-a73c-5730726e1a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:49.744809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce3710-21df-4ca2-a73c-5730726e1a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:49.745082 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce3710-21df-4ca2-a73c-5730726e1a0b admin admin] PATH_INFO: `/v3/projects/b49cee525821401d92e8fd8e37329f0b` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:49.746281 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce3710-21df-4ca2-a73c-5730726e1a0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b49cee525821401d92e8fd8e37329f0b)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:49.748233 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce3710-21df-4ca2-a73c-5730726e1a0b admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:49.794094 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-93ce3710-21df-4ca2-a73c-5730726e1a0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b49cee525821401d92e8fd8e37329f0b', 'request_id': 'req-93ce3710-21df-4ca2-a73c-5730726e1a0b'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:49.800564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-93ce3710-21df-4ca2-a73c-5730726e1a0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b49cee525821401d92e8fd8e37329f0b', 'request_id': 'req-93ce3710-21df-4ca2-a73c-5730726e1a0b'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:49.807012 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-93ce3710-21df-4ca2-a73c-5730726e1a0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b49cee525821401d92e8fd8e37329f0b', 'request_id': 'req-93ce3710-21df-4ca2-a73c-5730726e1a0b'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:49.819044 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:57:49.823997 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-93ce3710-21df-4ca2-a73c-5730726e1a0b admin admin] The token cache is being invalidate because project b49cee525821401d92e8fd8e37329f0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:57:49.824522 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-93ce3710-21df-4ca2-a73c-5730726e1a0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:49.825770 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-93ce3710-21df-4ca2-a73c-5730726e1a0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:49.830651 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1360/2719] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:57:49 2022] DELETE /identity/v3/projects/b49cee525821401d92e8fd8e37329f0b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:57:49.832209 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed593115-5fa5-4422-b7f0-cc6a06969d7a admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:49.834423 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-ed593115-5fa5-4422-b7f0-cc6a06969d7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:49.847397 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed593115-5fa5-4422-b7f0-cc6a06969d7a admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:49.907262 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79d8d4-b851-42ec-b85c-ae11f00173d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:49.908131 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79d8d4-b851-42ec-b85c-ae11f00173d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:49.908415 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79d8d4-b851-42ec-b85c-ae11f00173d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:49.908690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79d8d4-b851-42ec-b85c-ae11f00173d3 admin admin] PATH_INFO: `/v3/users/caadc0250b3d4cb6bb8510d7ef34ea44` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:49.909877 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79d8d4-b851-42ec-b85c-ae11f00173d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caadc0250b3d4cb6bb8510d7ef34ea44)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:49.911864 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79d8d4-b851-42ec-b85c-ae11f00173d3 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:49.958420 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-7c79d8d4-b851-42ec-b85c-ae11f00173d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caadc0250b3d4cb6bb8510d7ef34ea44'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:49.959110 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-7c79d8d4-b851-42ec-b85c-ae11f00173d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caadc0250b3d4cb6bb8510d7ef34ea44'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:49.970956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-7c79d8d4-b851-42ec-b85c-ae11f00173d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caadc0250b3d4cb6bb8510d7ef34ea44'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:49.971624 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-7c79d8d4-b851-42ec-b85c-ae11f00173d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caadc0250b3d4cb6bb8510d7ef34ea44'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:49.978601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-7c79d8d4-b851-42ec-b85c-ae11f00173d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caadc0250b3d4cb6bb8510d7ef34ea44'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:49.991262 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1360/2720] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:57:49 2022] DELETE /identity/v3/users/caadc0250b3d4cb6bb8510d7ef34ea44 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:57:50.262483 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce3710-21df-4ca2-a73c-5730726e1a0b admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:50.264000 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-93ce3710-21df-4ca2-a73c-5730726e1a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:50.281870 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce3710-21df-4ca2-a73c-5730726e1a0b admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:50.340085 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2439a2b-5fe8-4fd5-912d-7be92139926e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:50.340945 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2439a2b-5fe8-4fd5-912d-7be92139926e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:50.341225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2439a2b-5fe8-4fd5-912d-7be92139926e admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:50.341516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2439a2b-5fe8-4fd5-912d-7be92139926e admin admin] PATH_INFO: `/v3/projects/e2d236f2c17048069ed60d3ad6892174` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:50.342679 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2439a2b-5fe8-4fd5-912d-7be92139926e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2d236f2c17048069ed60d3ad6892174)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:50.344582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2439a2b-5fe8-4fd5-912d-7be92139926e admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:50.388609 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e2439a2b-5fe8-4fd5-912d-7be92139926e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2d236f2c17048069ed60d3ad6892174', 'request_id': 'req-e2439a2b-5fe8-4fd5-912d-7be92139926e'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:50.394986 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e2439a2b-5fe8-4fd5-912d-7be92139926e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2d236f2c17048069ed60d3ad6892174', 'request_id': 'req-e2439a2b-5fe8-4fd5-912d-7be92139926e'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:50.400354 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e2439a2b-5fe8-4fd5-912d-7be92139926e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2d236f2c17048069ed60d3ad6892174', 'request_id': 'req-e2439a2b-5fe8-4fd5-912d-7be92139926e'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:50.412177 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e2439a2b-5fe8-4fd5-912d-7be92139926e admin admin] The token cache is being invalidate because project e2d236f2c17048069ed60d3ad6892174 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:57:50.412465 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e2439a2b-5fe8-4fd5-912d-7be92139926e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:50.413077 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e2439a2b-5fe8-4fd5-912d-7be92139926e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:50.414584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1361/2721] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:57:50 2022] DELETE /identity/v3/projects/e2d236f2c17048069ed60d3ad6892174 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:57:50.420509 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11a4ca-7058-4f8f-bdb0-36305837ae3f None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:50.420800 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11a4ca-7058-4f8f-bdb0-36305837ae3f None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:50.421076 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11a4ca-7058-4f8f-bdb0-36305837ae3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:50.438234 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-da11a4ca-7058-4f8f-bdb0-36305837ae3f None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:57:50.440008 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-da11a4ca-7058-4f8f-bdb0-36305837ae3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:50.452024 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:57:50.508614 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1361/2722] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:57:50.516651 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73889b52-fb90-49a5-9fb4-160071c07bb4 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:50.516937 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73889b52-fb90-49a5-9fb4-160071c07bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:50.517215 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73889b52-fb90-49a5-9fb4-160071c07bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:50.535366 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-73889b52-fb90-49a5-9fb4-160071c07bb4 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:57:50.536575 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-73889b52-fb90-49a5-9fb4-160071c07bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:50.544283 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1362/2723] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:57:50.548999 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11a4ca-7058-4f8f-bdb0-36305837ae3f None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:50.558377 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11a4ca-7058-4f8f-bdb0-36305837ae3f None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:50.562901 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1519a4-0f2b-486e-a371-b41b3ab53800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:50.563547 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1519a4-0f2b-486e-a371-b41b3ab53800 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:50.563830 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1519a4-0f2b-486e-a371-b41b3ab53800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:50.564731 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1519a4-0f2b-486e-a371-b41b3ab53800 admin admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:50.565442 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1519a4-0f2b-486e-a371-b41b3ab53800 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:57:50.565746 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1519a4-0f2b-486e-a371-b41b3ab53800 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:50.567358 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1519a4-0f2b-486e-a371-b41b3ab53800 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:50.578517 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1362/2724] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:57:50.582616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73889b52-fb90-49a5-9fb4-160071c07bb4 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:50.591721 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73889b52-fb90-49a5-9fb4-160071c07bb4 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:50.596264 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2618ba-df27-4f00-b0b1-132d3062671a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:50.596906 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2618ba-df27-4f00-b0b1-132d3062671a admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:50.597189 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2618ba-df27-4f00-b0b1-132d3062671a admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:50.597464 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2618ba-df27-4f00-b0b1-132d3062671a admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:50.598153 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2618ba-df27-4f00-b0b1-132d3062671a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:50.600098 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2618ba-df27-4f00-b0b1-132d3062671a admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:50.625152 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1363/2725] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:57:50 2022] POST /identity/v3/projects => generated 361 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:57:50.629751 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1519a4-0f2b-486e-a371-b41b3ab53800 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:50.639674 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1519a4-0f2b-486e-a371-b41b3ab53800 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:50.695111 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b39b52-32df-4920-824d-1ddc9ade439a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:50.695766 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b39b52-32df-4920-824d-1ddc9ade439a admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:50.696047 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b39b52-32df-4920-824d-1ddc9ade439a admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:50.696321 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b39b52-32df-4920-824d-1ddc9ade439a admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:50.697005 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b39b52-32df-4920-824d-1ddc9ade439a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:50.698925 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b39b52-32df-4920-824d-1ddc9ade439a admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:50.718089 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1363/2726] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:57:50 2022] POST /identity/v3/users => generated 281 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:57:50.721995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2618ba-df27-4f00-b0b1-132d3062671a admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:50.732592 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2618ba-df27-4f00-b0b1-132d3062671a admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:50.737859 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaaa60b-a882-4f5b-ac6f-dfb4c418eb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:50.738516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaaa60b-a882-4f5b-ac6f-dfb4c418eb05 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:50.738834 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaaa60b-a882-4f5b-ac6f-dfb4c418eb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:50.739114 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaaa60b-a882-4f5b-ac6f-dfb4c418eb05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:50.739833 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaaa60b-a882-4f5b-ac6f-dfb4c418eb05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:50.741454 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaaa60b-a882-4f5b-ac6f-dfb4c418eb05 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:50.752413 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1364/2727] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:57:50.756685 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b39b52-32df-4920-824d-1ddc9ade439a admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:50.766422 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b39b52-32df-4920-824d-1ddc9ade439a admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:50.770948 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a758e4-635c-4e93-8c03-d113f8938624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:50.771594 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a758e4-635c-4e93-8c03-d113f8938624 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:50.771875 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a758e4-635c-4e93-8c03-d113f8938624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:50.772149 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a758e4-635c-4e93-8c03-d113f8938624 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:50.772866 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a758e4-635c-4e93-8c03-d113f8938624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:50.774448 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a758e4-635c-4e93-8c03-d113f8938624 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:50.784189 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1364/2728] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:57:50.788033 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaaa60b-a882-4f5b-ac6f-dfb4c418eb05 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:50.797739 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaaa60b-a882-4f5b-ac6f-dfb4c418eb05 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:50.802830 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5ea45-4e99-45da-856a-a53934f8a72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:50.803700 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5ea45-4e99-45da-856a-a53934f8a72c admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:50.803984 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5ea45-4e99-45da-856a-a53934f8a72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:50.804256 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5ea45-4e99-45da-856a-a53934f8a72c admin admin] PATH_INFO: `/v3/projects/9cde7909ec334356a0702267f274b5e0/users/5f60a8b1780e48dc9c3b3ae1ea40df2e/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:50.819095 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5ea45-4e99-45da-856a-a53934f8a72c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cde7909ec334356a0702267f274b5e0, user_id=5f60a8b1780e48dc9c3b3ae1ea40df2e, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:50.821797 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5ea45-4e99-45da-856a-a53934f8a72c admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:50.839590 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1365/2729] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:57:50 2022] PUT /identity/v3/projects/9cde7909ec334356a0702267f274b5e0/users/5f60a8b1780e48dc9c3b3ae1ea40df2e/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:57:50.851234 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a286f-8481-408c-ad2b-e8d7f04ecf93 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:50.851748 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a286f-8481-408c-ad2b-e8d7f04ecf93 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:50.851838 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a286f-8481-408c-ad2b-e8d7f04ecf93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:50.882828 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-809a286f-8481-408c-ad2b-e8d7f04ecf93 None None] MFA Rules not processed for user `5f60a8b1780e48dc9c3b3ae1ea40df2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:57:50.884128 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-809a286f-8481-408c-ad2b-e8d7f04ecf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:50.954641 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1365/2730] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:57:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:57:50.984683 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5ea45-4e99-45da-856a-a53934f8a72c admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:50.987041 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-3ca5ea45-4e99-45da-856a-a53934f8a72c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:51.014876 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:57:51.045329 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5ea45-4e99-45da-856a-a53934f8a72c admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:51.049616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976baa34-caef-4756-9afa-5976878c4c34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:51.050256 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976baa34-caef-4756-9afa-5976878c4c34 service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:51.050543 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976baa34-caef-4756-9afa-5976878c4c34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:51.050854 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976baa34-caef-4756-9afa-5976878c4c34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:51.059390 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976baa34-caef-4756-9afa-5976878c4c34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:51.060838 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976baa34-caef-4756-9afa-5976878c4c34 service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:51.069625 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1366/2731] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:57:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:57:51.083530 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a286f-8481-408c-ad2b-e8d7f04ecf93 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:51.096994 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:57:51.146783 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a286f-8481-408c-ad2b-e8d7f04ecf93 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:51.151354 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36edbc2-beb1-47de-8cfe-5a741492bb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:51.152220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36edbc2-beb1-47de-8cfe-5a741492bb3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:51.152506 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36edbc2-beb1-47de-8cfe-5a741492bb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:51.152785 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36edbc2-beb1-47de-8cfe-5a741492bb3f admin admin] PATH_INFO: `/v3/users/5f60a8b1780e48dc9c3b3ae1ea40df2e` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:51.154233 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36edbc2-beb1-47de-8cfe-5a741492bb3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f60a8b1780e48dc9c3b3ae1ea40df2e)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:51.156565 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36edbc2-beb1-47de-8cfe-5a741492bb3f admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:51.204816 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d36edbc2-beb1-47de-8cfe-5a741492bb3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f60a8b1780e48dc9c3b3ae1ea40df2e'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:51.205503 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d36edbc2-beb1-47de-8cfe-5a741492bb3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f60a8b1780e48dc9c3b3ae1ea40df2e'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:51.217286 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d36edbc2-beb1-47de-8cfe-5a741492bb3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f60a8b1780e48dc9c3b3ae1ea40df2e'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:51.217944 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d36edbc2-beb1-47de-8cfe-5a741492bb3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f60a8b1780e48dc9c3b3ae1ea40df2e'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:51.225716 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d36edbc2-beb1-47de-8cfe-5a741492bb3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f60a8b1780e48dc9c3b3ae1ea40df2e'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:51.238661 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1366/2732] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:57:51 2022] DELETE /identity/v3/users/5f60a8b1780e48dc9c3b3ae1ea40df2e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:57:51.243340 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e234ee-2d76-4469-ad82-714a2ecc796b None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:51.243629 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e234ee-2d76-4469-ad82-714a2ecc796b None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:51.243901 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e234ee-2d76-4469-ad82-714a2ecc796b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:51.261067 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-51e234ee-2d76-4469-ad82-714a2ecc796b None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:57:51.262247 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-51e234ee-2d76-4469-ad82-714a2ecc796b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:51.319645 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1367/2733] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:57:51.329115 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36edbc2-beb1-47de-8cfe-5a741492bb3f admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:51.331030 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-d36edbc2-beb1-47de-8cfe-5a741492bb3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:51.386686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36edbc2-beb1-47de-8cfe-5a741492bb3f admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:51.390216 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af67e47-ef3d-4746-adfe-d6fb39109ed5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:51.390881 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af67e47-ef3d-4746-adfe-d6fb39109ed5 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:51.391163 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af67e47-ef3d-4746-adfe-d6fb39109ed5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:51.391435 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af67e47-ef3d-4746-adfe-d6fb39109ed5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:51.400737 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af67e47-ef3d-4746-adfe-d6fb39109ed5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:51.402101 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af67e47-ef3d-4746-adfe-d6fb39109ed5 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:51.411960 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1367/2734] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:57:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:57:51.676441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e234ee-2d76-4469-ad82-714a2ecc796b None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:51.677887 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-51e234ee-2d76-4469-ad82-714a2ecc796b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:51.692033 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e234ee-2d76-4469-ad82-714a2ecc796b None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:51.696855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ea833-2ebb-4991-8def-fa512accd745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:51.697904 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ea833-2ebb-4991-8def-fa512accd745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:51.698190 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ea833-2ebb-4991-8def-fa512accd745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:51.698466 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ea833-2ebb-4991-8def-fa512accd745 admin admin] PATH_INFO: `/v3/projects/9cde7909ec334356a0702267f274b5e0` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:51.699716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ea833-2ebb-4991-8def-fa512accd745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cde7909ec334356a0702267f274b5e0)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:51.701668 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ea833-2ebb-4991-8def-fa512accd745 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:51.752559 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e14ea833-2ebb-4991-8def-fa512accd745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cde7909ec334356a0702267f274b5e0', 'request_id': 'req-e14ea833-2ebb-4991-8def-fa512accd745'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:51.758891 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e14ea833-2ebb-4991-8def-fa512accd745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cde7909ec334356a0702267f274b5e0', 'request_id': 'req-e14ea833-2ebb-4991-8def-fa512accd745'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:51.764347 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e14ea833-2ebb-4991-8def-fa512accd745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cde7909ec334356a0702267f274b5e0', 'request_id': 'req-e14ea833-2ebb-4991-8def-fa512accd745'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:51.777429 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e14ea833-2ebb-4991-8def-fa512accd745 admin admin] The token cache is being invalidate because project 9cde7909ec334356a0702267f274b5e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:57:51.777712 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e14ea833-2ebb-4991-8def-fa512accd745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:51.778314 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-e14ea833-2ebb-4991-8def-fa512accd745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:51.779855 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1368/2735] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:57:51 2022] DELETE /identity/v3/projects/9cde7909ec334356a0702267f274b5e0 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:57:51.785742 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363f3a9-9a3c-4f91-b203-c0644e15a626 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:51.786028 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363f3a9-9a3c-4f91-b203-c0644e15a626 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:51.786303 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363f3a9-9a3c-4f91-b203-c0644e15a626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:51.803397 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-0363f3a9-9a3c-4f91-b203-c0644e15a626 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:57:51.804572 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-0363f3a9-9a3c-4f91-b203-c0644e15a626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:51.834548 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:57:51.864352 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1368/2736] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:57:51.873105 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425de325-240b-4435-9a71-3075b5b22906 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:51.873400 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425de325-240b-4435-9a71-3075b5b22906 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:51.873684 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425de325-240b-4435-9a71-3075b5b22906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:51.893125 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-425de325-240b-4435-9a71-3075b5b22906 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:57:51.894318 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-425de325-240b-4435-9a71-3075b5b22906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:51.902159 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1369/2737] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:57:51.906220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363f3a9-9a3c-4f91-b203-c0644e15a626 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:51.915893 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363f3a9-9a3c-4f91-b203-c0644e15a626 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:51.920546 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03adbe4b-724a-40aa-bf52-b00491fdc08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:51.921143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03adbe4b-724a-40aa-bf52-b00491fdc08f admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:51.921429 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03adbe4b-724a-40aa-bf52-b00491fdc08f admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:51.921703 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03adbe4b-724a-40aa-bf52-b00491fdc08f admin admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:51.922457 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03adbe4b-724a-40aa-bf52-b00491fdc08f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:57:51.922797 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03adbe4b-724a-40aa-bf52-b00491fdc08f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:51.924412 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03adbe4b-724a-40aa-bf52-b00491fdc08f admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:51.935982 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1369/2738] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:57:51.940758 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425de325-240b-4435-9a71-3075b5b22906 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:51.950235 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425de325-240b-4435-9a71-3075b5b22906 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:51.955578 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f401b-9ae4-4f75-a18f-90cb20dc166b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:51.956231 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f401b-9ae4-4f75-a18f-90cb20dc166b admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:51.956538 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f401b-9ae4-4f75-a18f-90cb20dc166b admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:51.956813 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f401b-9ae4-4f75-a18f-90cb20dc166b admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:51.957504 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f401b-9ae4-4f75-a18f-90cb20dc166b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:51.959426 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f401b-9ae4-4f75-a18f-90cb20dc166b admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:51.987429 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1370/2739] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:57:51 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:57:51.988565 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03adbe4b-724a-40aa-bf52-b00491fdc08f admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:51.998353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03adbe4b-724a-40aa-bf52-b00491fdc08f admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:52.053011 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa87dcc-5088-4747-bb10-f7b7d13acd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:52.053678 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa87dcc-5088-4747-bb10-f7b7d13acd33 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:52.053961 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa87dcc-5088-4747-bb10-f7b7d13acd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:52.054236 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa87dcc-5088-4747-bb10-f7b7d13acd33 admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:52.054994 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa87dcc-5088-4747-bb10-f7b7d13acd33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:52.056930 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa87dcc-5088-4747-bb10-f7b7d13acd33 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:52.076035 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1370/2740] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:57:51 2022] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:57:52.080004 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f401b-9ae4-4f75-a18f-90cb20dc166b admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:52.089974 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f401b-9ae4-4f75-a18f-90cb20dc166b admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:52.094409 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccded986-6d66-4b8d-bb3c-2cc63d35cc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:52.095094 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccded986-6d66-4b8d-bb3c-2cc63d35cc14 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:52.095417 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccded986-6d66-4b8d-bb3c-2cc63d35cc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:52.095691 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccded986-6d66-4b8d-bb3c-2cc63d35cc14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:52.096401 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccded986-6d66-4b8d-bb3c-2cc63d35cc14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:52.097994 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccded986-6d66-4b8d-bb3c-2cc63d35cc14 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:52.108000 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1371/2741] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:57:52.112075 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa87dcc-5088-4747-bb10-f7b7d13acd33 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:52.121761 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa87dcc-5088-4747-bb10-f7b7d13acd33 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:52.126300 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a963b-c7c6-48f3-b166-44350c134f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:52.127533 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a963b-c7c6-48f3-b166-44350c134f41 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:52.127819 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a963b-c7c6-48f3-b166-44350c134f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:52.128097 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a963b-c7c6-48f3-b166-44350c134f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:52.129072 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a963b-c7c6-48f3-b166-44350c134f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:52.130668 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a963b-c7c6-48f3-b166-44350c134f41 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:52.140350 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1371/2742] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:57:52.144087 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccded986-6d66-4b8d-bb3c-2cc63d35cc14 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:52.153804 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccded986-6d66-4b8d-bb3c-2cc63d35cc14 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:52.158424 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc871f7b-6b1c-41d8-ba3e-72187df2988c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:52.159325 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc871f7b-6b1c-41d8-ba3e-72187df2988c admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:52.159609 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc871f7b-6b1c-41d8-ba3e-72187df2988c admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:52.159884 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc871f7b-6b1c-41d8-ba3e-72187df2988c admin admin] PATH_INFO: `/v3/projects/ab8f8d12ad894d5c994a6a9ff36b0704/users/fae60ddbe17944c18b3d92bceb0bf511/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:52.167807 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:57:52.177504 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc871f7b-6b1c-41d8-ba3e-72187df2988c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab8f8d12ad894d5c994a6a9ff36b0704, user_id=fae60ddbe17944c18b3d92bceb0bf511, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:52.180747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc871f7b-6b1c-41d8-ba3e-72187df2988c admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:52.194164 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1372/2743] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:57:52 2022] PUT /identity/v3/projects/ab8f8d12ad894d5c994a6a9ff36b0704/users/fae60ddbe17944c18b3d92bceb0bf511/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:57:52.204318 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a327b-e745-46cb-8a98-373ea3ed10a2 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:52.204619 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a327b-e745-46cb-8a98-373ea3ed10a2 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:52.206278 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a327b-e745-46cb-8a98-373ea3ed10a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:52.231060 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-007a327b-e745-46cb-8a98-373ea3ed10a2 None None] MFA Rules not processed for user `fae60ddbe17944c18b3d92bceb0bf511`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:57:52.232633 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-007a327b-e745-46cb-8a98-373ea3ed10a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:52.295416 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1372/2744] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:57:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:57:52.307159 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc871f7b-6b1c-41d8-ba3e-72187df2988c admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:52.308840 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-bc871f7b-6b1c-41d8-ba3e-72187df2988c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:52.363658 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc871f7b-6b1c-41d8-ba3e-72187df2988c admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:52.367211 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06063cdf-a448-404e-899d-575449f1fba1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:52.367842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06063cdf-a448-404e-899d-575449f1fba1 service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:52.368126 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06063cdf-a448-404e-899d-575449f1fba1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:52.368403 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06063cdf-a448-404e-899d-575449f1fba1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:52.376447 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06063cdf-a448-404e-899d-575449f1fba1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:52.378382 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06063cdf-a448-404e-899d-575449f1fba1 service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:52.387475 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1373/2745] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:57:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:57:54.908497 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a327b-e745-46cb-8a98-373ea3ed10a2 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:54.942559 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:57:54.972849 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a327b-e745-46cb-8a98-373ea3ed10a2 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:54.977349 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a8084-5901-4bc9-9278-cbbf42a8ed16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:54.978206 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a8084-5901-4bc9-9278-cbbf42a8ed16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:54.978489 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a8084-5901-4bc9-9278-cbbf42a8ed16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:54.978790 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a8084-5901-4bc9-9278-cbbf42a8ed16 admin admin] PATH_INFO: `/v3/users/fae60ddbe17944c18b3d92bceb0bf511` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:54.979963 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a8084-5901-4bc9-9278-cbbf42a8ed16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fae60ddbe17944c18b3d92bceb0bf511)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:54.981936 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a8084-5901-4bc9-9278-cbbf42a8ed16 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:55.026814 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-dc7a8084-5901-4bc9-9278-cbbf42a8ed16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fae60ddbe17944c18b3d92bceb0bf511'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:55.027452 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-dc7a8084-5901-4bc9-9278-cbbf42a8ed16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fae60ddbe17944c18b3d92bceb0bf511'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:55.039770 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-dc7a8084-5901-4bc9-9278-cbbf42a8ed16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fae60ddbe17944c18b3d92bceb0bf511'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:55.040412 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-dc7a8084-5901-4bc9-9278-cbbf42a8ed16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fae60ddbe17944c18b3d92bceb0bf511'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:55.049477 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-dc7a8084-5901-4bc9-9278-cbbf42a8ed16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fae60ddbe17944c18b3d92bceb0bf511'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:55.062422 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1373/2746] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:57:54 2022] DELETE /identity/v3/users/fae60ddbe17944c18b3d92bceb0bf511 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:57:55.067500 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82779fb-fbd3-4603-84b1-e9700727fee6 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:55.067952 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82779fb-fbd3-4603-84b1-e9700727fee6 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:55.068101 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82779fb-fbd3-4603-84b1-e9700727fee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:55.085239 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-f82779fb-fbd3-4603-84b1-e9700727fee6 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:57:55.086434 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-f82779fb-fbd3-4603-84b1-e9700727fee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:55.145224 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1374/2747] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:57:55.154780 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a8084-5901-4bc9-9278-cbbf42a8ed16 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:55.156163 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-dc7a8084-5901-4bc9-9278-cbbf42a8ed16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:55.212670 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a8084-5901-4bc9-9278-cbbf42a8ed16 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:55.216362 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8665c9e-d826-407b-b75f-84f584a8046d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:55.217009 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8665c9e-d826-407b-b75f-84f584a8046d service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:55.217296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8665c9e-d826-407b-b75f-84f584a8046d service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:55.217575 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8665c9e-d826-407b-b75f-84f584a8046d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:55.226784 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8665c9e-d826-407b-b75f-84f584a8046d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:55.228228 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8665c9e-d826-407b-b75f-84f584a8046d service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:55.238156 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1374/2748] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:57:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:57:55.502631 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82779fb-fbd3-4603-84b1-e9700727fee6 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:55.504396 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-f82779fb-fbd3-4603-84b1-e9700727fee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:55.519052 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82779fb-fbd3-4603-84b1-e9700727fee6 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:55.525091 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568dd9b-76ec-4d1d-85da-372120d88563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:55.525996 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568dd9b-76ec-4d1d-85da-372120d88563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:55.526272 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568dd9b-76ec-4d1d-85da-372120d88563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:55.526543 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568dd9b-76ec-4d1d-85da-372120d88563 admin admin] PATH_INFO: `/v3/projects/ab8f8d12ad894d5c994a6a9ff36b0704` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:55.528076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568dd9b-76ec-4d1d-85da-372120d88563 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab8f8d12ad894d5c994a6a9ff36b0704)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:55.530155 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568dd9b-76ec-4d1d-85da-372120d88563 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:55.576507 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-3568dd9b-76ec-4d1d-85da-372120d88563 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab8f8d12ad894d5c994a6a9ff36b0704', 'request_id': 'req-3568dd9b-76ec-4d1d-85da-372120d88563'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:55.582512 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-3568dd9b-76ec-4d1d-85da-372120d88563 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab8f8d12ad894d5c994a6a9ff36b0704', 'request_id': 'req-3568dd9b-76ec-4d1d-85da-372120d88563'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:55.588456 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-3568dd9b-76ec-4d1d-85da-372120d88563 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab8f8d12ad894d5c994a6a9ff36b0704', 'request_id': 'req-3568dd9b-76ec-4d1d-85da-372120d88563'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:55.601510 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-3568dd9b-76ec-4d1d-85da-372120d88563 admin admin] The token cache is being invalidate because project ab8f8d12ad894d5c994a6a9ff36b0704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:57:55.601792 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-3568dd9b-76ec-4d1d-85da-372120d88563 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:55.602426 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-3568dd9b-76ec-4d1d-85da-372120d88563 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:57:55.604101 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1375/2749] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:57:55 2022] DELETE /identity/v3/projects/ab8f8d12ad894d5c994a6a9ff36b0704 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:57:55.608918 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97af6dc-3761-42d5-ac43-83057ec37a1f None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:55.609210 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97af6dc-3761-42d5-ac43-83057ec37a1f None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:55.609490 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97af6dc-3761-42d5-ac43-83057ec37a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:55.627348 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-b97af6dc-3761-42d5-ac43-83057ec37a1f None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:57:55.628788 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-b97af6dc-3761-42d5-ac43-83057ec37a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:55.675798 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:57:55.689071 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1375/2750] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:57:55.696859 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010500e-3ef0-4a42-9712-2788f3e4f631 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:55.697153 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010500e-3ef0-4a42-9712-2788f3e4f631 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:55.697462 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010500e-3ef0-4a42-9712-2788f3e4f631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:55.715365 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-7010500e-3ef0-4a42-9712-2788f3e4f631 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:57:55.716560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-7010500e-3ef0-4a42-9712-2788f3e4f631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:55.725328 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1376/2751] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:57:55.729591 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97af6dc-3761-42d5-ac43-83057ec37a1f None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:55.739946 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97af6dc-3761-42d5-ac43-83057ec37a1f None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:55.744539 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898459e-f2e7-45c7-91f2-953a3ddbfc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:55.745194 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898459e-f2e7-45c7-91f2-953a3ddbfc32 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:55.745529 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898459e-f2e7-45c7-91f2-953a3ddbfc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:55.745757 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898459e-f2e7-45c7-91f2-953a3ddbfc32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:55.746482 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898459e-f2e7-45c7-91f2-953a3ddbfc32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:57:55.746829 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898459e-f2e7-45c7-91f2-953a3ddbfc32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:55.748439 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898459e-f2e7-45c7-91f2-953a3ddbfc32 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:55.760311 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1376/2752] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:57:55.764505 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010500e-3ef0-4a42-9712-2788f3e4f631 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:55.774137 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010500e-3ef0-4a42-9712-2788f3e4f631 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:55.778818 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13df95-8492-4fc0-bedb-8d65c0b57d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:55.779462 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13df95-8492-4fc0-bedb-8d65c0b57d06 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:55.779742 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13df95-8492-4fc0-bedb-8d65c0b57d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:55.780019 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13df95-8492-4fc0-bedb-8d65c0b57d06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:55.780711 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13df95-8492-4fc0-bedb-8d65c0b57d06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:55.783242 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13df95-8492-4fc0-bedb-8d65c0b57d06 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:55.786396 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:57:55.809819 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1377/2753] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:57:55 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:57:55.813840 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898459e-f2e7-45c7-91f2-953a3ddbfc32 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:55.823736 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898459e-f2e7-45c7-91f2-953a3ddbfc32 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:55.879355 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d2261-1afd-45d5-9774-760a965bc29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:55.880022 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d2261-1afd-45d5-9774-760a965bc29a admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:55.880309 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d2261-1afd-45d5-9774-760a965bc29a admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:55.880587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d2261-1afd-45d5-9774-760a965bc29a admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:55.881267 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d2261-1afd-45d5-9774-760a965bc29a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:55.883220 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d2261-1afd-45d5-9774-760a965bc29a admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:55.905384 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1377/2754] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:57:55 2022] POST /identity/v3/users => generated 285 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:57:55.906664 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13df95-8492-4fc0-bedb-8d65c0b57d06 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:55.917306 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13df95-8492-4fc0-bedb-8d65c0b57d06 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:55.922050 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340fda8-98d7-4256-8c44-eb4c3bf84720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:55.922735 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340fda8-98d7-4256-8c44-eb4c3bf84720 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:55.923032 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340fda8-98d7-4256-8c44-eb4c3bf84720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:55.923290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340fda8-98d7-4256-8c44-eb4c3bf84720 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:55.924004 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6340fda8-98d7-4256-8c44-eb4c3bf84720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:55.925662 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6340fda8-98d7-4256-8c44-eb4c3bf84720 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:55.935522 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1378/2755] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:57:55.939060 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d2261-1afd-45d5-9774-760a965bc29a admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:55.948900 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d2261-1afd-45d5-9774-760a965bc29a admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:55.953620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94b16a-760b-41b1-a1c6-1ddac42b2f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:55.954802 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94b16a-760b-41b1-a1c6-1ddac42b2f2f admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:55.955107 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94b16a-760b-41b1-a1c6-1ddac42b2f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:55.955419 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94b16a-760b-41b1-a1c6-1ddac42b2f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:55.956143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94b16a-760b-41b1-a1c6-1ddac42b2f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:55.957741 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94b16a-760b-41b1-a1c6-1ddac42b2f2f admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:55.967526 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1378/2756] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:57:55.971971 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340fda8-98d7-4256-8c44-eb4c3bf84720 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:55.981628 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340fda8-98d7-4256-8c44-eb4c3bf84720 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:55.986213 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad13b92-4363-414a-8826-7a9aa8b711a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:55.987111 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad13b92-4363-414a-8826-7a9aa8b711a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:55.987391 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad13b92-4363-414a-8826-7a9aa8b711a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:55.987666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad13b92-4363-414a-8826-7a9aa8b711a7 admin admin] PATH_INFO: `/v3/projects/35750e46100f4885a7e0ff00264e80c8/users/5241e85ec99d48b88c2c112aa47fdbde/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:56.001943 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad13b92-4363-414a-8826-7a9aa8b711a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35750e46100f4885a7e0ff00264e80c8, user_id=5241e85ec99d48b88c2c112aa47fdbde, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:56.004948 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad13b92-4363-414a-8826-7a9aa8b711a7 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:56.017937 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1379/2757] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:57:55 2022] PUT /identity/v3/projects/35750e46100f4885a7e0ff00264e80c8/users/5241e85ec99d48b88c2c112aa47fdbde/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:57:56.028802 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6939044-b5b6-4de3-8c17-ed6052765c3a None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:56.029116 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6939044-b5b6-4de3-8c17-ed6052765c3a None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:56.029387 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6939044-b5b6-4de3-8c17-ed6052765c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:56.055761 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-a6939044-b5b6-4de3-8c17-ed6052765c3a None None] MFA Rules not processed for user `5241e85ec99d48b88c2c112aa47fdbde`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:57:56.056967 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-a6939044-b5b6-4de3-8c17-ed6052765c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:56.120590 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1379/2758] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:57:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:57:56.133092 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad13b92-4363-414a-8826-7a9aa8b711a7 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:57:56.134966 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-cad13b92-4363-414a-8826-7a9aa8b711a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:57:56.190903 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad13b92-4363-414a-8826-7a9aa8b711a7 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:57:56.194571 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be0afc-39f0-4342-9689-7dccf1a28c1b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09d603d756a9484bbf48cfd6d56bdb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:57:56.195237 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be0afc-39f0-4342-9689-7dccf1a28c1b service glance] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:57:56.195525 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be0afc-39f0-4342-9689-7dccf1a28c1b service glance] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:57:56.195803 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be0afc-39f0-4342-9689-7dccf1a28c1b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:57:56.204024 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be0afc-39f0-4342-9689-7dccf1a28c1b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:57:56.206120 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be0afc-39f0-4342-9689-7dccf1a28c1b service glance] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:57:56.214865 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1380/2759] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:57:56 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:58:06.117621 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=75,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:58:06.210943 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=47,keystone:INSERT=2 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:58:24.813196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6939044-b5b6-4de3-8c17-ed6052765c3a None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:58:24.873520 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6939044-b5b6-4de3-8c17-ed6052765c3a None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:58:24.878869 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b2542-4e54-4445-b73f-39ea169dcee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:58:24.879739 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b2542-4e54-4445-b73f-39ea169dcee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:58:24.880021 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b2542-4e54-4445-b73f-39ea169dcee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:58:24.880314 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b2542-4e54-4445-b73f-39ea169dcee4 admin admin] PATH_INFO: `/v3/users/5241e85ec99d48b88c2c112aa47fdbde` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:58:24.881494 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b2542-4e54-4445-b73f-39ea169dcee4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5241e85ec99d48b88c2c112aa47fdbde)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:58:24.883453 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b2542-4e54-4445-b73f-39ea169dcee4 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:58:24.928477 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-f98b2542-4e54-4445-b73f-39ea169dcee4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5241e85ec99d48b88c2c112aa47fdbde'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:58:24.929122 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-f98b2542-4e54-4445-b73f-39ea169dcee4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5241e85ec99d48b88c2c112aa47fdbde'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:58:24.941495 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-f98b2542-4e54-4445-b73f-39ea169dcee4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5241e85ec99d48b88c2c112aa47fdbde'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:58:24.942135 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-f98b2542-4e54-4445-b73f-39ea169dcee4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5241e85ec99d48b88c2c112aa47fdbde'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:58:24.951158 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-f98b2542-4e54-4445-b73f-39ea169dcee4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5241e85ec99d48b88c2c112aa47fdbde'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:58:24.965519 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1380/2760] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:58:24 2022] DELETE /identity/v3/users/5241e85ec99d48b88c2c112aa47fdbde => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:58:24.969936 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9a87d-95bc-475f-b038-5c99c0664d6e None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:58:24.970437 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9a87d-95bc-475f-b038-5c99c0664d6e None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:58:24.970615 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9a87d-95bc-475f-b038-5c99c0664d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:58:24.989469 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-9ee9a87d-95bc-475f-b038-5c99c0664d6e None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:58:24.990759 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-9ee9a87d-95bc-475f-b038-5c99c0664d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:58:25.055216 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1381/2761] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:58:25.064814 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b2542-4e54-4445-b73f-39ea169dcee4 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:58:25.066831 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-f98b2542-4e54-4445-b73f-39ea169dcee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:58:25.122676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b2542-4e54-4445-b73f-39ea169dcee4 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:58:25.126322 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76937c53-9e25-48bf-9eaa-7c1222a88115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:58:25.127001 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76937c53-9e25-48bf-9eaa-7c1222a88115 service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:58:25.127286 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76937c53-9e25-48bf-9eaa-7c1222a88115 service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:58:25.127563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76937c53-9e25-48bf-9eaa-7c1222a88115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:58:25.137418 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76937c53-9e25-48bf-9eaa-7c1222a88115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:58:25.138873 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76937c53-9e25-48bf-9eaa-7c1222a88115 service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:58:25.148227 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1381/2762] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:58:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:58:25.413006 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9a87d-95bc-475f-b038-5c99c0664d6e None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:58:25.414484 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-9ee9a87d-95bc-475f-b038-5c99c0664d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:58:25.426543 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9a87d-95bc-475f-b038-5c99c0664d6e None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:58:25.431917 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe764ff4-f984-461d-828e-a88dec8bdd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:58:25.432834 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe764ff4-f984-461d-828e-a88dec8bdd45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:58:25.433119 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe764ff4-f984-461d-828e-a88dec8bdd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:58:25.433397 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe764ff4-f984-461d-828e-a88dec8bdd45 admin admin] PATH_INFO: `/v3/projects/35750e46100f4885a7e0ff00264e80c8` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:58:25.434607 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe764ff4-f984-461d-828e-a88dec8bdd45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35750e46100f4885a7e0ff00264e80c8)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:58:25.436583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe764ff4-f984-461d-828e-a88dec8bdd45 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:58:25.482208 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-fe764ff4-f984-461d-828e-a88dec8bdd45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35750e46100f4885a7e0ff00264e80c8', 'request_id': 'req-fe764ff4-f984-461d-828e-a88dec8bdd45'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:58:25.488890 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-fe764ff4-f984-461d-828e-a88dec8bdd45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35750e46100f4885a7e0ff00264e80c8', 'request_id': 'req-fe764ff4-f984-461d-828e-a88dec8bdd45'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:58:25.494461 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-fe764ff4-f984-461d-828e-a88dec8bdd45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35750e46100f4885a7e0ff00264e80c8', 'request_id': 'req-fe764ff4-f984-461d-828e-a88dec8bdd45'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:58:25.506658 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-fe764ff4-f984-461d-828e-a88dec8bdd45 admin admin] The token cache is being invalidate because project 35750e46100f4885a7e0ff00264e80c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:58:25.506965 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-fe764ff4-f984-461d-828e-a88dec8bdd45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:58:25.507592 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-fe764ff4-f984-461d-828e-a88dec8bdd45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:58:25.509126 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1382/2763] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:58:25 2022] DELETE /identity/v3/projects/35750e46100f4885a7e0ff00264e80c8 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:58:25.514586 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5be20-c76e-49a9-862d-8a893d3f9acb None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:58:25.514905 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5be20-c76e-49a9-862d-8a893d3f9acb None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:58:25.515185 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5be20-c76e-49a9-862d-8a893d3f9acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:58:25.532409 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-99d5be20-c76e-49a9-862d-8a893d3f9acb None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:58:25.533588 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-99d5be20-c76e-49a9-862d-8a893d3f9acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:58:25.550831 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:58:25.594782 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1382/2764] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:58:25.603895 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a32a8-2555-4ad4-848e-4e6844946c46 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:58:25.604188 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a32a8-2555-4ad4-848e-4e6844946c46 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:58:25.604465 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a32a8-2555-4ad4-848e-4e6844946c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:58:25.624357 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-091a32a8-2555-4ad4-848e-4e6844946c46 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:58:25.625552 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-091a32a8-2555-4ad4-848e-4e6844946c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:58:25.633603 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1383/2765] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:58:25.637974 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5be20-c76e-49a9-862d-8a893d3f9acb None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:58:25.648050 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5be20-c76e-49a9-862d-8a893d3f9acb None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:58:25.653282 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f8321-f1cd-40a4-a08d-f5b64b2b1dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:58:25.654081 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f8321-f1cd-40a4-a08d-f5b64b2b1dfe admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:58:25.654365 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f8321-f1cd-40a4-a08d-f5b64b2b1dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:58:25.654656 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f8321-f1cd-40a4-a08d-f5b64b2b1dfe admin admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:58:25.655406 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f8321-f1cd-40a4-a08d-f5b64b2b1dfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:58:25.655715 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f8321-f1cd-40a4-a08d-f5b64b2b1dfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:58:25.657319 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f8321-f1cd-40a4-a08d-f5b64b2b1dfe admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:58:25.669687 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1383/2766] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 12:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:58:25.673650 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a32a8-2555-4ad4-848e-4e6844946c46 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:58:25.682753 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a32a8-2555-4ad4-848e-4e6844946c46 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:58:25.687408 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038627f7-4ec0-467e-ba0e-39e9098b70f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:58:25.688063 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038627f7-4ec0-467e-ba0e-39e9098b70f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:58:25.688342 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038627f7-4ec0-467e-ba0e-39e9098b70f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:58:25.689036 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038627f7-4ec0-467e-ba0e-39e9098b70f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:58:25.689295 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038627f7-4ec0-467e-ba0e-39e9098b70f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:58:25.691392 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038627f7-4ec0-467e-ba0e-39e9098b70f2 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:58:25.719142 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1384/2767] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 12:58:25 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:58:25.723994 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f8321-f1cd-40a4-a08d-f5b64b2b1dfe admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:58:25.734286 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f8321-f1cd-40a4-a08d-f5b64b2b1dfe admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:58:25.790736 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7cd28d-9cdf-43a8-8d5b-493f36eddc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:58:25.791356 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cd28d-9cdf-43a8-8d5b-493f36eddc3e admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:58:25.791643 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cd28d-9cdf-43a8-8d5b-493f36eddc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:58:25.791923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cd28d-9cdf-43a8-8d5b-493f36eddc3e admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:58:25.792608 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7cd28d-9cdf-43a8-8d5b-493f36eddc3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:58:25.794541 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7cd28d-9cdf-43a8-8d5b-493f36eddc3e admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:58:25.813454 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1384/2768] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 12:58:25 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:58:25.817776 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038627f7-4ec0-467e-ba0e-39e9098b70f2 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:58:25.828042 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038627f7-4ec0-467e-ba0e-39e9098b70f2 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:58:25.833270 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c422d79-cbf3-48ef-9981-a7a4b07589f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:58:25.833962 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c422d79-cbf3-48ef-9981-a7a4b07589f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:58:25.834269 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c422d79-cbf3-48ef-9981-a7a4b07589f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:58:25.834543 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c422d79-cbf3-48ef-9981-a7a4b07589f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:58:25.835585 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c422d79-cbf3-48ef-9981-a7a4b07589f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:58:25.837244 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c422d79-cbf3-48ef-9981-a7a4b07589f5 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:58:25.848118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1385/2769] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:58:25.851837 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7cd28d-9cdf-43a8-8d5b-493f36eddc3e admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:58:25.861690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7cd28d-9cdf-43a8-8d5b-493f36eddc3e admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:58:25.866403 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaacfdb2-e2c2-422d-acdc-a1d80e195514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:58:25.867092 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaacfdb2-e2c2-422d-acdc-a1d80e195514 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:58:25.867378 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaacfdb2-e2c2-422d-acdc-a1d80e195514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:58:25.867658 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaacfdb2-e2c2-422d-acdc-a1d80e195514 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:58:25.868449 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaacfdb2-e2c2-422d-acdc-a1d80e195514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:58:25.870010 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaacfdb2-e2c2-422d-acdc-a1d80e195514 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:58:25.880407 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1385/2770] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 12:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:58:25.884211 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c422d79-cbf3-48ef-9981-a7a4b07589f5 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:58:25.894202 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c422d79-cbf3-48ef-9981-a7a4b07589f5 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:58:25.898996 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2852f51-f646-48da-9cbc-c30fac75dd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:58:25.899856 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2852f51-f646-48da-9cbc-c30fac75dd24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:58:25.900133 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2852f51-f646-48da-9cbc-c30fac75dd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:58:25.900405 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2852f51-f646-48da-9cbc-c30fac75dd24 admin admin] PATH_INFO: `/v3/projects/cb9bc95213da4d1c96ae7e19bb10e692/users/c9b0b5f38dce4bb8bfb49024f6c6a00b/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:58:25.915120 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2852f51-f646-48da-9cbc-c30fac75dd24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb9bc95213da4d1c96ae7e19bb10e692, user_id=c9b0b5f38dce4bb8bfb49024f6c6a00b, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:58:25.917755 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2852f51-f646-48da-9cbc-c30fac75dd24 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:58:25.930464 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1386/2771] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 12:58:25 2022] PUT /identity/v3/projects/cb9bc95213da4d1c96ae7e19bb10e692/users/c9b0b5f38dce4bb8bfb49024f6c6a00b/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:58:25.941250 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80024f37-3bc0-4691-acd3-234dde592b59 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:58:25.941546 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80024f37-3bc0-4691-acd3-234dde592b59 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:58:25.941829 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80024f37-3bc0-4691-acd3-234dde592b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:58:25.969548 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-80024f37-3bc0-4691-acd3-234dde592b59 None None] MFA Rules not processed for user `c9b0b5f38dce4bb8bfb49024f6c6a00b`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:58:25.970743 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-80024f37-3bc0-4691-acd3-234dde592b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:58:26.035975 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1386/2772] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:58:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:58:26.046518 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2852f51-f646-48da-9cbc-c30fac75dd24 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:58:26.048256 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-f2852f51-f646-48da-9cbc-c30fac75dd24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:58:26.069767 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:58:26.106261 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2852f51-f646-48da-9cbc-c30fac75dd24 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:58:26.109866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b550e7-b04c-4350-b889-bc26a35aa316 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:58:26.110508 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b550e7-b04c-4350-b889-bc26a35aa316 service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:58:26.110835 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b550e7-b04c-4350-b889-bc26a35aa316 service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:58:26.111113 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b550e7-b04c-4350-b889-bc26a35aa316 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:58:26.119201 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b550e7-b04c-4350-b889-bc26a35aa316 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:58:26.120641 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b550e7-b04c-4350-b889-bc26a35aa316 service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:58:26.129994 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1387/2773] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:58:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:58:27.457482 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74abee-922d-4cbb-82e9-a41767e314de None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:58:27.458048 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74abee-922d-4cbb-82e9-a41767e314de None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:58:27.458048 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74abee-922d-4cbb-82e9-a41767e314de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:58:27.475752 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-ce74abee-922d-4cbb-82e9-a41767e314de None None] MFA Rules not processed for user `c9b0b5f38dce4bb8bfb49024f6c6a00b`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:58:27.476949 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-ce74abee-922d-4cbb-82e9-a41767e314de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:58:27.483773 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1387/2774] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:58:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:58:30.362295 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b550e7-b04c-4350-b889-bc26a35aa316 service cinder] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:58:30.363902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-c0b550e7-b04c-4350-b889-bc26a35aa316 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:58:30.445160 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b550e7-b04c-4350-b889-bc26a35aa316 service cinder] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:58:30.451123 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230b61f-9a69-44dd-b93f-f43a6218d4e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:58:30.451944 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230b61f-9a69-44dd-b93f-f43a6218d4e7 service nova] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:58:30.452310 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230b61f-9a69-44dd-b93f-f43a6218d4e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:58:30.452686 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230b61f-9a69-44dd-b93f-f43a6218d4e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:58:30.454718 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-5230b61f-9a69-44dd-b93f-f43a6218d4e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:58:30.473416 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5230b61f-9a69-44dd-b93f-f43a6218d4e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:58:30.475226 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5230b61f-9a69-44dd-b93f-f43a6218d4e7 service nova] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:58:30.487732 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1388/2775] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:58:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:58:37.470023 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:58:40.483173 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=51 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:58:41.340395 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b8910-79a6-4b4d-9fa8-2c2f662c3b96 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:58:41.340853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b8910-79a6-4b4d-9fa8-2c2f662c3b96 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:58:41.340947 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b8910-79a6-4b4d-9fa8-2c2f662c3b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:58:41.388376 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-6c9b8910-79a6-4b4d-9fa8-2c2f662c3b96 None None] MFA Rules not processed for user `2891b5a315b64f228f665e024b641629`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:58:41.389586 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-6c9b8910-79a6-4b4d-9fa8-2c2f662c3b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:58:41.456801 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1388/2776] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Jun 29 12:58:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:58:41.501736 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230b61f-9a69-44dd-b93f-f43a6218d4e7 service nova] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:58:41.503822 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-5230b61f-9a69-44dd-b93f-f43a6218d4e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:58:41.592537 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230b61f-9a69-44dd-b93f-f43a6218d4e7 service nova] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:58:41.597436 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec61b8-10b7-4ed6-a08c-4a41b26ced9b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11efdbeeaa5c428aa344f7f0f5b061ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:58:41.598074 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec61b8-10b7-4ed6-a08c-4a41b26ced9b service swift] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:58:41.598353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec61b8-10b7-4ed6-a08c-4a41b26ced9b service swift] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:58:41.598626 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec61b8-10b7-4ed6-a08c-4a41b26ced9b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:58:41.606426 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec61b8-10b7-4ed6-a08c-4a41b26ced9b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:58:41.608040 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec61b8-10b7-4ed6-a08c-4a41b26ced9b service swift] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:58:41.616300 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1389/2777] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Jun 29 12:58:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 12:58:42.103139 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3db57-f6cf-438c-8bdb-accc23151e0d None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:58:42.103428 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3db57-f6cf-438c-8bdb-accc23151e0d None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:58:42.103706 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3db57-f6cf-438c-8bdb-accc23151e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:58:42.121599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-01c3db57-f6cf-438c-8bdb-accc23151e0d None None] MFA Rules not processed for user `2891b5a315b64f228f665e024b641629`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:58:42.122876 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-01c3db57-f6cf-438c-8bdb-accc23151e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:58:42.130549 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1389/2778] 10.222.0.13 () {58 vars in 967 bytes} [Wed Jun 29 12:58:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:58:42.142308 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec61b8-10b7-4ed6-a08c-4a41b26ced9b service swift] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:58:42.153270 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec61b8-10b7-4ed6-a08c-4a41b26ced9b service swift] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:58:42.158908 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a7c7b-0599-4269-8c52-34db9052422f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11efdbeeaa5c428aa344f7f0f5b061ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:58:42.159538 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a7c7b-0599-4269-8c52-34db9052422f service swift] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:58:42.159822 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a7c7b-0599-4269-8c52-34db9052422f service swift] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:58:42.160098 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a7c7b-0599-4269-8c52-34db9052422f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:58:42.168060 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a7c7b-0599-4269-8c52-34db9052422f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:58:42.169639 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a7c7b-0599-4269-8c52-34db9052422f service swift] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:58:42.177621 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1390/2779] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Jun 29 12:58:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 29 12:58:42.365304 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a5b29-18d4-49e1-95e7-8cfc6bbc6de8 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:58:42.365821 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a5b29-18d4-49e1-95e7-8cfc6bbc6de8 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:58:42.365927 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a5b29-18d4-49e1-95e7-8cfc6bbc6de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:58:42.383526 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-155a5b29-18d4-49e1-95e7-8cfc6bbc6de8 None None] MFA Rules not processed for user `2891b5a315b64f228f665e024b641629`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:58:42.384719 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-155a5b29-18d4-49e1-95e7-8cfc6bbc6de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:58:42.391999 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1390/2780] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Jun 29 12:58:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:58:42.404100 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a7c7b-0599-4269-8c52-34db9052422f service swift] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:58:42.415111 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a7c7b-0599-4269-8c52-34db9052422f service swift] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:58:42.420031 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9438ff0-1a72-4402-9380-7b938365fd04 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11efdbeeaa5c428aa344f7f0f5b061ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:58:42.420659 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9438ff0-1a72-4402-9380-7b938365fd04 service swift] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:58:42.420940 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9438ff0-1a72-4402-9380-7b938365fd04 service swift] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:58:42.421214 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9438ff0-1a72-4402-9380-7b938365fd04 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:58:42.429161 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9438ff0-1a72-4402-9380-7b938365fd04 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:58:42.430790 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9438ff0-1a72-4402-9380-7b938365fd04 service swift] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:58:42.438678 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1391/2781] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Jun 29 12:58:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 12:58:42.773267 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514cace-099b-4aa9-8b34-21a84162ad1c None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:58:42.773500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514cace-099b-4aa9-8b34-21a84162ad1c None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:58:42.773782 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514cace-099b-4aa9-8b34-21a84162ad1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:58:42.791218 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-d514cace-099b-4aa9-8b34-21a84162ad1c None None] MFA Rules not processed for user `2891b5a315b64f228f665e024b641629`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:58:42.792430 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-d514cace-099b-4aa9-8b34-21a84162ad1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:58:42.799709 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1391/2782] 10.222.0.13 () {58 vars in 967 bytes} [Wed Jun 29 12:58:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:58:42.811718 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9438ff0-1a72-4402-9380-7b938365fd04 service swift] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:58:42.822767 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9438ff0-1a72-4402-9380-7b938365fd04 service swift] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:58:42.827707 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f019c-3f0f-49c2-873c-694314ec62f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11efdbeeaa5c428aa344f7f0f5b061ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:58:42.828335 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f019c-3f0f-49c2-873c-694314ec62f3 service swift] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:58:42.828616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f019c-3f0f-49c2-873c-694314ec62f3 service swift] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:58:42.828888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f019c-3f0f-49c2-873c-694314ec62f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:58:42.837455 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f019c-3f0f-49c2-873c-694314ec62f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:58:42.839066 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f019c-3f0f-49c2-873c-694314ec62f3 service swift] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:58:42.846935 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1392/2783] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Jun 29 12:58:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 12:58:44.868729 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514cace-099b-4aa9-8b34-21a84162ad1c None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:58:44.930081 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514cace-099b-4aa9-8b34-21a84162ad1c None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:58:44.934568 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb786e-66c2-4f2e-9dc3-52a9019b0a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:58:44.935459 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb786e-66c2-4f2e-9dc3-52a9019b0a16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:58:44.935738 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb786e-66c2-4f2e-9dc3-52a9019b0a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:58:44.936009 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb786e-66c2-4f2e-9dc3-52a9019b0a16 admin admin] PATH_INFO: `/v3/users/c9b0b5f38dce4bb8bfb49024f6c6a00b` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:58:44.937175 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb786e-66c2-4f2e-9dc3-52a9019b0a16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9b0b5f38dce4bb8bfb49024f6c6a00b)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:58:44.939134 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb786e-66c2-4f2e-9dc3-52a9019b0a16 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:58:44.985493 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-f4cb786e-66c2-4f2e-9dc3-52a9019b0a16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9b0b5f38dce4bb8bfb49024f6c6a00b'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:58:44.986135 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-f4cb786e-66c2-4f2e-9dc3-52a9019b0a16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9b0b5f38dce4bb8bfb49024f6c6a00b'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:58:44.991390 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:58:44.999987 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-f4cb786e-66c2-4f2e-9dc3-52a9019b0a16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9b0b5f38dce4bb8bfb49024f6c6a00b'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:58:45.000695 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-f4cb786e-66c2-4f2e-9dc3-52a9019b0a16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9b0b5f38dce4bb8bfb49024f6c6a00b'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:58:45.008215 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-f4cb786e-66c2-4f2e-9dc3-52a9019b0a16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9b0b5f38dce4bb8bfb49024f6c6a00b'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:58:45.020581 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1392/2784] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:58:44 2022] DELETE /identity/v3/users/c9b0b5f38dce4bb8bfb49024f6c6a00b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:58:45.025132 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b78eb-a854-4bd6-a1ec-0faa6881ed70 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:58:45.025583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b78eb-a854-4bd6-a1ec-0faa6881ed70 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:58:45.025698 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b78eb-a854-4bd6-a1ec-0faa6881ed70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:58:45.042616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-697b78eb-a854-4bd6-a1ec-0faa6881ed70 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:58:45.043830 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-697b78eb-a854-4bd6-a1ec-0faa6881ed70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:58:45.104503 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1393/2785] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 12:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:58:45.114029 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb786e-66c2-4f2e-9dc3-52a9019b0a16 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:58:45.115471 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-f4cb786e-66c2-4f2e-9dc3-52a9019b0a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:58:45.171724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb786e-66c2-4f2e-9dc3-52a9019b0a16 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:58:45.175876 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb90d8-2c1e-456f-bbf4-487de0222cfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:58:45.176522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb90d8-2c1e-456f-bbf4-487de0222cfd service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:58:45.176804 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb90d8-2c1e-456f-bbf4-487de0222cfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:58:45.177084 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb90d8-2c1e-456f-bbf4-487de0222cfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:58:45.186050 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb90d8-2c1e-456f-bbf4-487de0222cfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:58:45.187453 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb90d8-2c1e-456f-bbf4-487de0222cfd service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:58:45.197462 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1393/2786] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:58:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:58:45.363638 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b78eb-a854-4bd6-a1ec-0faa6881ed70 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:58:45.365584 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-697b78eb-a854-4bd6-a1ec-0faa6881ed70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:58:45.381640 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b78eb-a854-4bd6-a1ec-0faa6881ed70 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:58:45.388549 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ee276-6c59-4dfa-a9c3-9043f486cb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:58:45.389657 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ee276-6c59-4dfa-a9c3-9043f486cb2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:58:45.390027 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ee276-6c59-4dfa-a9c3-9043f486cb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:58:45.390410 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ee276-6c59-4dfa-a9c3-9043f486cb2a admin admin] PATH_INFO: `/v3/projects/cb9bc95213da4d1c96ae7e19bb10e692` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:58:45.391781 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ee276-6c59-4dfa-a9c3-9043f486cb2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb9bc95213da4d1c96ae7e19bb10e692)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:58:45.393803 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ee276-6c59-4dfa-a9c3-9043f486cb2a admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:58:45.424336 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:58:45.442362 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-7f3ee276-6c59-4dfa-a9c3-9043f486cb2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb9bc95213da4d1c96ae7e19bb10e692', 'request_id': 'req-7f3ee276-6c59-4dfa-a9c3-9043f486cb2a'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:58:45.448445 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-7f3ee276-6c59-4dfa-a9c3-9043f486cb2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb9bc95213da4d1c96ae7e19bb10e692', 'request_id': 'req-7f3ee276-6c59-4dfa-a9c3-9043f486cb2a'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:58:45.454477 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-7f3ee276-6c59-4dfa-a9c3-9043f486cb2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb9bc95213da4d1c96ae7e19bb10e692', 'request_id': 'req-7f3ee276-6c59-4dfa-a9c3-9043f486cb2a'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:58:45.465985 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-7f3ee276-6c59-4dfa-a9c3-9043f486cb2a admin admin] The token cache is being invalidate because project cb9bc95213da4d1c96ae7e19bb10e692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:58:45.466274 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-7f3ee276-6c59-4dfa-a9c3-9043f486cb2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:58:45.466926 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-7f3ee276-6c59-4dfa-a9c3-9043f486cb2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:58:45.468460 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1394/2787] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:58:45 2022] DELETE /identity/v3/projects/cb9bc95213da4d1c96ae7e19bb10e692 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:58:55.193218 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=36,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:58:55.463148 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:DELETE=6,keystone:SELECT=14,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:59:24.163497 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb90d8-2c1e-456f-bbf4-487de0222cfd service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:59:24.172057 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb90d8-2c1e-456f-bbf4-487de0222cfd service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:59:24.222470 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6deff64-10ed-44aa-9b20-08ab6c3964ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:59:24.223158 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6deff64-10ed-44aa-9b20-08ab6c3964ab service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:59:24.223445 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6deff64-10ed-44aa-9b20-08ab6c3964ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:59:24.223724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6deff64-10ed-44aa-9b20-08ab6c3964ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:59:24.225499 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-b6deff64-10ed-44aa-9b20-08ab6c3964ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:59:24.315675 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6deff64-10ed-44aa-9b20-08ab6c3964ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:59:24.317167 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6deff64-10ed-44aa-9b20-08ab6c3964ab service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:59:24.337745 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1394/2788] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:59:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:59:28.024591 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ee276-6c59-4dfa-a9c3-9043f486cb2a admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:59:28.026000 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-7f3ee276-6c59-4dfa-a9c3-9043f486cb2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:59:28.038793 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ee276-6c59-4dfa-a9c3-9043f486cb2a admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:59:28.042230 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99851841-f6f5-48cc-9a87-3f54994bedba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:59:28.042899 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99851841-f6f5-48cc-9a87-3f54994bedba service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:59:28.043180 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99851841-f6f5-48cc-9a87-3f54994bedba service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:59:28.043453 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99851841-f6f5-48cc-9a87-3f54994bedba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:59:28.045108 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-99851841-f6f5-48cc-9a87-3f54994bedba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:59:28.126078 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99851841-f6f5-48cc-9a87-3f54994bedba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:59:28.127834 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99851841-f6f5-48cc-9a87-3f54994bedba service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:59:28.146450 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1395/2789] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 12:59:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:59:34.075108 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6deff64-10ed-44aa-9b20-08ab6c3964ab service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:59:34.076544 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-b6deff64-10ed-44aa-9b20-08ab6c3964ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:59:34.092334 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6deff64-10ed-44aa-9b20-08ab6c3964ab service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:59:34.097721 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5354fd-e039-431f-860c-ceb54d7abe57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:59:34.098646 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5354fd-e039-431f-860c-ceb54d7abe57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:59:34.098956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5354fd-e039-431f-860c-ceb54d7abe57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:59:34.099234 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5354fd-e039-431f-860c-ceb54d7abe57 admin admin] PATH_INFO: `/v3/users/2ab423c5002c4b01aeae93f31aa6feec` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:59:34.100442 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5354fd-e039-431f-860c-ceb54d7abe57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ab423c5002c4b01aeae93f31aa6feec)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:59:34.102857 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5354fd-e039-431f-860c-ceb54d7abe57 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:59:34.152238 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-6a5354fd-e039-431f-860c-ceb54d7abe57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ab423c5002c4b01aeae93f31aa6feec'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:59:34.152898 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-6a5354fd-e039-431f-860c-ceb54d7abe57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ab423c5002c4b01aeae93f31aa6feec'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:59:34.165932 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-6a5354fd-e039-431f-860c-ceb54d7abe57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ab423c5002c4b01aeae93f31aa6feec'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:59:34.166700 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-6a5354fd-e039-431f-860c-ceb54d7abe57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ab423c5002c4b01aeae93f31aa6feec'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:59:34.170489 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:59:34.176873 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-6a5354fd-e039-431f-860c-ceb54d7abe57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ab423c5002c4b01aeae93f31aa6feec'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:59:34.195411 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1395/2790] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:59:34 2022] DELETE /identity/v3/users/2ab423c5002c4b01aeae93f31aa6feec => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:59:34.368499 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99851841-f6f5-48cc-9a87-3f54994bedba service neutron] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:59:34.379898 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99851841-f6f5-48cc-9a87-3f54994bedba service neutron] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:59:34.444720 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42d686-e603-49b0-92fe-c7ae99bcc6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:59:34.445579 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42d686-e603-49b0-92fe-c7ae99bcc6c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:59:34.445858 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42d686-e603-49b0-92fe-c7ae99bcc6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:59:34.446130 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42d686-e603-49b0-92fe-c7ae99bcc6c4 admin admin] PATH_INFO: `/v3/projects/f1596ce0cbaf437699c4d4eba180ff7b` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:59:34.447313 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42d686-e603-49b0-92fe-c7ae99bcc6c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1596ce0cbaf437699c4d4eba180ff7b)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:59:34.449239 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42d686-e603-49b0-92fe-c7ae99bcc6c4 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:59:34.494553 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-4b42d686-e603-49b0-92fe-c7ae99bcc6c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1596ce0cbaf437699c4d4eba180ff7b', 'request_id': 'req-4b42d686-e603-49b0-92fe-c7ae99bcc6c4'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:59:34.500438 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-4b42d686-e603-49b0-92fe-c7ae99bcc6c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1596ce0cbaf437699c4d4eba180ff7b', 'request_id': 'req-4b42d686-e603-49b0-92fe-c7ae99bcc6c4'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:59:34.506664 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-4b42d686-e603-49b0-92fe-c7ae99bcc6c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1596ce0cbaf437699c4d4eba180ff7b', 'request_id': 'req-4b42d686-e603-49b0-92fe-c7ae99bcc6c4'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:59:34.510138 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:59:34.521721 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-4b42d686-e603-49b0-92fe-c7ae99bcc6c4 admin admin] The token cache is being invalidate because project f1596ce0cbaf437699c4d4eba180ff7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:59:34.522068 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-4b42d686-e603-49b0-92fe-c7ae99bcc6c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:59:34.522732 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-4b42d686-e603-49b0-92fe-c7ae99bcc6c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:59:34.524325 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1396/2791] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:59:34 2022] DELETE /identity/v3/projects/f1596ce0cbaf437699c4d4eba180ff7b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:59:34.528289 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5354fd-e039-431f-860c-ceb54d7abe57 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:59:34.529676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-6a5354fd-e039-431f-860c-ceb54d7abe57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:59:34.542610 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5354fd-e039-431f-860c-ceb54d7abe57 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:59:34.597653 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8ef17-1d99-43b5-87fc-0c017a4f9118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:59:34.598520 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8ef17-1d99-43b5-87fc-0c017a4f9118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:59:34.598832 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8ef17-1d99-43b5-87fc-0c017a4f9118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:59:34.599113 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8ef17-1d99-43b5-87fc-0c017a4f9118 admin admin] PATH_INFO: `/v3/users/6c287a593c7d4362ac42e369f25c1221` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:59:34.600282 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8ef17-1d99-43b5-87fc-0c017a4f9118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c287a593c7d4362ac42e369f25c1221)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:59:34.602204 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8ef17-1d99-43b5-87fc-0c017a4f9118 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:59:34.647023 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-86c8ef17-1d99-43b5-87fc-0c017a4f9118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c287a593c7d4362ac42e369f25c1221'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:59:34.647712 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-86c8ef17-1d99-43b5-87fc-0c017a4f9118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c287a593c7d4362ac42e369f25c1221'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:59:34.660233 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-86c8ef17-1d99-43b5-87fc-0c017a4f9118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c287a593c7d4362ac42e369f25c1221'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:59:34.660997 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-86c8ef17-1d99-43b5-87fc-0c017a4f9118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c287a593c7d4362ac42e369f25c1221'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:59:34.668737 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-86c8ef17-1d99-43b5-87fc-0c017a4f9118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c287a593c7d4362ac42e369f25c1221'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:59:34.681170 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1396/2792] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 12:59:34 2022] DELETE /identity/v3/users/6c287a593c7d4362ac42e369f25c1221 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:59:35.094945 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42d686-e603-49b0-92fe-c7ae99bcc6c4 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:59:35.096883 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-4b42d686-e603-49b0-92fe-c7ae99bcc6c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:59:35.111615 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42d686-e603-49b0-92fe-c7ae99bcc6c4 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:59:35.168151 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5006de-ce6c-431a-9928-c5cb79da9b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:59:35.169012 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5006de-ce6c-431a-9928-c5cb79da9b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:59:35.169298 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5006de-ce6c-431a-9928-c5cb79da9b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:59:35.169577 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5006de-ce6c-431a-9928-c5cb79da9b0e admin admin] PATH_INFO: `/v3/projects/f647b80b40744560813bc546d49a70fa` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:59:35.170795 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5006de-ce6c-431a-9928-c5cb79da9b0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f647b80b40744560813bc546d49a70fa)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:59:35.172717 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5006de-ce6c-431a-9928-c5cb79da9b0e admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:59:35.217781 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-5d5006de-ce6c-431a-9928-c5cb79da9b0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f647b80b40744560813bc546d49a70fa', 'request_id': 'req-5d5006de-ce6c-431a-9928-c5cb79da9b0e'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:59:35.224905 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-5d5006de-ce6c-431a-9928-c5cb79da9b0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f647b80b40744560813bc546d49a70fa', 'request_id': 'req-5d5006de-ce6c-431a-9928-c5cb79da9b0e'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:59:35.231613 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-5d5006de-ce6c-431a-9928-c5cb79da9b0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f647b80b40744560813bc546d49a70fa', 'request_id': 'req-5d5006de-ce6c-431a-9928-c5cb79da9b0e'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:59:35.243996 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-5d5006de-ce6c-431a-9928-c5cb79da9b0e admin admin] The token cache is being invalidate because project f647b80b40744560813bc546d49a70fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:59:35.244284 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-5d5006de-ce6c-431a-9928-c5cb79da9b0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:59:35.244907 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-5d5006de-ce6c-431a-9928-c5cb79da9b0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:59:35.246451 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1397/2793] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 12:59:35 2022] DELETE /identity/v3/projects/f647b80b40744560813bc546d49a70fa => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:59:44.677760 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=59,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:59:45.240990 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:00:07.259673 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8ef17-1d99-43b5-87fc-0c017a4f9118 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:00:07.261072 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-86c8ef17-1d99-43b5-87fc-0c017a4f9118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:00:07.343887 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8ef17-1d99-43b5-87fc-0c017a4f9118 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:00:07.404896 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd2360-70ed-4e76-b5d8-169bb86581c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57c8b894e74c709ea389ed462184fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:00:07.405550 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd2360-70ed-4e76-b5d8-169bb86581c0 service placement] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:00:07.405825 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd2360-70ed-4e76-b5d8-169bb86581c0 service placement] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:00:07.406104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd2360-70ed-4e76-b5d8-169bb86581c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:00:07.407910 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-c8cd2360-70ed-4e76-b5d8-169bb86581c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:00:07.418909 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cd2360-70ed-4e76-b5d8-169bb86581c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:00:07.420479 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cd2360-70ed-4e76-b5d8-169bb86581c0 service placement] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:00:07.430071 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1397/2794] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 13:00:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 13:00:17.425946 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=63 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:01:20.481094 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5006de-ce6c-431a-9928-c5cb79da9b0e admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:01:20.482503 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-5d5006de-ce6c-431a-9928-c5cb79da9b0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:01:20.547945 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5006de-ce6c-431a-9928-c5cb79da9b0e admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:01:20.551523 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a97b7b-af9c-4118-b11a-e96cee63abdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:01:20.552160 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a97b7b-af9c-4118-b11a-e96cee63abdf service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:01:20.552444 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a97b7b-af9c-4118-b11a-e96cee63abdf service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:01:20.552720 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a97b7b-af9c-4118-b11a-e96cee63abdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:01:20.554456 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-e8a97b7b-af9c-4118-b11a-e96cee63abdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:01:20.632858 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a97b7b-af9c-4118-b11a-e96cee63abdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:01:20.634313 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a97b7b-af9c-4118-b11a-e96cee63abdf service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:01:20.652583 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1398/2795] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 13:01:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 13:01:30.650001 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=65 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:04:22.744467 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd2360-70ed-4e76-b5d8-169bb86581c0 service placement] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:22.746155 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-c8cd2360-70ed-4e76-b5d8-169bb86581c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:22.801574 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd2360-70ed-4e76-b5d8-169bb86581c0 service placement] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:22.805131 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87875403-ef6c-45f3-9928-7b37a8c741ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:22.805775 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87875403-ef6c-45f3-9928-7b37a8c741ec service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:22.806058 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87875403-ef6c-45f3-9928-7b37a8c741ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:22.806337 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87875403-ef6c-45f3-9928-7b37a8c741ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:22.808117 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-87875403-ef6c-45f3-9928-7b37a8c741ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:22.868646 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87875403-ef6c-45f3-9928-7b37a8c741ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:22.870012 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87875403-ef6c-45f3-9928-7b37a8c741ec service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:22.879936 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1398/2796] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 13:04:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 13:04:25.923045 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a97b7b-af9c-4118-b11a-e96cee63abdf service cinder] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:25.924661 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-e8a97b7b-af9c-4118-b11a-e96cee63abdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:25.940084 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a97b7b-af9c-4118-b11a-e96cee63abdf service cinder] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:25.945468 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69567943-615f-40b1-bcf3-b7e86d8a1584 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57c8b894e74c709ea389ed462184fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:25.946840 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69567943-615f-40b1-bcf3-b7e86d8a1584 service placement] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:25.947054 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69567943-615f-40b1-bcf3-b7e86d8a1584 service placement] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:25.947332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69567943-615f-40b1-bcf3-b7e86d8a1584 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:25.949114 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-69567943-615f-40b1-bcf3-b7e86d8a1584 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:25.961737 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69567943-615f-40b1-bcf3-b7e86d8a1584 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:25.963406 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69567943-615f-40b1-bcf3-b7e86d8a1584 service placement] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:25.978764 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1399/2797] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 13:04:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 13:04:25.979598 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87875403-ef6c-45f3-9928-7b37a8c741ec service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:25.981171 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-87875403-ef6c-45f3-9928-7b37a8c741ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:25.995124 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87875403-ef6c-45f3-9928-7b37a8c741ec service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:26.006713 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987557a-a0f4-4b53-a457-6d9fea3111b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:26.007623 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987557a-a0f4-4b53-a457-6d9fea3111b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:26.007913 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987557a-a0f4-4b53-a457-6d9fea3111b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:26.008192 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987557a-a0f4-4b53-a457-6d9fea3111b5 admin admin] PATH_INFO: `/v3/users/026de546e4f448b3b5258cafedf8bf78` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:26.009452 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987557a-a0f4-4b53-a457-6d9fea3111b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=026de546e4f448b3b5258cafedf8bf78)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:26.011479 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987557a-a0f4-4b53-a457-6d9fea3111b5 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:26.057845 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-1987557a-a0f4-4b53-a457-6d9fea3111b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '026de546e4f448b3b5258cafedf8bf78'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:26.058507 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-1987557a-a0f4-4b53-a457-6d9fea3111b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '026de546e4f448b3b5258cafedf8bf78'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:26.070995 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-1987557a-a0f4-4b53-a457-6d9fea3111b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '026de546e4f448b3b5258cafedf8bf78'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:26.071632 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-1987557a-a0f4-4b53-a457-6d9fea3111b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '026de546e4f448b3b5258cafedf8bf78'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:26.079450 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-1987557a-a0f4-4b53-a457-6d9fea3111b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '026de546e4f448b3b5258cafedf8bf78'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:26.091652 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1399/2798] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 13:04:25 2022] DELETE /identity/v3/users/026de546e4f448b3b5258cafedf8bf78 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 13:04:26.265024 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69567943-615f-40b1-bcf3-b7e86d8a1584 service placement] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:26.276229 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69567943-615f-40b1-bcf3-b7e86d8a1584 service placement] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:26.335937 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345d410-5d69-4bca-95f8-a16002825693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:26.336795 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345d410-5d69-4bca-95f8-a16002825693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:26.337076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345d410-5d69-4bca-95f8-a16002825693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:26.337352 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345d410-5d69-4bca-95f8-a16002825693 admin admin] PATH_INFO: `/v3/projects/f9aa36d294af47a5ad4519c4e7f2ea59` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:26.338524 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b345d410-5d69-4bca-95f8-a16002825693 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9aa36d294af47a5ad4519c4e7f2ea59)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:26.340473 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b345d410-5d69-4bca-95f8-a16002825693 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:26.388431 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-b345d410-5d69-4bca-95f8-a16002825693 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9aa36d294af47a5ad4519c4e7f2ea59', 'request_id': 'req-b345d410-5d69-4bca-95f8-a16002825693'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:26.394841 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-b345d410-5d69-4bca-95f8-a16002825693 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9aa36d294af47a5ad4519c4e7f2ea59', 'request_id': 'req-b345d410-5d69-4bca-95f8-a16002825693'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:26.400192 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-b345d410-5d69-4bca-95f8-a16002825693 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9aa36d294af47a5ad4519c4e7f2ea59', 'request_id': 'req-b345d410-5d69-4bca-95f8-a16002825693'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:26.412408 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-b345d410-5d69-4bca-95f8-a16002825693 admin admin] The token cache is being invalidate because project f9aa36d294af47a5ad4519c4e7f2ea59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 13:04:26.412689 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-b345d410-5d69-4bca-95f8-a16002825693 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:26.413297 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-b345d410-5d69-4bca-95f8-a16002825693 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:26.414856 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1400/2799] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 13:04:26 2022] DELETE /identity/v3/projects/f9aa36d294af47a5ad4519c4e7f2ea59 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 13:04:26.420549 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf04ae1-b383-4d2c-8ef8-7138d6501ca5 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:26.420836 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf04ae1-b383-4d2c-8ef8-7138d6501ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:26.421113 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf04ae1-b383-4d2c-8ef8-7138d6501ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:26.447591 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:04:26.479199 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-bbf04ae1-b383-4d2c-8ef8-7138d6501ca5 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:04:26.480421 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-bbf04ae1-b383-4d2c-8ef8-7138d6501ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:26.538511 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1400/2800] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 13:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 13:04:26.546182 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493af31-88b6-4ec2-b064-86828d60bf78 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:26.546465 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493af31-88b6-4ec2-b064-86828d60bf78 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:26.546762 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493af31-88b6-4ec2-b064-86828d60bf78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:26.565314 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-e493af31-88b6-4ec2-b064-86828d60bf78 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:04:26.566493 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-e493af31-88b6-4ec2-b064-86828d60bf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:26.574673 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1401/2801] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 13:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 13:04:26.578688 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf04ae1-b383-4d2c-8ef8-7138d6501ca5 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:26.588287 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf04ae1-b383-4d2c-8ef8-7138d6501ca5 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:26.592873 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eaf382-bd24-466b-8d14-eb95bad53e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:26.593519 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eaf382-bd24-466b-8d14-eb95bad53e9d admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:26.593803 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eaf382-bd24-466b-8d14-eb95bad53e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:26.594589 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eaf382-bd24-466b-8d14-eb95bad53e9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:26.595338 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eaf382-bd24-466b-8d14-eb95bad53e9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 13:04:26.595644 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eaf382-bd24-466b-8d14-eb95bad53e9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:26.597230 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eaf382-bd24-466b-8d14-eb95bad53e9d admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:26.608519 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1401/2802] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 13:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 13:04:26.613083 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493af31-88b6-4ec2-b064-86828d60bf78 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:26.622352 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493af31-88b6-4ec2-b064-86828d60bf78 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:26.627197 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f16da-ad66-4717-a4da-220f350057b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:26.627832 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f16da-ad66-4717-a4da-220f350057b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:26.628113 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f16da-ad66-4717-a4da-220f350057b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:26.628384 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f16da-ad66-4717-a4da-220f350057b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:26.629054 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f16da-ad66-4717-a4da-220f350057b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:26.630988 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f16da-ad66-4717-a4da-220f350057b5 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:26.665439 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1402/2803] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 13:04:26 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 13:04:26.669438 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eaf382-bd24-466b-8d14-eb95bad53e9d admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:26.679999 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eaf382-bd24-466b-8d14-eb95bad53e9d admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:26.736552 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c1ec5-33cc-48e6-8837-ed407d82e2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:26.737242 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c1ec5-33cc-48e6-8837-ed407d82e2fc admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:26.737520 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c1ec5-33cc-48e6-8837-ed407d82e2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:26.737792 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c1ec5-33cc-48e6-8837-ed407d82e2fc admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:26.738490 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c1ec5-33cc-48e6-8837-ed407d82e2fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:26.740506 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c1ec5-33cc-48e6-8837-ed407d82e2fc admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:26.759955 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1402/2804] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 13:04:26 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 13:04:26.764091 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f16da-ad66-4717-a4da-220f350057b5 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:26.774827 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f16da-ad66-4717-a4da-220f350057b5 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:26.779351 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f52fa-efa3-4f2c-af95-30fa9ec4031c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:26.780031 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f52fa-efa3-4f2c-af95-30fa9ec4031c admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:26.780320 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f52fa-efa3-4f2c-af95-30fa9ec4031c admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:26.780601 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f52fa-efa3-4f2c-af95-30fa9ec4031c admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:26.781327 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f52fa-efa3-4f2c-af95-30fa9ec4031c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:26.783613 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f52fa-efa3-4f2c-af95-30fa9ec4031c admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:26.793449 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1403/2805] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 13:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 13:04:26.797378 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c1ec5-33cc-48e6-8837-ed407d82e2fc admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:26.807188 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c1ec5-33cc-48e6-8837-ed407d82e2fc admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:26.812007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7b4a1-c7ea-46c8-852b-62d68f7766ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:26.812670 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7b4a1-c7ea-46c8-852b-62d68f7766ad admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:26.812958 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7b4a1-c7ea-46c8-852b-62d68f7766ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:26.813240 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7b4a1-c7ea-46c8-852b-62d68f7766ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:26.813962 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7b4a1-c7ea-46c8-852b-62d68f7766ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:26.815597 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7b4a1-c7ea-46c8-852b-62d68f7766ad admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:26.825491 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1403/2806] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 13:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 13:04:26.829874 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f52fa-efa3-4f2c-af95-30fa9ec4031c admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:26.839648 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f52fa-efa3-4f2c-af95-30fa9ec4031c admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:26.844853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5e6fa-a735-4b9b-93ab-e053b2b0c854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:26.845724 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5e6fa-a735-4b9b-93ab-e053b2b0c854 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:26.846005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5e6fa-a735-4b9b-93ab-e053b2b0c854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:26.846280 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5e6fa-a735-4b9b-93ab-e053b2b0c854 admin admin] PATH_INFO: `/v3/projects/747b0f6c475e48ebaa6bbfe59fa69552/users/9d0dfa3267564edb8ef4cec960829f0f/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:26.860633 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae5e6fa-a735-4b9b-93ab-e053b2b0c854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=747b0f6c475e48ebaa6bbfe59fa69552, user_id=9d0dfa3267564edb8ef4cec960829f0f, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:26.863348 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae5e6fa-a735-4b9b-93ab-e053b2b0c854 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:26.876421 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1404/2807] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 13:04:26 2022] PUT /identity/v3/projects/747b0f6c475e48ebaa6bbfe59fa69552/users/9d0dfa3267564edb8ef4cec960829f0f/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 13:04:26.887404 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3d87a-f2e0-4301-846e-d34ff3c16916 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:26.887796 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3d87a-f2e0-4301-846e-d34ff3c16916 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:26.888079 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3d87a-f2e0-4301-846e-d34ff3c16916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:26.914555 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-80f3d87a-f2e0-4301-846e-d34ff3c16916 None None] MFA Rules not processed for user `9d0dfa3267564edb8ef4cec960829f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:04:26.915770 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-80f3d87a-f2e0-4301-846e-d34ff3c16916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:26.957928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:04:26.978863 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1404/2808] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 13:04:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 13:04:26.983111 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5e6fa-a735-4b9b-93ab-e053b2b0c854 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:26.988685 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:04:27.050143 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5e6fa-a735-4b9b-93ab-e053b2b0c854 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:27.054965 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2a3e0-b63a-40e8-acb7-6dd3fa3b59a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:27.055631 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2a3e0-b63a-40e8-acb7-6dd3fa3b59a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:27.055939 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2a3e0-b63a-40e8-acb7-6dd3fa3b59a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:27.056242 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2a3e0-b63a-40e8-acb7-6dd3fa3b59a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:27.056932 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2a3e0-b63a-40e8-acb7-6dd3fa3b59a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:27.058883 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2a3e0-b63a-40e8-acb7-6dd3fa3b59a7 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:27.083516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1405/2809] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 13:04:26 2022] POST /identity/v3/projects => generated 363 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 13:04:27.087956 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3d87a-f2e0-4301-846e-d34ff3c16916 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:27.099017 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3d87a-f2e0-4301-846e-d34ff3c16916 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:27.153880 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f2aaf-1b79-462f-9c71-6aa65d79907d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:27.154544 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f2aaf-1b79-462f-9c71-6aa65d79907d admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:27.154852 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f2aaf-1b79-462f-9c71-6aa65d79907d admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:27.155133 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f2aaf-1b79-462f-9c71-6aa65d79907d admin admin] PATH_INFO: `/v3/users` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:27.155817 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631f2aaf-1b79-462f-9c71-6aa65d79907d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:27.157736 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631f2aaf-1b79-462f-9c71-6aa65d79907d admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:27.176313 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1405/2810] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 13:04:27 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 13:04:27.180189 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2a3e0-b63a-40e8-acb7-6dd3fa3b59a7 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:27.190848 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2a3e0-b63a-40e8-acb7-6dd3fa3b59a7 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:27.195372 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434147ff-5a7b-4d96-9b08-67158eb96c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:27.196022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434147ff-5a7b-4d96-9b08-67158eb96c0d admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:27.196301 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434147ff-5a7b-4d96-9b08-67158eb96c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:27.196574 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434147ff-5a7b-4d96-9b08-67158eb96c0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:27.197294 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434147ff-5a7b-4d96-9b08-67158eb96c0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:27.198913 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434147ff-5a7b-4d96-9b08-67158eb96c0d admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:27.209716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1406/2811] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 13:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 13:04:27.213690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f2aaf-1b79-462f-9c71-6aa65d79907d admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:27.223456 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f2aaf-1b79-462f-9c71-6aa65d79907d admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:27.228094 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1b706-b047-410d-8983-594ae8ba878e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:27.228966 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1b706-b047-410d-8983-594ae8ba878e admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:27.229261 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1b706-b047-410d-8983-594ae8ba878e admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:27.229543 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1b706-b047-410d-8983-594ae8ba878e admin admin] PATH_INFO: `/v3/projects/ad136419488c4dd0b554cd05fc193eaf/users/c184bd5822314099a1c8c8141acb0f71/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:27.244249 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc1b706-b047-410d-8983-594ae8ba878e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad136419488c4dd0b554cd05fc193eaf, user_id=c184bd5822314099a1c8c8141acb0f71, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:27.247270 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc1b706-b047-410d-8983-594ae8ba878e admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:27.261026 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1406/2812] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 13:04:27 2022] PUT /identity/v3/projects/ad136419488c4dd0b554cd05fc193eaf/users/c184bd5822314099a1c8c8141acb0f71/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 13:04:27.265043 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434147ff-5a7b-4d96-9b08-67158eb96c0d admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:27.275514 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434147ff-5a7b-4d96-9b08-67158eb96c0d admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:27.330593 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7fa13-a0b4-4e47-b713-b957094011a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:27.331222 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7fa13-a0b4-4e47-b713-b957094011a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:27.331509 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7fa13-a0b4-4e47-b713-b957094011a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:27.331789 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7fa13-a0b4-4e47-b713-b957094011a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:27.332505 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7fa13-a0b4-4e47-b713-b957094011a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:27.334115 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7fa13-a0b4-4e47-b713-b957094011a8 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:27.343701 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1407/2813] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 13:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 13:04:27.347907 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1b706-b047-410d-8983-594ae8ba878e admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:27.358088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1b706-b047-410d-8983-594ae8ba878e admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:27.362673 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540ef39-e02b-4480-bb73-f2ca86775e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:27.363582 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540ef39-e02b-4480-bb73-f2ca86775e5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:27.363871 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540ef39-e02b-4480-bb73-f2ca86775e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:27.364149 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540ef39-e02b-4480-bb73-f2ca86775e5a admin admin] PATH_INFO: `/v3/projects/ad136419488c4dd0b554cd05fc193eaf/users/c184bd5822314099a1c8c8141acb0f71/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:27.366105 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540ef39-e02b-4480-bb73-f2ca86775e5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad136419488c4dd0b554cd05fc193eaf, user_id=c184bd5822314099a1c8c8141acb0f71, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:27.368809 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540ef39-e02b-4480-bb73-f2ca86775e5a admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:27.379539 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1407/2814] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 13:04:27 2022] PUT /identity/v3/projects/ad136419488c4dd0b554cd05fc193eaf/users/c184bd5822314099a1c8c8141acb0f71/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 13:04:27.389385 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2e489-f1cc-44f4-bf37-a1d2325f1135 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:27.389681 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2e489-f1cc-44f4-bf37-a1d2325f1135 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:27.389965 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2e489-f1cc-44f4-bf37-a1d2325f1135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:27.415989 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-0fc2e489-f1cc-44f4-bf37-a1d2325f1135 None None] MFA Rules not processed for user `c184bd5822314099a1c8c8141acb0f71`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:04:27.417193 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-0fc2e489-f1cc-44f4-bf37-a1d2325f1135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:27.479460 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:04:27.487514 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1408/2815] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 13:04:27 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 13:04:27.494679 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540ef39-e02b-4480-bb73-f2ca86775e5a admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:27.496681 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-f540ef39-e02b-4480-bb73-f2ca86775e5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:27.554393 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540ef39-e02b-4480-bb73-f2ca86775e5a admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:27.558045 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cde29-1229-4d2e-b907-84b982b7ce76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:27.558726 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cde29-1229-4d2e-b907-84b982b7ce76 service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:27.559019 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cde29-1229-4d2e-b907-84b982b7ce76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:27.559300 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cde29-1229-4d2e-b907-84b982b7ce76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:27.568831 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540cde29-1229-4d2e-b907-84b982b7ce76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:27.570282 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540cde29-1229-4d2e-b907-84b982b7ce76 service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:27.579733 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1408/2816] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 13:04:27 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 13:04:27.976146 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2e489-f1cc-44f4-bf37-a1d2325f1135 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:28.037783 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2e489-f1cc-44f4-bf37-a1d2325f1135 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:28.042241 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c8c31-3957-42c4-9068-3473ae37cd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:28.043132 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c8c31-3957-42c4-9068-3473ae37cd40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:28.043417 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c8c31-3957-42c4-9068-3473ae37cd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:28.043692 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c8c31-3957-42c4-9068-3473ae37cd40 admin admin] PATH_INFO: `/v3/users/9d0dfa3267564edb8ef4cec960829f0f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:28.044889 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c8c31-3957-42c4-9068-3473ae37cd40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d0dfa3267564edb8ef4cec960829f0f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:28.046841 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c8c31-3957-42c4-9068-3473ae37cd40 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:28.091037 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-f30c8c31-3957-42c4-9068-3473ae37cd40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d0dfa3267564edb8ef4cec960829f0f'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:28.091615 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-f30c8c31-3957-42c4-9068-3473ae37cd40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d0dfa3267564edb8ef4cec960829f0f'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:28.103652 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-f30c8c31-3957-42c4-9068-3473ae37cd40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d0dfa3267564edb8ef4cec960829f0f'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:28.111146 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-f30c8c31-3957-42c4-9068-3473ae37cd40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d0dfa3267564edb8ef4cec960829f0f'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:28.111769 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-f30c8c31-3957-42c4-9068-3473ae37cd40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d0dfa3267564edb8ef4cec960829f0f'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:28.124239 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1409/2817] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 13:04:27 2022] DELETE /identity/v3/users/9d0dfa3267564edb8ef4cec960829f0f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 13:04:28.128862 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad33f94-0b90-4098-851e-123c4ff7f9c9 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:28.129339 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad33f94-0b90-4098-851e-123c4ff7f9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:28.129440 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad33f94-0b90-4098-851e-123c4ff7f9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:28.146357 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-9ad33f94-0b90-4098-851e-123c4ff7f9c9 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:04:28.147591 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-9ad33f94-0b90-4098-851e-123c4ff7f9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:28.188216 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:04:28.209243 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1409/2818] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 13:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 13:04:28.219520 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c8c31-3957-42c4-9068-3473ae37cd40 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:28.220927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-f30c8c31-3957-42c4-9068-3473ae37cd40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:28.280927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c8c31-3957-42c4-9068-3473ae37cd40 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:28.285119 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f79e0-652a-426c-846d-c4b9a86994ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:28.285757 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f79e0-652a-426c-846d-c4b9a86994ab service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:28.286035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f79e0-652a-426c-846d-c4b9a86994ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:28.286306 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f79e0-652a-426c-846d-c4b9a86994ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:28.295404 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f79e0-652a-426c-846d-c4b9a86994ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:28.296844 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f79e0-652a-426c-846d-c4b9a86994ab service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:28.306361 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1410/2819] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 13:04:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 13:04:28.580067 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad33f94-0b90-4098-851e-123c4ff7f9c9 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:28.581518 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-9ad33f94-0b90-4098-851e-123c4ff7f9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:28.593788 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad33f94-0b90-4098-851e-123c4ff7f9c9 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:28.599043 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52728a7-2efe-4c14-8c24-d8af577df208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:28.599906 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52728a7-2efe-4c14-8c24-d8af577df208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:28.600192 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52728a7-2efe-4c14-8c24-d8af577df208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:28.600469 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52728a7-2efe-4c14-8c24-d8af577df208 admin admin] PATH_INFO: `/v3/projects/747b0f6c475e48ebaa6bbfe59fa69552` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:28.601647 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52728a7-2efe-4c14-8c24-d8af577df208 admin admin] RBAC: Authorizing `identity:delete_project(project_id=747b0f6c475e48ebaa6bbfe59fa69552)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:28.603596 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52728a7-2efe-4c14-8c24-d8af577df208 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:28.650515 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d52728a7-2efe-4c14-8c24-d8af577df208 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '747b0f6c475e48ebaa6bbfe59fa69552', 'request_id': 'req-d52728a7-2efe-4c14-8c24-d8af577df208'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:28.657646 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d52728a7-2efe-4c14-8c24-d8af577df208 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '747b0f6c475e48ebaa6bbfe59fa69552', 'request_id': 'req-d52728a7-2efe-4c14-8c24-d8af577df208'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:28.663782 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d52728a7-2efe-4c14-8c24-d8af577df208 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '747b0f6c475e48ebaa6bbfe59fa69552', 'request_id': 'req-d52728a7-2efe-4c14-8c24-d8af577df208'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:28.674047 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d52728a7-2efe-4c14-8c24-d8af577df208 admin admin] The token cache is being invalidate because project 747b0f6c475e48ebaa6bbfe59fa69552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 13:04:28.674333 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d52728a7-2efe-4c14-8c24-d8af577df208 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:28.674976 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d52728a7-2efe-4c14-8c24-d8af577df208 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:28.676486 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1410/2820] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 13:04:28 2022] DELETE /identity/v3/projects/747b0f6c475e48ebaa6bbfe59fa69552 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 13:04:28.680658 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f79e0-652a-426c-846d-c4b9a86994ab service neutron] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:28.690737 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f79e0-652a-426c-846d-c4b9a86994ab service neutron] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:28.708781 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:04:28.751685 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24112a26-a0ca-4c60-bc1b-717aeacd5128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:28.752566 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24112a26-a0ca-4c60-bc1b-717aeacd5128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:28.752851 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24112a26-a0ca-4c60-bc1b-717aeacd5128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:28.753129 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24112a26-a0ca-4c60-bc1b-717aeacd5128 admin admin] PATH_INFO: `/v3/users/c184bd5822314099a1c8c8141acb0f71` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:28.754331 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24112a26-a0ca-4c60-bc1b-717aeacd5128 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c184bd5822314099a1c8c8141acb0f71)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:28.756369 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24112a26-a0ca-4c60-bc1b-717aeacd5128 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:28.800579 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-24112a26-a0ca-4c60-bc1b-717aeacd5128 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c184bd5822314099a1c8c8141acb0f71'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:28.801248 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-24112a26-a0ca-4c60-bc1b-717aeacd5128 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c184bd5822314099a1c8c8141acb0f71'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:28.813492 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-24112a26-a0ca-4c60-bc1b-717aeacd5128 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c184bd5822314099a1c8c8141acb0f71'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:28.820425 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-24112a26-a0ca-4c60-bc1b-717aeacd5128 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c184bd5822314099a1c8c8141acb0f71'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:28.821136 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-24112a26-a0ca-4c60-bc1b-717aeacd5128 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c184bd5822314099a1c8c8141acb0f71'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:28.833634 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1411/2821] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 13:04:28 2022] DELETE /identity/v3/users/c184bd5822314099a1c8c8141acb0f71 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 13:04:29.095243 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52728a7-2efe-4c14-8c24-d8af577df208 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:29.096919 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-d52728a7-2efe-4c14-8c24-d8af577df208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:29.110823 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52728a7-2efe-4c14-8c24-d8af577df208 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:29.167783 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132c2d9-e3c3-4c28-8147-2eae19f7c7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:29.168648 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132c2d9-e3c3-4c28-8147-2eae19f7c7e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:29.168933 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132c2d9-e3c3-4c28-8147-2eae19f7c7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:29.169207 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132c2d9-e3c3-4c28-8147-2eae19f7c7e5 admin admin] PATH_INFO: `/v3/projects/ad136419488c4dd0b554cd05fc193eaf` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:29.170379 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132c2d9-e3c3-4c28-8147-2eae19f7c7e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad136419488c4dd0b554cd05fc193eaf)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:29.172881 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132c2d9-e3c3-4c28-8147-2eae19f7c7e5 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:29.218771 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d132c2d9-e3c3-4c28-8147-2eae19f7c7e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad136419488c4dd0b554cd05fc193eaf', 'request_id': 'req-d132c2d9-e3c3-4c28-8147-2eae19f7c7e5'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:29.225860 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d132c2d9-e3c3-4c28-8147-2eae19f7c7e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad136419488c4dd0b554cd05fc193eaf', 'request_id': 'req-d132c2d9-e3c3-4c28-8147-2eae19f7c7e5'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:29.231886 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d132c2d9-e3c3-4c28-8147-2eae19f7c7e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad136419488c4dd0b554cd05fc193eaf', 'request_id': 'req-d132c2d9-e3c3-4c28-8147-2eae19f7c7e5'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:29.237066 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:04:29.244739 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d132c2d9-e3c3-4c28-8147-2eae19f7c7e5 admin admin] The token cache is being invalidate because project ad136419488c4dd0b554cd05fc193eaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 13:04:29.245083 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d132c2d9-e3c3-4c28-8147-2eae19f7c7e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:29.246194 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d132c2d9-e3c3-4c28-8147-2eae19f7c7e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:29.247847 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1411/2822] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 13:04:29 2022] DELETE /identity/v3/projects/ad136419488c4dd0b554cd05fc193eaf => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 13:04:29.253251 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f30e6-7001-4376-a7a2-f4f7b20642b5 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:29.253740 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f30e6-7001-4376-a7a2-f4f7b20642b5 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:29.253844 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f30e6-7001-4376-a7a2-f4f7b20642b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:29.271949 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-e89f30e6-7001-4376-a7a2-f4f7b20642b5 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:04:29.273161 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-e89f30e6-7001-4376-a7a2-f4f7b20642b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:29.330836 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1412/2823] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 13:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 13:04:29.338473 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc0e85-1693-4c03-88e0-141f6fbbf9c8 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:29.338820 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc0e85-1693-4c03-88e0-141f6fbbf9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:29.339104 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc0e85-1693-4c03-88e0-141f6fbbf9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:29.356833 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-1edc0e85-1693-4c03-88e0-141f6fbbf9c8 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:04:29.358023 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-1edc0e85-1693-4c03-88e0-141f6fbbf9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:29.366686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1412/2824] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 13:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 13:04:29.370479 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f30e6-7001-4376-a7a2-f4f7b20642b5 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:29.380725 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f30e6-7001-4376-a7a2-f4f7b20642b5 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:29.385218 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c2e25-cb44-4806-a330-287d22684676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:29.385863 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c2e25-cb44-4806-a330-287d22684676 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:29.386152 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c2e25-cb44-4806-a330-287d22684676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:29.386430 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c2e25-cb44-4806-a330-287d22684676 admin admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:29.387183 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c2e25-cb44-4806-a330-287d22684676 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 13:04:29.387494 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c2e25-cb44-4806-a330-287d22684676 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:29.389106 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c2e25-cb44-4806-a330-287d22684676 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:29.400454 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1413/2825] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 13:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 13:04:29.404683 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc0e85-1693-4c03-88e0-141f6fbbf9c8 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:29.414399 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc0e85-1693-4c03-88e0-141f6fbbf9c8 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:29.419244 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2e975-fa1b-434b-b49d-38a093d1831f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:29.419894 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2e975-fa1b-434b-b49d-38a093d1831f admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:29.420180 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2e975-fa1b-434b-b49d-38a093d1831f admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:29.420457 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2e975-fa1b-434b-b49d-38a093d1831f admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:29.421150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2e975-fa1b-434b-b49d-38a093d1831f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:29.423672 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2e975-fa1b-434b-b49d-38a093d1831f admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:29.447923 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1413/2826] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 13:04:29 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 13:04:29.452014 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c2e25-cb44-4806-a330-287d22684676 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:29.461772 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c2e25-cb44-4806-a330-287d22684676 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:29.489044 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:04:29.520192 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691dce1-aa75-4c66-9046-b3458df6f3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:29.520861 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691dce1-aa75-4c66-9046-b3458df6f3c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:29.521173 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691dce1-aa75-4c66-9046-b3458df6f3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:29.521451 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691dce1-aa75-4c66-9046-b3458df6f3c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:29.522131 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691dce1-aa75-4c66-9046-b3458df6f3c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:29.524106 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691dce1-aa75-4c66-9046-b3458df6f3c1 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:29.543629 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1414/2827] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 13:04:29 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 13:04:29.548201 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2e975-fa1b-434b-b49d-38a093d1831f admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:29.558537 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2e975-fa1b-434b-b49d-38a093d1831f admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:29.563246 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daadfe06-d69a-4f5a-b504-98af0b4c1972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:29.563905 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadfe06-d69a-4f5a-b504-98af0b4c1972 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:29.564216 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadfe06-d69a-4f5a-b504-98af0b4c1972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:29.564493 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadfe06-d69a-4f5a-b504-98af0b4c1972 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:29.565213 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daadfe06-d69a-4f5a-b504-98af0b4c1972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:29.566893 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daadfe06-d69a-4f5a-b504-98af0b4c1972 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:29.577105 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1414/2828] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 13:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 13:04:29.580901 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691dce1-aa75-4c66-9046-b3458df6f3c1 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:29.590658 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691dce1-aa75-4c66-9046-b3458df6f3c1 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:29.595766 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734a785-ef92-4634-92dd-afb53db2a414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:29.596414 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734a785-ef92-4634-92dd-afb53db2a414 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:29.596702 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734a785-ef92-4634-92dd-afb53db2a414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:29.596977 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734a785-ef92-4634-92dd-afb53db2a414 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:29.597691 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3734a785-ef92-4634-92dd-afb53db2a414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:29.599331 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3734a785-ef92-4634-92dd-afb53db2a414 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:29.609014 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1415/2829] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 13:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 13:04:29.613495 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daadfe06-d69a-4f5a-b504-98af0b4c1972 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:29.624498 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daadfe06-d69a-4f5a-b504-98af0b4c1972 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:29.629134 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93e88d-d942-4edf-8ef2-fc6654683453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:29.630026 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93e88d-d942-4edf-8ef2-fc6654683453 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:29.630308 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93e88d-d942-4edf-8ef2-fc6654683453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:29.630583 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93e88d-d942-4edf-8ef2-fc6654683453 admin admin] PATH_INFO: `/v3/projects/a463f3ea408d4c62aac2a552014242f1/users/5d5672d9a96e432a8983c24888e5966f/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:29.644800 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93e88d-d942-4edf-8ef2-fc6654683453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a463f3ea408d4c62aac2a552014242f1, user_id=5d5672d9a96e432a8983c24888e5966f, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:29.647493 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93e88d-d942-4edf-8ef2-fc6654683453 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:29.660389 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1415/2830] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 13:04:29 2022] PUT /identity/v3/projects/a463f3ea408d4c62aac2a552014242f1/users/5d5672d9a96e432a8983c24888e5966f/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 13:04:29.716934 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7026582-42bc-4f10-a5a7-b892266ef741 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:29.717241 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7026582-42bc-4f10-a5a7-b892266ef741 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:29.717491 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7026582-42bc-4f10-a5a7-b892266ef741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:29.745076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-b7026582-42bc-4f10-a5a7-b892266ef741 None None] MFA Rules not processed for user `5d5672d9a96e432a8983c24888e5966f`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:04:29.746604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-b7026582-42bc-4f10-a5a7-b892266ef741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:29.812180 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1416/2831] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 13:04:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 13:04:29.816563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93e88d-d942-4edf-8ef2-fc6654683453 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:29.877273 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93e88d-d942-4edf-8ef2-fc6654683453 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:29.881837 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01992a03-7b87-4d6a-9456-40e73ccf8508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:29.882491 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01992a03-7b87-4d6a-9456-40e73ccf8508 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:29.882805 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01992a03-7b87-4d6a-9456-40e73ccf8508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:29.883085 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01992a03-7b87-4d6a-9456-40e73ccf8508 admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:29.883778 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01992a03-7b87-4d6a-9456-40e73ccf8508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:29.885673 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01992a03-7b87-4d6a-9456-40e73ccf8508 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:29.910682 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1416/2832] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 13:04:29 2022] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 13:04:29.914806 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7026582-42bc-4f10-a5a7-b892266ef741 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:29.925139 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7026582-42bc-4f10-a5a7-b892266ef741 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:29.979537 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ed79f-0857-4c00-83a4-15533db90c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:29.980192 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ed79f-0857-4c00-83a4-15533db90c9f admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:29.980473 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ed79f-0857-4c00-83a4-15533db90c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:29.980747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ed79f-0857-4c00-83a4-15533db90c9f admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:29.981418 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ed79f-0857-4c00-83a4-15533db90c9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:29.983392 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ed79f-0857-4c00-83a4-15533db90c9f admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:30.003778 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1417/2833] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 13:04:29 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 13:04:30.007652 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01992a03-7b87-4d6a-9456-40e73ccf8508 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:30.018478 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01992a03-7b87-4d6a-9456-40e73ccf8508 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:30.023171 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11d4b9-81fb-4da8-8081-7e81dbb40660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:30.023871 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11d4b9-81fb-4da8-8081-7e81dbb40660 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:30.024160 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11d4b9-81fb-4da8-8081-7e81dbb40660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:30.024455 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11d4b9-81fb-4da8-8081-7e81dbb40660 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:30.025159 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11d4b9-81fb-4da8-8081-7e81dbb40660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:30.026800 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11d4b9-81fb-4da8-8081-7e81dbb40660 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:30.037939 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1417/2834] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 13:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 13:04:30.041824 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ed79f-0857-4c00-83a4-15533db90c9f admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:30.051701 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ed79f-0857-4c00-83a4-15533db90c9f admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:30.056284 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b69f6-c970-4fba-9540-fcffbb0aa2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:30.057158 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b69f6-c970-4fba-9540-fcffbb0aa2f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:30.057444 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b69f6-c970-4fba-9540-fcffbb0aa2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:30.057722 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b69f6-c970-4fba-9540-fcffbb0aa2f5 admin admin] PATH_INFO: `/v3/projects/0e2363c793e54b59aa53dc3786acbc6c/users/f6c27a04f6cf41fe8dbe665612fc2f1d/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:30.072126 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b69f6-c970-4fba-9540-fcffbb0aa2f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e2363c793e54b59aa53dc3786acbc6c, user_id=f6c27a04f6cf41fe8dbe665612fc2f1d, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:30.074852 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b69f6-c970-4fba-9540-fcffbb0aa2f5 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:30.088033 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1418/2835] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 13:04:30 2022] PUT /identity/v3/projects/0e2363c793e54b59aa53dc3786acbc6c/users/f6c27a04f6cf41fe8dbe665612fc2f1d/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 13:04:30.091767 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11d4b9-81fb-4da8-8081-7e81dbb40660 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:30.102067 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11d4b9-81fb-4da8-8081-7e81dbb40660 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:30.156383 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cfe56-94e2-4f86-b6d3-1b93ff25e13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:30.157055 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cfe56-94e2-4f86-b6d3-1b93ff25e13b admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:30.157343 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cfe56-94e2-4f86-b6d3-1b93ff25e13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:30.157624 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cfe56-94e2-4f86-b6d3-1b93ff25e13b admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:30.158351 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cfe56-94e2-4f86-b6d3-1b93ff25e13b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:30.159999 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cfe56-94e2-4f86-b6d3-1b93ff25e13b admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:30.169783 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1418/2836] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 13:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 13:04:30.174025 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b69f6-c970-4fba-9540-fcffbb0aa2f5 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:30.179674 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:04:30.186159 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b69f6-c970-4fba-9540-fcffbb0aa2f5 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:30.191537 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3d863-d33c-4de7-8610-1dd0a63e0acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:30.192415 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3d863-d33c-4de7-8610-1dd0a63e0acd admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:30.192697 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3d863-d33c-4de7-8610-1dd0a63e0acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:30.192970 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3d863-d33c-4de7-8610-1dd0a63e0acd admin admin] PATH_INFO: `/v3/projects/0e2363c793e54b59aa53dc3786acbc6c/users/f6c27a04f6cf41fe8dbe665612fc2f1d/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:30.194994 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3d863-d33c-4de7-8610-1dd0a63e0acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e2363c793e54b59aa53dc3786acbc6c, user_id=f6c27a04f6cf41fe8dbe665612fc2f1d, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:30.197704 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3d863-d33c-4de7-8610-1dd0a63e0acd admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:30.208438 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1419/2837] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 13:04:30 2022] PUT /identity/v3/projects/0e2363c793e54b59aa53dc3786acbc6c/users/f6c27a04f6cf41fe8dbe665612fc2f1d/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 13:04:30.218367 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf71973-c0fe-48db-a5cc-9d1fa22ad0f5 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:30.218692 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf71973-c0fe-48db-a5cc-9d1fa22ad0f5 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:30.218978 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf71973-c0fe-48db-a5cc-9d1fa22ad0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:30.224727 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:04:30.245650 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-2cf71973-c0fe-48db-a5cc-9d1fa22ad0f5 None None] MFA Rules not processed for user `f6c27a04f6cf41fe8dbe665612fc2f1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:04:30.247156 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-2cf71973-c0fe-48db-a5cc-9d1fa22ad0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:30.315074 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1419/2838] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 13:04:30 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 13:04:30.326335 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3d863-d33c-4de7-8610-1dd0a63e0acd admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:30.328109 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-88c3d863-d33c-4de7-8610-1dd0a63e0acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:30.387126 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3d863-d33c-4de7-8610-1dd0a63e0acd admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:30.390845 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27908759-1433-44d8-84b4-ed0b564f4001 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:30.392045 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27908759-1433-44d8-84b4-ed0b564f4001 service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:30.392332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27908759-1433-44d8-84b4-ed0b564f4001 service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:30.392608 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27908759-1433-44d8-84b4-ed0b564f4001 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:30.401663 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27908759-1433-44d8-84b4-ed0b564f4001 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:30.403145 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27908759-1433-44d8-84b4-ed0b564f4001 service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:30.412472 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1420/2839] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 13:04:30 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 13:04:30.454380 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf71973-c0fe-48db-a5cc-9d1fa22ad0f5 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:30.455831 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-2cf71973-c0fe-48db-a5cc-9d1fa22ad0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:30.467729 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf71973-c0fe-48db-a5cc-9d1fa22ad0f5 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:30.471321 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446aaf78-5e05-4ba7-b90c-fbbd80360990 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:30.471951 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446aaf78-5e05-4ba7-b90c-fbbd80360990 service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:30.472231 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446aaf78-5e05-4ba7-b90c-fbbd80360990 service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:30.472505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446aaf78-5e05-4ba7-b90c-fbbd80360990 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:30.527914 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446aaf78-5e05-4ba7-b90c-fbbd80360990 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:30.529336 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446aaf78-5e05-4ba7-b90c-fbbd80360990 service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:30.538030 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1420/2840] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 13:04:30 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 13:04:33.783703 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27908759-1433-44d8-84b4-ed0b564f4001 service cinder] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:33.844126 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27908759-1433-44d8-84b4-ed0b564f4001 service cinder] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:33.848599 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1693c7-f267-4b41-907b-54d057f9a276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:33.849457 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1693c7-f267-4b41-907b-54d057f9a276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:33.849740 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1693c7-f267-4b41-907b-54d057f9a276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:33.850015 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1693c7-f267-4b41-907b-54d057f9a276 admin admin] PATH_INFO: `/v3/users/5d5672d9a96e432a8983c24888e5966f` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:33.851208 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1693c7-f267-4b41-907b-54d057f9a276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d5672d9a96e432a8983c24888e5966f)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:33.853124 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1693c7-f267-4b41-907b-54d057f9a276 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:33.898500 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-6f1693c7-f267-4b41-907b-54d057f9a276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d5672d9a96e432a8983c24888e5966f'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:33.899167 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-6f1693c7-f267-4b41-907b-54d057f9a276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d5672d9a96e432a8983c24888e5966f'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:33.911024 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-6f1693c7-f267-4b41-907b-54d057f9a276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d5672d9a96e432a8983c24888e5966f'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:33.918119 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-6f1693c7-f267-4b41-907b-54d057f9a276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d5672d9a96e432a8983c24888e5966f'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:33.918900 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-6f1693c7-f267-4b41-907b-54d057f9a276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d5672d9a96e432a8983c24888e5966f'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:33.931441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1421/2841] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 13:04:33 2022] DELETE /identity/v3/users/5d5672d9a96e432a8983c24888e5966f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 13:04:33.936064 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5733a-dea4-4f0b-9559-a4f4578cab49 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:33.936549 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5733a-dea4-4f0b-9559-a4f4578cab49 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:33.936641 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5733a-dea4-4f0b-9559-a4f4578cab49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:33.953058 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-9cd5733a-dea4-4f0b-9559-a4f4578cab49 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:04:33.954239 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-9cd5733a-dea4-4f0b-9559-a4f4578cab49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:34.011700 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1421/2842] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 13:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 13:04:34.021220 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1693c7-f267-4b41-907b-54d057f9a276 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:34.022613 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-6f1693c7-f267-4b41-907b-54d057f9a276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:34.036112 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:04:34.082362 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1693c7-f267-4b41-907b-54d057f9a276 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:34.085984 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465c61f-f34d-4ce5-b841-0c010d4927b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:34.086624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465c61f-f34d-4ce5-b841-0c010d4927b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:34.086939 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465c61f-f34d-4ce5-b841-0c010d4927b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:34.087217 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465c61f-f34d-4ce5-b841-0c010d4927b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:34.096655 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465c61f-f34d-4ce5-b841-0c010d4927b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:34.098098 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465c61f-f34d-4ce5-b841-0c010d4927b7 service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:34.107369 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1422/2843] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 13:04:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 13:04:34.369841 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5733a-dea4-4f0b-9559-a4f4578cab49 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:34.371559 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-9cd5733a-dea4-4f0b-9559-a4f4578cab49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:34.383468 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5733a-dea4-4f0b-9559-a4f4578cab49 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:34.388133 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36c2cc-d126-4b53-a2ea-6f716e88b66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:34.389004 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36c2cc-d126-4b53-a2ea-6f716e88b66f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:34.389310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36c2cc-d126-4b53-a2ea-6f716e88b66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:34.389566 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36c2cc-d126-4b53-a2ea-6f716e88b66f admin admin] PATH_INFO: `/v3/projects/a463f3ea408d4c62aac2a552014242f1` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:34.391016 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e36c2cc-d126-4b53-a2ea-6f716e88b66f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a463f3ea408d4c62aac2a552014242f1)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:34.393980 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e36c2cc-d126-4b53-a2ea-6f716e88b66f admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:34.420638 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:04:34.443477 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-7e36c2cc-d126-4b53-a2ea-6f716e88b66f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a463f3ea408d4c62aac2a552014242f1', 'request_id': 'req-7e36c2cc-d126-4b53-a2ea-6f716e88b66f'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:34.450484 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-7e36c2cc-d126-4b53-a2ea-6f716e88b66f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a463f3ea408d4c62aac2a552014242f1', 'request_id': 'req-7e36c2cc-d126-4b53-a2ea-6f716e88b66f'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:34.457421 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-7e36c2cc-d126-4b53-a2ea-6f716e88b66f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a463f3ea408d4c62aac2a552014242f1', 'request_id': 'req-7e36c2cc-d126-4b53-a2ea-6f716e88b66f'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:34.467827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-7e36c2cc-d126-4b53-a2ea-6f716e88b66f admin admin] The token cache is being invalidate because project a463f3ea408d4c62aac2a552014242f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 13:04:34.468113 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-7e36c2cc-d126-4b53-a2ea-6f716e88b66f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:34.468747 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-7e36c2cc-d126-4b53-a2ea-6f716e88b66f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:34.470959 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1422/2844] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 13:04:34 2022] DELETE /identity/v3/projects/a463f3ea408d4c62aac2a552014242f1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 13:04:34.474866 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465c61f-f34d-4ce5-b841-0c010d4927b7 service neutron] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:34.484261 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465c61f-f34d-4ce5-b841-0c010d4927b7 service neutron] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:34.539560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a2627-b6a5-4fa3-8b90-53f32d204aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:34.540424 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a2627-b6a5-4fa3-8b90-53f32d204aba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:34.540705 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a2627-b6a5-4fa3-8b90-53f32d204aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:34.540981 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a2627-b6a5-4fa3-8b90-53f32d204aba admin admin] PATH_INFO: `/v3/users/f6c27a04f6cf41fe8dbe665612fc2f1d` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:34.542144 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a2627-b6a5-4fa3-8b90-53f32d204aba admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6c27a04f6cf41fe8dbe665612fc2f1d)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:34.544174 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a2627-b6a5-4fa3-8b90-53f32d204aba admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:34.588436 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-d86a2627-b6a5-4fa3-8b90-53f32d204aba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6c27a04f6cf41fe8dbe665612fc2f1d'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:34.589075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-d86a2627-b6a5-4fa3-8b90-53f32d204aba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6c27a04f6cf41fe8dbe665612fc2f1d'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:34.601628 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-d86a2627-b6a5-4fa3-8b90-53f32d204aba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6c27a04f6cf41fe8dbe665612fc2f1d'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:34.608684 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-d86a2627-b6a5-4fa3-8b90-53f32d204aba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6c27a04f6cf41fe8dbe665612fc2f1d'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:34.609345 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-d86a2627-b6a5-4fa3-8b90-53f32d204aba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6c27a04f6cf41fe8dbe665612fc2f1d'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:34.621684 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1423/2845] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 13:04:34 2022] DELETE /identity/v3/users/f6c27a04f6cf41fe8dbe665612fc2f1d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 13:04:34.896622 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36c2cc-d126-4b53-a2ea-6f716e88b66f admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:34.898213 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-7e36c2cc-d126-4b53-a2ea-6f716e88b66f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:34.913864 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36c2cc-d126-4b53-a2ea-6f716e88b66f admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:34.974047 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc92e5a-1cfc-48bb-b6fb-b191f06dc441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:34.974950 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc92e5a-1cfc-48bb-b6fb-b191f06dc441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:34.975232 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc92e5a-1cfc-48bb-b6fb-b191f06dc441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:34.975504 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc92e5a-1cfc-48bb-b6fb-b191f06dc441 admin admin] PATH_INFO: `/v3/projects/0e2363c793e54b59aa53dc3786acbc6c` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:34.976740 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc92e5a-1cfc-48bb-b6fb-b191f06dc441 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e2363c793e54b59aa53dc3786acbc6c)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:34.978959 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc92e5a-1cfc-48bb-b6fb-b191f06dc441 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:35.026265 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-3cc92e5a-1cfc-48bb-b6fb-b191f06dc441 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e2363c793e54b59aa53dc3786acbc6c', 'request_id': 'req-3cc92e5a-1cfc-48bb-b6fb-b191f06dc441'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:35.033423 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-3cc92e5a-1cfc-48bb-b6fb-b191f06dc441 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e2363c793e54b59aa53dc3786acbc6c', 'request_id': 'req-3cc92e5a-1cfc-48bb-b6fb-b191f06dc441'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:35.039690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-3cc92e5a-1cfc-48bb-b6fb-b191f06dc441 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e2363c793e54b59aa53dc3786acbc6c', 'request_id': 'req-3cc92e5a-1cfc-48bb-b6fb-b191f06dc441'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:35.050211 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-3cc92e5a-1cfc-48bb-b6fb-b191f06dc441 admin admin] The token cache is being invalidate because project 0e2363c793e54b59aa53dc3786acbc6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 13:04:35.050498 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-3cc92e5a-1cfc-48bb-b6fb-b191f06dc441 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:35.051150 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-3cc92e5a-1cfc-48bb-b6fb-b191f06dc441 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:35.052684 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1423/2846] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 13:04:34 2022] DELETE /identity/v3/projects/0e2363c793e54b59aa53dc3786acbc6c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 13:04:35.057988 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9dbf3-ec8a-4370-8035-d7e882caaa41 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:35.058468 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9dbf3-ec8a-4370-8035-d7e882caaa41 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:35.058559 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9dbf3-ec8a-4370-8035-d7e882caaa41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:35.078215 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-9ba9dbf3-ec8a-4370-8035-d7e882caaa41 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:04:35.079372 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-9ba9dbf3-ec8a-4370-8035-d7e882caaa41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:35.107270 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:04:35.140929 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1424/2847] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 13:04:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 13:04:35.149433 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264daa99-8b59-49ca-b537-e2ed1f87264a None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:35.149727 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264daa99-8b59-49ca-b537-e2ed1f87264a None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:35.150007 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264daa99-8b59-49ca-b537-e2ed1f87264a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:35.167774 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-264daa99-8b59-49ca-b537-e2ed1f87264a None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:04:35.168969 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-264daa99-8b59-49ca-b537-e2ed1f87264a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:35.177338 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1424/2848] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 13:04:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 13:04:35.181353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9dbf3-ec8a-4370-8035-d7e882caaa41 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:35.191766 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9dbf3-ec8a-4370-8035-d7e882caaa41 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:35.196534 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e94be1-c543-46b8-87f8-107c39e2680f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:35.197184 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e94be1-c543-46b8-87f8-107c39e2680f admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:35.197470 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e94be1-c543-46b8-87f8-107c39e2680f admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:35.197746 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e94be1-c543-46b8-87f8-107c39e2680f admin admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:35.198464 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e94be1-c543-46b8-87f8-107c39e2680f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 13:04:35.198809 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e94be1-c543-46b8-87f8-107c39e2680f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:35.200424 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e94be1-c543-46b8-87f8-107c39e2680f admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:35.212016 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1425/2849] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 13:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 13:04:35.216010 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264daa99-8b59-49ca-b537-e2ed1f87264a None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:35.225112 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264daa99-8b59-49ca-b537-e2ed1f87264a None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:35.229785 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bef63f-38a9-4d1f-9337-ca612215eefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:35.230433 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bef63f-38a9-4d1f-9337-ca612215eefc admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:35.230759 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bef63f-38a9-4d1f-9337-ca612215eefc admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:35.231042 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bef63f-38a9-4d1f-9337-ca612215eefc admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:35.231726 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bef63f-38a9-4d1f-9337-ca612215eefc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:35.233622 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bef63f-38a9-4d1f-9337-ca612215eefc admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:35.259609 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1425/2850] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 13:04:35 2022] POST /identity/v3/projects => generated 399 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 13:04:35.263783 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e94be1-c543-46b8-87f8-107c39e2680f admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:35.273636 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e94be1-c543-46b8-87f8-107c39e2680f admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:35.329776 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4495a-8c31-43a1-862b-c82d86ac6cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:35.330370 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4495a-8c31-43a1-862b-c82d86ac6cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:35.330674 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4495a-8c31-43a1-862b-c82d86ac6cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:35.330956 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4495a-8c31-43a1-862b-c82d86ac6cc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:35.331634 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4495a-8c31-43a1-862b-c82d86ac6cc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:35.333552 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4495a-8c31-43a1-862b-c82d86ac6cc4 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:35.352639 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1426/2851] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 13:04:35 2022] POST /identity/v3/users => generated 300 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 13:04:35.357224 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bef63f-38a9-4d1f-9337-ca612215eefc admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:35.368451 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bef63f-38a9-4d1f-9337-ca612215eefc admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:35.373407 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb55262-5ba6-4d79-9dd1-a387303117cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:35.374072 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb55262-5ba6-4d79-9dd1-a387303117cd admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:35.374357 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb55262-5ba6-4d79-9dd1-a387303117cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:35.374655 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb55262-5ba6-4d79-9dd1-a387303117cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:35.375392 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb55262-5ba6-4d79-9dd1-a387303117cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:35.377566 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb55262-5ba6-4d79-9dd1-a387303117cd admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:35.382676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:04:35.389119 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1426/2852] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 13:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 13:04:35.392832 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4495a-8c31-43a1-862b-c82d86ac6cc4 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:35.402720 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4495a-8c31-43a1-862b-c82d86ac6cc4 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:35.407734 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf7a02-a1a7-44a1-96d9-b13818be65b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:35.408379 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf7a02-a1a7-44a1-96d9-b13818be65b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:35.408657 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf7a02-a1a7-44a1-96d9-b13818be65b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:35.408931 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf7a02-a1a7-44a1-96d9-b13818be65b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:35.409642 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf7a02-a1a7-44a1-96d9-b13818be65b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:35.411339 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf7a02-a1a7-44a1-96d9-b13818be65b8 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:35.420982 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1427/2853] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 13:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 13:04:35.425502 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb55262-5ba6-4d79-9dd1-a387303117cd admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:35.435817 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb55262-5ba6-4d79-9dd1-a387303117cd admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:35.440586 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a7311-1cc2-493b-8c12-346b3aa729a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:35.441457 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a7311-1cc2-493b-8c12-346b3aa729a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:35.441743 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a7311-1cc2-493b-8c12-346b3aa729a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:35.442022 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a7311-1cc2-493b-8c12-346b3aa729a2 admin admin] PATH_INFO: `/v3/projects/cfeba5aa5bd94ca18a909c1896b2d5e5/users/8f95333fcb7e4766881d5ce03c37e26a/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:35.456505 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a7311-1cc2-493b-8c12-346b3aa729a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfeba5aa5bd94ca18a909c1896b2d5e5, user_id=8f95333fcb7e4766881d5ce03c37e26a, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:35.459233 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a7311-1cc2-493b-8c12-346b3aa729a2 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:35.472315 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1427/2854] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 13:04:35 2022] PUT /identity/v3/projects/cfeba5aa5bd94ca18a909c1896b2d5e5/users/8f95333fcb7e4766881d5ce03c37e26a/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 13:04:35.482602 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a2a72-41c8-42ab-828d-9b8097174657 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:35.482926 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a2a72-41c8-42ab-828d-9b8097174657 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:35.483210 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a2a72-41c8-42ab-828d-9b8097174657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:35.510257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-183a2a72-41c8-42ab-828d-9b8097174657 None None] MFA Rules not processed for user `8f95333fcb7e4766881d5ce03c37e26a`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:04:35.511495 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-183a2a72-41c8-42ab-828d-9b8097174657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:35.573349 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1428/2855] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 13:04:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 13:04:35.577831 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a7311-1cc2-493b-8c12-346b3aa729a2 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:35.639009 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a7311-1cc2-493b-8c12-346b3aa729a2 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:35.643610 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981de1e2-01bb-49fb-8f92-3d029d22f2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:35.644260 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981de1e2-01bb-49fb-8f92-3d029d22f2b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:35.644547 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981de1e2-01bb-49fb-8f92-3d029d22f2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:35.644829 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981de1e2-01bb-49fb-8f92-3d029d22f2b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:35.645508 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981de1e2-01bb-49fb-8f92-3d029d22f2b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:35.647445 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981de1e2-01bb-49fb-8f92-3d029d22f2b4 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:35.673796 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1428/2856] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 13:04:35 2022] POST /identity/v3/projects => generated 395 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 13:04:35.677952 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a2a72-41c8-42ab-828d-9b8097174657 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:35.688786 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a2a72-41c8-42ab-828d-9b8097174657 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:35.714044 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:04:35.749545 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9ac5a-e28e-49be-84d7-ae63684fb89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:35.750223 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9ac5a-e28e-49be-84d7-ae63684fb89b admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:35.750510 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9ac5a-e28e-49be-84d7-ae63684fb89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:35.750853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9ac5a-e28e-49be-84d7-ae63684fb89b admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:35.751548 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9ac5a-e28e-49be-84d7-ae63684fb89b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:35.753485 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9ac5a-e28e-49be-84d7-ae63684fb89b admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:35.773037 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1429/2857] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 13:04:35 2022] POST /identity/v3/users => generated 304 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 13:04:35.777143 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981de1e2-01bb-49fb-8f92-3d029d22f2b4 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:35.788030 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981de1e2-01bb-49fb-8f92-3d029d22f2b4 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:35.792615 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e781f-65cb-44fa-9977-52c2a437c3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:35.793280 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e781f-65cb-44fa-9977-52c2a437c3ad admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:35.793569 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e781f-65cb-44fa-9977-52c2a437c3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:35.793850 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e781f-65cb-44fa-9977-52c2a437c3ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:35.794585 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e781f-65cb-44fa-9977-52c2a437c3ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:35.796234 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e781f-65cb-44fa-9977-52c2a437c3ad admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:35.806677 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1429/2858] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 13:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 13:04:35.810610 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9ac5a-e28e-49be-84d7-ae63684fb89b admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:35.820356 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9ac5a-e28e-49be-84d7-ae63684fb89b admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:35.824920 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f245e7-7aad-4cf0-8fc2-d1735b881972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:35.825784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f245e7-7aad-4cf0-8fc2-d1735b881972 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:35.826064 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f245e7-7aad-4cf0-8fc2-d1735b881972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:35.826337 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f245e7-7aad-4cf0-8fc2-d1735b881972 admin admin] PATH_INFO: `/v3/projects/7cd9eb2a67f84b7b879475561df6ad7e/users/947796681bc342c1afa51e59bb8f3f3d/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:35.841050 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f245e7-7aad-4cf0-8fc2-d1735b881972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cd9eb2a67f84b7b879475561df6ad7e, user_id=947796681bc342c1afa51e59bb8f3f3d, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:35.843768 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f245e7-7aad-4cf0-8fc2-d1735b881972 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:35.856875 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1430/2859] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 13:04:35 2022] PUT /identity/v3/projects/7cd9eb2a67f84b7b879475561df6ad7e/users/947796681bc342c1afa51e59bb8f3f3d/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 13:04:35.860742 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e781f-65cb-44fa-9977-52c2a437c3ad admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:35.870483 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e781f-65cb-44fa-9977-52c2a437c3ad admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:35.925762 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a249d5f-6341-4c1f-a28f-4139423c8aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:35.926431 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a249d5f-6341-4c1f-a28f-4139423c8aef admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:35.926744 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a249d5f-6341-4c1f-a28f-4139423c8aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:35.927020 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a249d5f-6341-4c1f-a28f-4139423c8aef admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:35.927735 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a249d5f-6341-4c1f-a28f-4139423c8aef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:35.929331 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a249d5f-6341-4c1f-a28f-4139423c8aef admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:35.939516 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1430/2860] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 13:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 13:04:35.943612 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f245e7-7aad-4cf0-8fc2-d1735b881972 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:35.953672 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f245e7-7aad-4cf0-8fc2-d1735b881972 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:35.959075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0edfd-bf9f-4c85-a2f8-3dc60a1d6ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:35.960068 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0edfd-bf9f-4c85-a2f8-3dc60a1d6ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:35.960356 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0edfd-bf9f-4c85-a2f8-3dc60a1d6ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:35.960635 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0edfd-bf9f-4c85-a2f8-3dc60a1d6ff9 admin admin] PATH_INFO: `/v3/projects/7cd9eb2a67f84b7b879475561df6ad7e/users/947796681bc342c1afa51e59bb8f3f3d/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:35.962627 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce0edfd-bf9f-4c85-a2f8-3dc60a1d6ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cd9eb2a67f84b7b879475561df6ad7e, user_id=947796681bc342c1afa51e59bb8f3f3d, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:35.965332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce0edfd-bf9f-4c85-a2f8-3dc60a1d6ff9 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:35.976133 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1431/2861] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 13:04:35 2022] PUT /identity/v3/projects/7cd9eb2a67f84b7b879475561df6ad7e/users/947796681bc342c1afa51e59bb8f3f3d/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 13:04:35.985982 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a24e78-3504-4670-87a8-d1830b612622 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:35.986436 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a24e78-3504-4670-87a8-d1830b612622 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:35.986928 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a24e78-3504-4670-87a8-d1830b612622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:36.013107 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-76a24e78-3504-4670-87a8-d1830b612622 None None] MFA Rules not processed for user `947796681bc342c1afa51e59bb8f3f3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:04:36.014310 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-76a24e78-3504-4670-87a8-d1830b612622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:36.047049 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:04:36.082772 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1431/2862] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 13:04:35 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 13:04:36.093373 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0edfd-bf9f-4c85-a2f8-3dc60a1d6ff9 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:36.095737 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-dce0edfd-bf9f-4c85-a2f8-3dc60a1d6ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:36.152874 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0edfd-bf9f-4c85-a2f8-3dc60a1d6ff9 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:36.156493 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50400e8-9b09-4a5a-898a-f545b7c11e7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:36.157123 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50400e8-9b09-4a5a-898a-f545b7c11e7a service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:36.157402 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50400e8-9b09-4a5a-898a-f545b7c11e7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:36.157675 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50400e8-9b09-4a5a-898a-f545b7c11e7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:36.166484 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50400e8-9b09-4a5a-898a-f545b7c11e7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:36.167950 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50400e8-9b09-4a5a-898a-f545b7c11e7a service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:36.177571 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1432/2863] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 13:04:36 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 13:04:36.247262 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a24e78-3504-4670-87a8-d1830b612622 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:36.257538 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a24e78-3504-4670-87a8-d1830b612622 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:36.261140 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01d3cd-8f73-411b-868f-81fb4b60d420 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:36.261813 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01d3cd-8f73-411b-868f-81fb4b60d420 service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:36.262091 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01d3cd-8f73-411b-868f-81fb4b60d420 service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:36.262364 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01d3cd-8f73-411b-868f-81fb4b60d420 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:36.317334 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01d3cd-8f73-411b-868f-81fb4b60d420 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:36.318824 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01d3cd-8f73-411b-868f-81fb4b60d420 service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:36.327497 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1432/2864] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 13:04:36 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 13:04:40.324704 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50400e8-9b09-4a5a-898a-f545b7c11e7a service cinder] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:40.383824 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50400e8-9b09-4a5a-898a-f545b7c11e7a service cinder] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:40.388235 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e3140-51c1-454b-8df7-ce7c591513c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:40.389084 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e3140-51c1-454b-8df7-ce7c591513c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:40.389362 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e3140-51c1-454b-8df7-ce7c591513c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:40.389637 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e3140-51c1-454b-8df7-ce7c591513c7 admin admin] PATH_INFO: `/v3/users/8f95333fcb7e4766881d5ce03c37e26a` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:40.390814 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e3140-51c1-454b-8df7-ce7c591513c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f95333fcb7e4766881d5ce03c37e26a)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:40.393221 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e3140-51c1-454b-8df7-ce7c591513c7 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:40.420453 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:04:40.443025 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-2c3e3140-51c1-454b-8df7-ce7c591513c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f95333fcb7e4766881d5ce03c37e26a'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:40.443601 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-2c3e3140-51c1-454b-8df7-ce7c591513c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f95333fcb7e4766881d5ce03c37e26a'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:40.455676 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-2c3e3140-51c1-454b-8df7-ce7c591513c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f95333fcb7e4766881d5ce03c37e26a'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:40.462655 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-2c3e3140-51c1-454b-8df7-ce7c591513c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f95333fcb7e4766881d5ce03c37e26a'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:40.463268 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-2c3e3140-51c1-454b-8df7-ce7c591513c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f95333fcb7e4766881d5ce03c37e26a'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:40.475687 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1433/2865] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 13:04:40 2022] DELETE /identity/v3/users/8f95333fcb7e4766881d5ce03c37e26a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 13:04:40.480144 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1bebd-58f4-4a61-ad32-6643a709f19a None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:40.480604 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1bebd-58f4-4a61-ad32-6643a709f19a None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:40.480719 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1bebd-58f4-4a61-ad32-6643a709f19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:40.497483 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-e1b1bebd-58f4-4a61-ad32-6643a709f19a None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:04:40.499056 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-e1b1bebd-58f4-4a61-ad32-6643a709f19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:40.556498 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1433/2866] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 13:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 13:04:40.565980 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e3140-51c1-454b-8df7-ce7c591513c7 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:40.567419 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-2c3e3140-51c1-454b-8df7-ce7c591513c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:40.623203 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e3140-51c1-454b-8df7-ce7c591513c7 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:40.627324 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a2d33-fe1c-45a5-952c-6a250be59b1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:40.627958 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a2d33-fe1c-45a5-952c-6a250be59b1b service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:40.628242 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a2d33-fe1c-45a5-952c-6a250be59b1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:40.628518 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a2d33-fe1c-45a5-952c-6a250be59b1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:40.637323 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a2d33-fe1c-45a5-952c-6a250be59b1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:40.638783 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a2d33-fe1c-45a5-952c-6a250be59b1b service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:40.648635 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1434/2867] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 13:04:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 13:04:40.911093 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1bebd-58f4-4a61-ad32-6643a709f19a None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:40.912611 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-e1b1bebd-58f4-4a61-ad32-6643a709f19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:40.925034 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1bebd-58f4-4a61-ad32-6643a709f19a None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:40.929705 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36df593-ed99-44af-84bf-13444ae09366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:40.930660 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36df593-ed99-44af-84bf-13444ae09366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:40.931034 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36df593-ed99-44af-84bf-13444ae09366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:40.931391 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36df593-ed99-44af-84bf-13444ae09366 admin admin] PATH_INFO: `/v3/projects/cfeba5aa5bd94ca18a909c1896b2d5e5` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:40.932657 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36df593-ed99-44af-84bf-13444ae09366 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfeba5aa5bd94ca18a909c1896b2d5e5)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:40.934707 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36df593-ed99-44af-84bf-13444ae09366 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:40.984295 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b36df593-ed99-44af-84bf-13444ae09366 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfeba5aa5bd94ca18a909c1896b2d5e5', 'request_id': 'req-b36df593-ed99-44af-84bf-13444ae09366'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:40.991418 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b36df593-ed99-44af-84bf-13444ae09366 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfeba5aa5bd94ca18a909c1896b2d5e5', 'request_id': 'req-b36df593-ed99-44af-84bf-13444ae09366'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:40.997846 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b36df593-ed99-44af-84bf-13444ae09366 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfeba5aa5bd94ca18a909c1896b2d5e5', 'request_id': 'req-b36df593-ed99-44af-84bf-13444ae09366'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:41.002476 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:04:41.010970 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b36df593-ed99-44af-84bf-13444ae09366 admin admin] The token cache is being invalidate because project cfeba5aa5bd94ca18a909c1896b2d5e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 13:04:41.011455 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b36df593-ed99-44af-84bf-13444ae09366 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:41.012384 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-b36df593-ed99-44af-84bf-13444ae09366 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:41.013964 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1434/2868] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 13:04:40 2022] DELETE /identity/v3/projects/cfeba5aa5bd94ca18a909c1896b2d5e5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 13:04:41.018453 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a2d33-fe1c-45a5-952c-6a250be59b1b service neutron] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:41.028056 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a2d33-fe1c-45a5-952c-6a250be59b1b service neutron] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:41.089342 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede98c5-3ce4-4f2f-8488-f34287f44c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:41.090220 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede98c5-3ce4-4f2f-8488-f34287f44c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:41.090506 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede98c5-3ce4-4f2f-8488-f34287f44c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:41.090813 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede98c5-3ce4-4f2f-8488-f34287f44c24 admin admin] PATH_INFO: `/v3/users/947796681bc342c1afa51e59bb8f3f3d` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:41.092055 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede98c5-3ce4-4f2f-8488-f34287f44c24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=947796681bc342c1afa51e59bb8f3f3d)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:41.094500 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede98c5-3ce4-4f2f-8488-f34287f44c24 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:41.148703 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-bede98c5-3ce4-4f2f-8488-f34287f44c24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '947796681bc342c1afa51e59bb8f3f3d'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:41.149612 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-bede98c5-3ce4-4f2f-8488-f34287f44c24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '947796681bc342c1afa51e59bb8f3f3d'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:41.150980 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:04:41.163921 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-bede98c5-3ce4-4f2f-8488-f34287f44c24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '947796681bc342c1afa51e59bb8f3f3d'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:41.171678 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-bede98c5-3ce4-4f2f-8488-f34287f44c24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '947796681bc342c1afa51e59bb8f3f3d'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:41.172415 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-bede98c5-3ce4-4f2f-8488-f34287f44c24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '947796681bc342c1afa51e59bb8f3f3d'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:41.185147 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1435/2869] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 13:04:41 2022] DELETE /identity/v3/users/947796681bc342c1afa51e59bb8f3f3d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 13:04:41.453677 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36df593-ed99-44af-84bf-13444ae09366 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:41.459954 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-b36df593-ed99-44af-84bf-13444ae09366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:41.474283 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36df593-ed99-44af-84bf-13444ae09366 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:41.532644 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb91213-9bb9-4550-949d-33601fa87edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:41.533440 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb91213-9bb9-4550-949d-33601fa87edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:41.533724 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb91213-9bb9-4550-949d-33601fa87edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:41.534000 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb91213-9bb9-4550-949d-33601fa87edb admin admin] PATH_INFO: `/v3/projects/7cd9eb2a67f84b7b879475561df6ad7e` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:41.535235 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb91213-9bb9-4550-949d-33601fa87edb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cd9eb2a67f84b7b879475561df6ad7e)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:41.537175 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb91213-9bb9-4550-949d-33601fa87edb admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:41.582449 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-0eb91213-9bb9-4550-949d-33601fa87edb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cd9eb2a67f84b7b879475561df6ad7e', 'request_id': 'req-0eb91213-9bb9-4550-949d-33601fa87edb'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:41.589522 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-0eb91213-9bb9-4550-949d-33601fa87edb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cd9eb2a67f84b7b879475561df6ad7e', 'request_id': 'req-0eb91213-9bb9-4550-949d-33601fa87edb'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:41.596198 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-0eb91213-9bb9-4550-949d-33601fa87edb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cd9eb2a67f84b7b879475561df6ad7e', 'request_id': 'req-0eb91213-9bb9-4550-949d-33601fa87edb'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:41.606287 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-0eb91213-9bb9-4550-949d-33601fa87edb admin admin] The token cache is being invalidate because project 7cd9eb2a67f84b7b879475561df6ad7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 13:04:41.606585 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-0eb91213-9bb9-4550-949d-33601fa87edb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:41.607234 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-0eb91213-9bb9-4550-949d-33601fa87edb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:41.608752 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1435/2870] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 13:04:41 2022] DELETE /identity/v3/projects/7cd9eb2a67f84b7b879475561df6ad7e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 13:04:41.614249 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20e845-520a-488a-8f00-3dbea3b88ac2 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:41.614746 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20e845-520a-488a-8f00-3dbea3b88ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:41.614829 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20e845-520a-488a-8f00-3dbea3b88ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:41.632503 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-6f20e845-520a-488a-8f00-3dbea3b88ac2 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:04:41.633675 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-6f20e845-520a-488a-8f00-3dbea3b88ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:41.692189 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1436/2871] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 13:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 13:04:41.700775 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523ca3f-5aaf-487e-92fc-0506154f1b4b None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:41.701108 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523ca3f-5aaf-487e-92fc-0506154f1b4b None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:41.701372 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523ca3f-5aaf-487e-92fc-0506154f1b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:41.720133 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-f523ca3f-5aaf-487e-92fc-0506154f1b4b None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:04:41.721447 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-f523ca3f-5aaf-487e-92fc-0506154f1b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:41.729528 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1436/2872] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 13:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 13:04:41.733808 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20e845-520a-488a-8f00-3dbea3b88ac2 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:41.744074 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20e845-520a-488a-8f00-3dbea3b88ac2 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:41.748976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193e16b-d8ae-4cf2-a09f-1939aa18e4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:41.749629 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193e16b-d8ae-4cf2-a09f-1939aa18e4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:41.749906 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193e16b-d8ae-4cf2-a09f-1939aa18e4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:41.750169 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193e16b-d8ae-4cf2-a09f-1939aa18e4a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:41.750956 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193e16b-d8ae-4cf2-a09f-1939aa18e4a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 13:04:41.751263 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193e16b-d8ae-4cf2-a09f-1939aa18e4a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:41.752868 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193e16b-d8ae-4cf2-a09f-1939aa18e4a3 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:41.764842 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1437/2873] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 13:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 13:04:41.769699 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523ca3f-5aaf-487e-92fc-0506154f1b4b None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:41.778860 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523ca3f-5aaf-487e-92fc-0506154f1b4b None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:41.784154 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f5d0d-c498-488b-b3b6-794d4eca1f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:41.784758 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f5d0d-c498-488b-b3b6-794d4eca1f1b admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:41.785018 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f5d0d-c498-488b-b3b6-794d4eca1f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:41.785292 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f5d0d-c498-488b-b3b6-794d4eca1f1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:41.785972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f5d0d-c498-488b-b3b6-794d4eca1f1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:41.787890 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f5d0d-c498-488b-b3b6-794d4eca1f1b admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:41.812167 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1437/2874] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 13:04:41 2022] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 13:04:41.816154 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193e16b-d8ae-4cf2-a09f-1939aa18e4a3 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:41.826043 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193e16b-d8ae-4cf2-a09f-1939aa18e4a3 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:41.883528 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357c5a4-f5c7-4c2e-8e8c-9de3cf83e1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:41.884193 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357c5a4-f5c7-4c2e-8e8c-9de3cf83e1e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:41.884477 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357c5a4-f5c7-4c2e-8e8c-9de3cf83e1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:41.884755 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357c5a4-f5c7-4c2e-8e8c-9de3cf83e1e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:41.885433 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357c5a4-f5c7-4c2e-8e8c-9de3cf83e1e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:41.887391 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357c5a4-f5c7-4c2e-8e8c-9de3cf83e1e3 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:41.907050 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1438/2875] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 13:04:41 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 13:04:41.911745 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f5d0d-c498-488b-b3b6-794d4eca1f1b admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:41.921854 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f5d0d-c498-488b-b3b6-794d4eca1f1b admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:41.926360 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159a51c-99f0-4edd-8bcd-c555f19508d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:41.927049 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159a51c-99f0-4edd-8bcd-c555f19508d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:41.927332 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159a51c-99f0-4edd-8bcd-c555f19508d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:41.927607 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159a51c-99f0-4edd-8bcd-c555f19508d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:41.928325 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159a51c-99f0-4edd-8bcd-c555f19508d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:41.929908 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159a51c-99f0-4edd-8bcd-c555f19508d0 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:41.940345 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1438/2876] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 13:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 13:04:41.943935 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357c5a4-f5c7-4c2e-8e8c-9de3cf83e1e3 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:41.953642 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357c5a4-f5c7-4c2e-8e8c-9de3cf83e1e3 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:41.958675 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268a756-3c18-4728-a4ba-8c2d36e570fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:41.959327 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268a756-3c18-4728-a4ba-8c2d36e570fe admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:41.959605 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268a756-3c18-4728-a4ba-8c2d36e570fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:41.959873 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268a756-3c18-4728-a4ba-8c2d36e570fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:41.960615 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268a756-3c18-4728-a4ba-8c2d36e570fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:41.962191 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268a756-3c18-4728-a4ba-8c2d36e570fe admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:41.972589 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1439/2877] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 13:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 13:04:41.976441 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159a51c-99f0-4edd-8bcd-c555f19508d0 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:41.986168 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159a51c-99f0-4edd-8bcd-c555f19508d0 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:41.990776 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74142fb-b3c2-4082-9a57-7b518f3cda8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:41.991646 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74142fb-b3c2-4082-9a57-7b518f3cda8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:41.991929 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74142fb-b3c2-4082-9a57-7b518f3cda8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:41.992204 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74142fb-b3c2-4082-9a57-7b518f3cda8b admin admin] PATH_INFO: `/v3/projects/836c5787fc114577927b06c5fc2d9a4c/users/6ffb7eaa93244d2591a8c4ecf646ea67/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:42.006576 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74142fb-b3c2-4082-9a57-7b518f3cda8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=836c5787fc114577927b06c5fc2d9a4c, user_id=6ffb7eaa93244d2591a8c4ecf646ea67, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:42.009246 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74142fb-b3c2-4082-9a57-7b518f3cda8b admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:42.022273 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1439/2878] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 13:04:41 2022] PUT /identity/v3/projects/836c5787fc114577927b06c5fc2d9a4c/users/6ffb7eaa93244d2591a8c4ecf646ea67/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 13:04:42.032838 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b06f9-ab26-401e-a935-4439d9dbfbab None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:42.033138 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b06f9-ab26-401e-a935-4439d9dbfbab None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:42.033405 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b06f9-ab26-401e-a935-4439d9dbfbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:42.064255 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-2a1b06f9-ab26-401e-a935-4439d9dbfbab None None] MFA Rules not processed for user `6ffb7eaa93244d2591a8c4ecf646ea67`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:04:42.065370 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-2a1b06f9-ab26-401e-a935-4439d9dbfbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:42.083474 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:04:42.130811 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1440/2879] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 13:04:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 13:04:42.135296 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74142fb-b3c2-4082-9a57-7b518f3cda8b admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:42.156378 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:04:42.198229 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74142fb-b3c2-4082-9a57-7b518f3cda8b admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:42.203028 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f84c4-192c-4111-9652-e4d36aa91c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:42.203686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f84c4-192c-4111-9652-e4d36aa91c22 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:42.203981 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f84c4-192c-4111-9652-e4d36aa91c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:42.204794 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f84c4-192c-4111-9652-e4d36aa91c22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:42.205489 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f84c4-192c-4111-9652-e4d36aa91c22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:42.207430 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f84c4-192c-4111-9652-e4d36aa91c22 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:42.231515 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1440/2880] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 13:04:42 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 13:04:42.235684 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b06f9-ab26-401e-a935-4439d9dbfbab None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:42.246138 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b06f9-ab26-401e-a935-4439d9dbfbab None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:42.301630 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf244f-27f1-47d1-ae90-5b464bac5977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:42.302293 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf244f-27f1-47d1-ae90-5b464bac5977 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:42.302576 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf244f-27f1-47d1-ae90-5b464bac5977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:42.302881 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf244f-27f1-47d1-ae90-5b464bac5977 admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:42.303564 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf244f-27f1-47d1-ae90-5b464bac5977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:42.305499 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf244f-27f1-47d1-ae90-5b464bac5977 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:42.324283 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1441/2881] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 13:04:42 2022] POST /identity/v3/users => generated 296 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 13:04:42.328323 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f84c4-192c-4111-9652-e4d36aa91c22 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:42.339148 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f84c4-192c-4111-9652-e4d36aa91c22 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:42.343750 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26cc277-0770-4ed9-8767-7e56ad9c3564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:42.344405 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cc277-0770-4ed9-8767-7e56ad9c3564 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:42.344691 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cc277-0770-4ed9-8767-7e56ad9c3564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:42.345044 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cc277-0770-4ed9-8767-7e56ad9c3564 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:42.345771 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26cc277-0770-4ed9-8767-7e56ad9c3564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:42.347464 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26cc277-0770-4ed9-8767-7e56ad9c3564 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:42.358013 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1441/2882] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 13:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 13:04:42.361982 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf244f-27f1-47d1-ae90-5b464bac5977 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:42.372030 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf244f-27f1-47d1-ae90-5b464bac5977 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:42.377139 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8ee5a-1be3-4036-adbf-30afd8ea2eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:42.378000 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8ee5a-1be3-4036-adbf-30afd8ea2eb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:42.378281 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8ee5a-1be3-4036-adbf-30afd8ea2eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:42.378693 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8ee5a-1be3-4036-adbf-30afd8ea2eb4 admin admin] PATH_INFO: `/v3/projects/8dd5336ef80c45bb8620cc8cabb387d0/users/84a128b36110404ca4bf5dee825fce84/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:42.393516 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8ee5a-1be3-4036-adbf-30afd8ea2eb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dd5336ef80c45bb8620cc8cabb387d0, user_id=84a128b36110404ca4bf5dee825fce84, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:42.396210 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8ee5a-1be3-4036-adbf-30afd8ea2eb4 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:42.409321 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1442/2883] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 13:04:42 2022] PUT /identity/v3/projects/8dd5336ef80c45bb8620cc8cabb387d0/users/84a128b36110404ca4bf5dee825fce84/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 13:04:42.413616 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26cc277-0770-4ed9-8767-7e56ad9c3564 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:42.425243 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26cc277-0770-4ed9-8767-7e56ad9c3564 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:42.482245 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b57ef-359c-493e-8032-93f2c3e6be78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:42.482945 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b57ef-359c-493e-8032-93f2c3e6be78 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:42.483227 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b57ef-359c-493e-8032-93f2c3e6be78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:42.483500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b57ef-359c-493e-8032-93f2c3e6be78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:42.484216 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b57ef-359c-493e-8032-93f2c3e6be78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:42.485868 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b57ef-359c-493e-8032-93f2c3e6be78 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:42.495670 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1442/2884] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 13:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 13:04:42.500061 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8ee5a-1be3-4036-adbf-30afd8ea2eb4 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:42.510877 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8ee5a-1be3-4036-adbf-30afd8ea2eb4 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:42.515475 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c136e0c-a935-4a3e-907c-7b62ec382a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:42.516354 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c136e0c-a935-4a3e-907c-7b62ec382a6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:42.517269 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c136e0c-a935-4a3e-907c-7b62ec382a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:42.517549 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c136e0c-a935-4a3e-907c-7b62ec382a6c admin admin] PATH_INFO: `/v3/projects/8dd5336ef80c45bb8620cc8cabb387d0/users/84a128b36110404ca4bf5dee825fce84/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:42.519563 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c136e0c-a935-4a3e-907c-7b62ec382a6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dd5336ef80c45bb8620cc8cabb387d0, user_id=84a128b36110404ca4bf5dee825fce84, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:42.522226 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c136e0c-a935-4a3e-907c-7b62ec382a6c admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:42.532349 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1443/2885] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 13:04:42 2022] PUT /identity/v3/projects/8dd5336ef80c45bb8620cc8cabb387d0/users/84a128b36110404ca4bf5dee825fce84/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 13:04:42.543312 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0692f6-7e1a-4ada-a5b5-727b58e51020 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:42.543792 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0692f6-7e1a-4ada-a5b5-727b58e51020 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:42.543885 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0692f6-7e1a-4ada-a5b5-727b58e51020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:42.570457 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-fe0692f6-7e1a-4ada-a5b5-727b58e51020 None None] MFA Rules not processed for user `84a128b36110404ca4bf5dee825fce84`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:04:42.571686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-fe0692f6-7e1a-4ada-a5b5-727b58e51020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:42.637568 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1443/2886] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 13:04:42 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 13:04:42.648709 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c136e0c-a935-4a3e-907c-7b62ec382a6c admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:42.650517 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-9c136e0c-a935-4a3e-907c-7b62ec382a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:42.710704 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c136e0c-a935-4a3e-907c-7b62ec382a6c admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:42.714335 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84409ebe-c6d3-4101-8fb4-c974fea68c4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:42.715018 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84409ebe-c6d3-4101-8fb4-c974fea68c4f service cinder] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:42.715307 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84409ebe-c6d3-4101-8fb4-c974fea68c4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:42.715587 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84409ebe-c6d3-4101-8fb4-c974fea68c4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:42.725276 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84409ebe-c6d3-4101-8fb4-c974fea68c4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:42.726783 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84409ebe-c6d3-4101-8fb4-c974fea68c4f service cinder] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:42.737818 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1444/2887] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 13:04:42 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 13:04:42.807910 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0692f6-7e1a-4ada-a5b5-727b58e51020 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:42.818072 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0692f6-7e1a-4ada-a5b5-727b58e51020 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:42.821690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c82428-433e-47b2-a911-294643cc8856 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:42.822340 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c82428-433e-47b2-a911-294643cc8856 service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:42.822625 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c82428-433e-47b2-a911-294643cc8856 service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:42.822929 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c82428-433e-47b2-a911-294643cc8856 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:42.834803 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:04:42.880196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c82428-433e-47b2-a911-294643cc8856 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:42.881639 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c82428-433e-47b2-a911-294643cc8856 service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:42.890548 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1444/2888] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 13:04:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 13:04:43.138900 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84409ebe-c6d3-4101-8fb4-c974fea68c4f service cinder] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:43.157955 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:04:43.203243 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84409ebe-c6d3-4101-8fb4-c974fea68c4f service cinder] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:43.207768 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75d0f4-fc93-49f0-ac1a-46846e6308b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:43.208638 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75d0f4-fc93-49f0-ac1a-46846e6308b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:43.208927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75d0f4-fc93-49f0-ac1a-46846e6308b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:43.209204 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75d0f4-fc93-49f0-ac1a-46846e6308b1 admin admin] PATH_INFO: `/v3/users/6ffb7eaa93244d2591a8c4ecf646ea67` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:43.210383 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75d0f4-fc93-49f0-ac1a-46846e6308b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ffb7eaa93244d2591a8c4ecf646ea67)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:43.212565 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75d0f4-fc93-49f0-ac1a-46846e6308b1 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:43.257906 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-ce75d0f4-fc93-49f0-ac1a-46846e6308b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ffb7eaa93244d2591a8c4ecf646ea67'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:43.258560 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-ce75d0f4-fc93-49f0-ac1a-46846e6308b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ffb7eaa93244d2591a8c4ecf646ea67'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:43.270934 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-ce75d0f4-fc93-49f0-ac1a-46846e6308b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ffb7eaa93244d2591a8c4ecf646ea67'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:43.277599 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-ce75d0f4-fc93-49f0-ac1a-46846e6308b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ffb7eaa93244d2591a8c4ecf646ea67'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:43.278209 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-ce75d0f4-fc93-49f0-ac1a-46846e6308b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ffb7eaa93244d2591a8c4ecf646ea67'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:43.290902 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1445/2889] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 13:04:43 2022] DELETE /identity/v3/users/6ffb7eaa93244d2591a8c4ecf646ea67 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 13:04:43.295599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae568cb-aa2f-4278-a6d7-a891e85e3306 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:43.295894 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae568cb-aa2f-4278-a6d7-a891e85e3306 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:43.296178 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae568cb-aa2f-4278-a6d7-a891e85e3306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:43.312951 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-cae568cb-aa2f-4278-a6d7-a891e85e3306 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:04:43.314212 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-cae568cb-aa2f-4278-a6d7-a891e85e3306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:43.376719 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1445/2890] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 13:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 13:04:43.386483 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75d0f4-fc93-49f0-ac1a-46846e6308b1 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:43.387941 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-ce75d0f4-fc93-49f0-ac1a-46846e6308b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:43.444409 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75d0f4-fc93-49f0-ac1a-46846e6308b1 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:43.448037 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20206023-cdd7-469d-a720-35864c1bac05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:43.448675 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20206023-cdd7-469d-a720-35864c1bac05 service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:43.448961 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20206023-cdd7-469d-a720-35864c1bac05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:43.449257 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20206023-cdd7-469d-a720-35864c1bac05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:43.458587 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20206023-cdd7-469d-a720-35864c1bac05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:43.460046 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20206023-cdd7-469d-a720-35864c1bac05 service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:43.469603 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1446/2891] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 13:04:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 13:04:43.734172 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae568cb-aa2f-4278-a6d7-a891e85e3306 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:43.735914 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-cae568cb-aa2f-4278-a6d7-a891e85e3306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:43.748407 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae568cb-aa2f-4278-a6d7-a891e85e3306 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:43.753587 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230303d8-30c0-4cae-a5b4-a53ed505571d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:43.754444 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230303d8-30c0-4cae-a5b4-a53ed505571d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:43.754755 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230303d8-30c0-4cae-a5b4-a53ed505571d admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:43.755108 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230303d8-30c0-4cae-a5b4-a53ed505571d admin admin] PATH_INFO: `/v3/projects/836c5787fc114577927b06c5fc2d9a4c` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:43.756210 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230303d8-30c0-4cae-a5b4-a53ed505571d admin admin] RBAC: Authorizing `identity:delete_project(project_id=836c5787fc114577927b06c5fc2d9a4c)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:43.758088 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230303d8-30c0-4cae-a5b4-a53ed505571d admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:43.804417 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-230303d8-30c0-4cae-a5b4-a53ed505571d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '836c5787fc114577927b06c5fc2d9a4c', 'request_id': 'req-230303d8-30c0-4cae-a5b4-a53ed505571d'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:43.811500 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-230303d8-30c0-4cae-a5b4-a53ed505571d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '836c5787fc114577927b06c5fc2d9a4c', 'request_id': 'req-230303d8-30c0-4cae-a5b4-a53ed505571d'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:43.818175 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-230303d8-30c0-4cae-a5b4-a53ed505571d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '836c5787fc114577927b06c5fc2d9a4c', 'request_id': 'req-230303d8-30c0-4cae-a5b4-a53ed505571d'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:43.828786 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-230303d8-30c0-4cae-a5b4-a53ed505571d admin admin] The token cache is being invalidate because project 836c5787fc114577927b06c5fc2d9a4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 13:04:43.829691 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-230303d8-30c0-4cae-a5b4-a53ed505571d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:43.830342 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-230303d8-30c0-4cae-a5b4-a53ed505571d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:43.831899 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1446/2892] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 13:04:43 2022] DELETE /identity/v3/projects/836c5787fc114577927b06c5fc2d9a4c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 13:04:43.835853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20206023-cdd7-469d-a720-35864c1bac05 service neutron] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:43.845371 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20206023-cdd7-469d-a720-35864c1bac05 service neutron] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:43.877935 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:04:43.902555 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3096f-5e5e-4289-9584-a395bdd0a383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:43.903448 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3096f-5e5e-4289-9584-a395bdd0a383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:43.903772 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3096f-5e5e-4289-9584-a395bdd0a383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:43.904139 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3096f-5e5e-4289-9584-a395bdd0a383 admin admin] PATH_INFO: `/v3/users/84a128b36110404ca4bf5dee825fce84` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:43.905315 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3096f-5e5e-4289-9584-a395bdd0a383 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84a128b36110404ca4bf5dee825fce84)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:43.907267 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3096f-5e5e-4289-9584-a395bdd0a383 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:43.951043 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-b3a3096f-5e5e-4289-9584-a395bdd0a383 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84a128b36110404ca4bf5dee825fce84'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:43.951959 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-b3a3096f-5e5e-4289-9584-a395bdd0a383 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84a128b36110404ca4bf5dee825fce84'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:43.964085 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-b3a3096f-5e5e-4289-9584-a395bdd0a383 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84a128b36110404ca4bf5dee825fce84'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:43.970686 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-b3a3096f-5e5e-4289-9584-a395bdd0a383 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84a128b36110404ca4bf5dee825fce84'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:43.971299 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-b3a3096f-5e5e-4289-9584-a395bdd0a383 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84a128b36110404ca4bf5dee825fce84'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:43.983611 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1447/2893] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 13:04:43 2022] DELETE /identity/v3/users/84a128b36110404ca4bf5dee825fce84 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 13:04:44.256133 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230303d8-30c0-4cae-a5b4-a53ed505571d admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:44.257778 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-230303d8-30c0-4cae-a5b4-a53ed505571d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:44.271074 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230303d8-30c0-4cae-a5b4-a53ed505571d admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:44.306685 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:04:44.331823 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9006f-3b49-4964-b3c4-b1669d5856b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:44.332686 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9006f-3b49-4964-b3c4-b1669d5856b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:44.332972 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9006f-3b49-4964-b3c4-b1669d5856b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:44.333248 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9006f-3b49-4964-b3c4-b1669d5856b2 admin admin] PATH_INFO: `/v3/projects/8dd5336ef80c45bb8620cc8cabb387d0` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:44.334418 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f9006f-3b49-4964-b3c4-b1669d5856b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dd5336ef80c45bb8620cc8cabb387d0)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:44.336363 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f9006f-3b49-4964-b3c4-b1669d5856b2 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:44.382223 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-46f9006f-3b49-4964-b3c4-b1669d5856b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dd5336ef80c45bb8620cc8cabb387d0', 'request_id': 'req-46f9006f-3b49-4964-b3c4-b1669d5856b2'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:44.389193 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-46f9006f-3b49-4964-b3c4-b1669d5856b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dd5336ef80c45bb8620cc8cabb387d0', 'request_id': 'req-46f9006f-3b49-4964-b3c4-b1669d5856b2'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:44.395384 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-46f9006f-3b49-4964-b3c4-b1669d5856b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dd5336ef80c45bb8620cc8cabb387d0', 'request_id': 'req-46f9006f-3b49-4964-b3c4-b1669d5856b2'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:44.406228 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-46f9006f-3b49-4964-b3c4-b1669d5856b2 admin admin] The token cache is being invalidate because project 8dd5336ef80c45bb8620cc8cabb387d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 13:04:44.406512 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-46f9006f-3b49-4964-b3c4-b1669d5856b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:44.407680 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-46f9006f-3b49-4964-b3c4-b1669d5856b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:04:44.409201 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1447/2894] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 13:04:44 2022] DELETE /identity/v3/projects/8dd5336ef80c45bb8620cc8cabb387d0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 13:04:44.414028 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22433f-eddb-4f79-90ae-8e89895b3ec7 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:44.414364 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22433f-eddb-4f79-90ae-8e89895b3ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:44.414608 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22433f-eddb-4f79-90ae-8e89895b3ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:44.432706 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-ea22433f-eddb-4f79-90ae-8e89895b3ec7 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:04:44.433877 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-ea22433f-eddb-4f79-90ae-8e89895b3ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:44.492009 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1448/2895] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 13:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 13:04:44.500342 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced24c2-1a5f-4f4d-84db-66b2c1cdf994 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:44.500574 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced24c2-1a5f-4f4d-84db-66b2c1cdf994 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:44.500858 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced24c2-1a5f-4f4d-84db-66b2c1cdf994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:44.518999 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-6ced24c2-1a5f-4f4d-84db-66b2c1cdf994 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:04:44.520208 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-6ced24c2-1a5f-4f4d-84db-66b2c1cdf994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:44.528163 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1448/2896] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 13:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 13:04:44.532803 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22433f-eddb-4f79-90ae-8e89895b3ec7 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:44.542424 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22433f-eddb-4f79-90ae-8e89895b3ec7 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:44.547047 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d76218-e5e0-4928-ac10-f04d097ecd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:44.547701 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d76218-e5e0-4928-ac10-f04d097ecd62 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:44.548529 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d76218-e5e0-4928-ac10-f04d097ecd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:44.548808 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d76218-e5e0-4928-ac10-f04d097ecd62 admin admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:44.549531 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d76218-e5e0-4928-ac10-f04d097ecd62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 13:04:44.549839 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d76218-e5e0-4928-ac10-f04d097ecd62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:44.551485 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d76218-e5e0-4928-ac10-f04d097ecd62 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:44.562994 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1449/2897] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 13:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 13:04:44.567331 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced24c2-1a5f-4f4d-84db-66b2c1cdf994 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:44.576377 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced24c2-1a5f-4f4d-84db-66b2c1cdf994 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:44.581046 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e2997-03bc-4767-a3cb-0f31edf86858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:44.581690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e2997-03bc-4767-a3cb-0f31edf86858 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:44.581975 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e2997-03bc-4767-a3cb-0f31edf86858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:44.582251 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e2997-03bc-4767-a3cb-0f31edf86858 admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:44.582985 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e2997-03bc-4767-a3cb-0f31edf86858 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:44.584880 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e2997-03bc-4767-a3cb-0f31edf86858 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:44.610129 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1449/2898] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 13:04:44 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 13:04:44.614728 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d76218-e5e0-4928-ac10-f04d097ecd62 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:44.624760 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d76218-e5e0-4928-ac10-f04d097ecd62 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:44.665063 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:04:44.682072 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920df98f-001f-42f2-b3b6-0c4957181479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:44.682751 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920df98f-001f-42f2-b3b6-0c4957181479 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:44.683040 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920df98f-001f-42f2-b3b6-0c4957181479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:44.683320 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920df98f-001f-42f2-b3b6-0c4957181479 admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:44.684015 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920df98f-001f-42f2-b3b6-0c4957181479 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:44.685978 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920df98f-001f-42f2-b3b6-0c4957181479 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:44.704049 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1450/2899] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 13:04:44 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 13:04:44.708093 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e2997-03bc-4767-a3cb-0f31edf86858 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:44.718454 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e2997-03bc-4767-a3cb-0f31edf86858 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:44.723854 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17caca96-b0d4-42e4-acc1-55a1fab29769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:44.724555 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17caca96-b0d4-42e4-acc1-55a1fab29769 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:44.724845 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17caca96-b0d4-42e4-acc1-55a1fab29769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:44.725127 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17caca96-b0d4-42e4-acc1-55a1fab29769 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:44.725857 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17caca96-b0d4-42e4-acc1-55a1fab29769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:44.727519 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17caca96-b0d4-42e4-acc1-55a1fab29769 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:44.738892 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1450/2900] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 13:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 13:04:44.742883 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920df98f-001f-42f2-b3b6-0c4957181479 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:44.753225 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920df98f-001f-42f2-b3b6-0c4957181479 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:44.757796 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a081683-6c96-4e2f-9009-5ac4e1f8bc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:44.758452 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a081683-6c96-4e2f-9009-5ac4e1f8bc8a admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:44.758774 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a081683-6c96-4e2f-9009-5ac4e1f8bc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:44.759064 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a081683-6c96-4e2f-9009-5ac4e1f8bc8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:44.759782 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a081683-6c96-4e2f-9009-5ac4e1f8bc8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:44.761388 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a081683-6c96-4e2f-9009-5ac4e1f8bc8a admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:44.771740 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1451/2901] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 13:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 13:04:44.775580 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17caca96-b0d4-42e4-acc1-55a1fab29769 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:44.785998 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17caca96-b0d4-42e4-acc1-55a1fab29769 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:44.790660 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b709008-c677-4fde-8087-6e500042d8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:44.791628 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b709008-c677-4fde-8087-6e500042d8f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:44.791914 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b709008-c677-4fde-8087-6e500042d8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:44.792194 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b709008-c677-4fde-8087-6e500042d8f1 admin admin] PATH_INFO: `/v3/projects/1ce766cec60445f3a4c9ed616f78e254/users/d73ba5dfa9e64e5a98c1117a4b9471d0/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:44.807595 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b709008-c677-4fde-8087-6e500042d8f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ce766cec60445f3a4c9ed616f78e254, user_id=d73ba5dfa9e64e5a98c1117a4b9471d0, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:44.810335 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b709008-c677-4fde-8087-6e500042d8f1 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:44.823414 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1451/2902] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 13:04:44 2022] PUT /identity/v3/projects/1ce766cec60445f3a4c9ed616f78e254/users/d73ba5dfa9e64e5a98c1117a4b9471d0/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 13:04:44.828303 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd24c96-be72-4153-805e-3ed2fe696c14 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:44.828593 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd24c96-be72-4153-805e-3ed2fe696c14 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:44.828871 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd24c96-be72-4153-805e-3ed2fe696c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:44.846512 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-ffd24c96-be72-4153-805e-3ed2fe696c14 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:04:44.847241 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-ffd24c96-be72-4153-805e-3ed2fe696c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:44.903747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1452/2903] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 13:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 13:04:44.913303 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b709008-c677-4fde-8087-6e500042d8f1 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:44.915008 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-3b709008-c677-4fde-8087-6e500042d8f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:44.970210 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b709008-c677-4fde-8087-6e500042d8f1 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:44.973822 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33d526-f83c-42e8-a8b4-9c526a855dcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:44.974454 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33d526-f83c-42e8-a8b4-9c526a855dcc service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:44.974776 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33d526-f83c-42e8-a8b4-9c526a855dcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:44.975050 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33d526-f83c-42e8-a8b4-9c526a855dcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:44.983781 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c33d526-f83c-42e8-a8b4-9c526a855dcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:44.985192 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c33d526-f83c-42e8-a8b4-9c526a855dcc service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:44.994937 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1452/2904] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 13:04:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 13:04:45.625030 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9e3dc-e514-48ee-9606-ab22a32a4ec6 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:45.625400 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9e3dc-e514-48ee-9606-ab22a32a4ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:45.625737 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9e3dc-e514-48ee-9606-ab22a32a4ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:45.652708 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-89e9e3dc-e514-48ee-9606-ab22a32a4ec6 None None] MFA Rules not processed for user `d73ba5dfa9e64e5a98c1117a4b9471d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:04:45.653927 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-89e9e3dc-e514-48ee-9606-ab22a32a4ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:45.731196 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1453/2905] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 13:04:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 13:04:45.742260 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33d526-f83c-42e8-a8b4-9c526a855dcc service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:45.743779 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-5c33d526-f83c-42e8-a8b4-9c526a855dcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:45.755927 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:04:45.807606 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33d526-f83c-42e8-a8b4-9c526a855dcc service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:45.811101 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a03c1-fb66-4739-8eac-2adfccb40aa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4009947e15c347e19da8b4fbddfb2875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:45.811747 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a03c1-fb66-4739-8eac-2adfccb40aa2 service cinder] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:45.812027 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a03c1-fb66-4739-8eac-2adfccb40aa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:45.812300 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a03c1-fb66-4739-8eac-2adfccb40aa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:45.821843 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a03c1-fb66-4739-8eac-2adfccb40aa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:45.823437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a03c1-fb66-4739-8eac-2adfccb40aa2 service cinder] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:45.832689 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1453/2906] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 13:04:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 13:04:47.180427 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca3c0e-d659-429a-b1d4-f2d21978d86f None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:47.180911 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca3c0e-d659-429a-b1d4-f2d21978d86f None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:47.181033 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca3c0e-d659-429a-b1d4-f2d21978d86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:47.198521 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-e8ca3c0e-d659-429a-b1d4-f2d21978d86f None None] MFA Rules not processed for user `d73ba5dfa9e64e5a98c1117a4b9471d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:04:47.199726 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-e8ca3c0e-d659-429a-b1d4-f2d21978d86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:47.206366 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1454/2907] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 13:04:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 13:04:47.246227 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a03c1-fb66-4739-8eac-2adfccb40aa2 service cinder] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:47.247888 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-5a3a03c1-fb66-4739-8eac-2adfccb40aa2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:47.322982 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a03c1-fb66-4739-8eac-2adfccb40aa2 service cinder] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:47.326496 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b5c6a-1dbd-4491-aaef-c1c59af0c765 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09d603d756a9484bbf48cfd6d56bdb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:47.327159 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b5c6a-1dbd-4491-aaef-c1c59af0c765 service glance] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:47.327444 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b5c6a-1dbd-4491-aaef-c1c59af0c765 service glance] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:47.327718 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b5c6a-1dbd-4491-aaef-c1c59af0c765 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:47.329462 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-747b5c6a-1dbd-4491-aaef-c1c59af0c765 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:47.397481 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b5c6a-1dbd-4491-aaef-c1c59af0c765 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:47.398939 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b5c6a-1dbd-4491-aaef-c1c59af0c765 service glance] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:47.410408 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1454/2908] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 13:04:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 13:04:47.615221 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca3c0e-d659-429a-b1d4-f2d21978d86f None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:47.625196 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca3c0e-d659-429a-b1d4-f2d21978d86f None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:47.628747 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884745cf-87c7-425b-8933-c991ca764586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:47.629385 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884745cf-87c7-425b-8933-c991ca764586 service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:47.629666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884745cf-87c7-425b-8933-c991ca764586 service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:47.629940 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884745cf-87c7-425b-8933-c991ca764586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:47.631716 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-884745cf-87c7-425b-8933-c991ca764586 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:47.640961 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884745cf-87c7-425b-8933-c991ca764586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:47.642408 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884745cf-87c7-425b-8933-c991ca764586 service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:47.650278 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1455/2909] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 13:04:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 13:04:47.961046 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b5c6a-1dbd-4491-aaef-c1c59af0c765 service glance] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:47.962416 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-747b5c6a-1dbd-4491-aaef-c1c59af0c765 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:47.997367 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=100 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:04:48.034158 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b5c6a-1dbd-4491-aaef-c1c59af0c765 service glance] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:48.039779 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12eb3c4-437f-41d1-a290-400375013e7f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57c8b894e74c709ea389ed462184fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:48.040439 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eb3c4-437f-41d1-a290-400375013e7f service placement] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:48.040713 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eb3c4-437f-41d1-a290-400375013e7f service placement] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:48.040986 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eb3c4-437f-41d1-a290-400375013e7f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:48.042848 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-b12eb3c4-437f-41d1-a290-400375013e7f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:48.054221 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12eb3c4-437f-41d1-a290-400375013e7f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:48.055865 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12eb3c4-437f-41d1-a290-400375013e7f service placement] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:48.067872 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1455/2910] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 13:04:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 13:04:49.677180 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884745cf-87c7-425b-8933-c991ca764586 service neutron] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:49.678625 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-884745cf-87c7-425b-8933-c991ca764586 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:49.690339 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884745cf-87c7-425b-8933-c991ca764586 service neutron] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:49.693975 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be2b21-0836-49b8-9a55-535c8c074adc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:49.694613 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be2b21-0836-49b8-9a55-535c8c074adc service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:49.694935 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be2b21-0836-49b8-9a55-535c8c074adc service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:49.695218 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be2b21-0836-49b8-9a55-535c8c074adc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:49.696938 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-17be2b21-0836-49b8-9a55-535c8c074adc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:49.706900 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be2b21-0836-49b8-9a55-535c8c074adc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:49.708359 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be2b21-0836-49b8-9a55-535c8c074adc service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:49.716636 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1456/2911] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 13:04:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 13:04:50.316175 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12eb3c4-437f-41d1-a290-400375013e7f service placement] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:50.317665 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-b12eb3c4-437f-41d1-a290-400375013e7f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:50.336546 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12eb3c4-437f-41d1-a290-400375013e7f service placement] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:50.343629 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e0fa4-fea8-41e7-9ae2-1254e1197b3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:50.344291 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e0fa4-fea8-41e7-9ae2-1254e1197b3f service nova] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:50.344576 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e0fa4-fea8-41e7-9ae2-1254e1197b3f service nova] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:50.344895 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e0fa4-fea8-41e7-9ae2-1254e1197b3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:50.346850 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-8a2e0fa4-fea8-41e7-9ae2-1254e1197b3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:50.359820 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e0fa4-fea8-41e7-9ae2-1254e1197b3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:50.361960 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e0fa4-fea8-41e7-9ae2-1254e1197b3f service nova] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:50.373136 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1456/2912] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 13:04:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 13:04:55.692680 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be2b21-0836-49b8-9a55-535c8c074adc service neutron] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:04:55.707062 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be2b21-0836-49b8-9a55-535c8c074adc service neutron] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:04:55.712982 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00717c6-2ba2-4260-bd2c-9392d3fe0221 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:04:55.713600 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00717c6-2ba2-4260-bd2c-9392d3fe0221 service nova] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:04:55.713824 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00717c6-2ba2-4260-bd2c-9392d3fe0221 service nova] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:04:55.714102 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00717c6-2ba2-4260-bd2c-9392d3fe0221 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:04:55.716050 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-f00717c6-2ba2-4260-bd2c-9392d3fe0221 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:04:55.731156 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00717c6-2ba2-4260-bd2c-9392d3fe0221 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:04:55.733004 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00717c6-2ba2-4260-bd2c-9392d3fe0221 service nova] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:04:55.744752 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1457/2913] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 13:04:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 13:05:00.368325 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=24 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:05:02.630437 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7712c-81cb-47ff-aaf4-b187b24ad9f6 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:05:02.631039 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7712c-81cb-47ff-aaf4-b187b24ad9f6 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:05:02.631039 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7712c-81cb-47ff-aaf4-b187b24ad9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:05:02.647668 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-70d7712c-81cb-47ff-aaf4-b187b24ad9f6 None None] MFA Rules not processed for user `d73ba5dfa9e64e5a98c1117a4b9471d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:05:02.648856 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-70d7712c-81cb-47ff-aaf4-b187b24ad9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:05:02.668785 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1457/2914] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 13:05:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 13:05:05.739798 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=94,keystone:INSERT=3 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:05:12.473793 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00717c6-2ba2-4260-bd2c-9392d3fe0221 service nova] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:05:12.475624 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-f00717c6-2ba2-4260-bd2c-9392d3fe0221 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:05:12.523023 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00717c6-2ba2-4260-bd2c-9392d3fe0221 service nova] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:05:12.527963 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdf9ba-ae93-44e3-8ba9-7d6e157ba955 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57c8b894e74c709ea389ed462184fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:05:12.528628 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdf9ba-ae93-44e3-8ba9-7d6e157ba955 service placement] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:05:12.528908 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdf9ba-ae93-44e3-8ba9-7d6e157ba955 service placement] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:05:12.529181 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdf9ba-ae93-44e3-8ba9-7d6e157ba955 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:05:12.530976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-58bdf9ba-ae93-44e3-8ba9-7d6e157ba955 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:05:12.542604 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bdf9ba-ae93-44e3-8ba9-7d6e157ba955 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:05:12.544201 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bdf9ba-ae93-44e3-8ba9-7d6e157ba955 service placement] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:05:12.553834 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1458/2915] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 13:05:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 13:05:12.663263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=9 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:05:22.549605 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=19 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:05:22.730877 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965c236-356a-4a8a-9d9b-7fa1bddc4b4a None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:05:22.730877 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965c236-356a-4a8a-9d9b-7fa1bddc4b4a None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:05:22.731467 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965c236-356a-4a8a-9d9b-7fa1bddc4b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:05:22.751390 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-3965c236-356a-4a8a-9d9b-7fa1bddc4b4a None None] MFA Rules not processed for user `2891b5a315b64f228f665e024b641629`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:05:22.752511 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-3965c236-356a-4a8a-9d9b-7fa1bddc4b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:05:22.807079 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1458/2916] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Jun 29 13:05:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 13:05:22.851076 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdf9ba-ae93-44e3-8ba9-7d6e157ba955 service placement] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:05:22.852551 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-58bdf9ba-ae93-44e3-8ba9-7d6e157ba955 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:05:22.919418 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdf9ba-ae93-44e3-8ba9-7d6e157ba955 service placement] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:05:22.924235 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aca037-447c-427d-a4ed-84f777115d06 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11efdbeeaa5c428aa344f7f0f5b061ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:05:22.924871 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aca037-447c-427d-a4ed-84f777115d06 service swift] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:05:22.925151 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aca037-447c-427d-a4ed-84f777115d06 service swift] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:05:22.926062 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aca037-447c-427d-a4ed-84f777115d06 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:05:22.934006 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aca037-447c-427d-a4ed-84f777115d06 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:05:22.935654 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aca037-447c-427d-a4ed-84f777115d06 service swift] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:05:22.943775 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1459/2917] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Jun 29 13:05:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 13:05:32.799690 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=25 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:05:32.940484 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=32 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:05:37.956119 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4edf6e-6dc4-4fbd-b370-d804c48fac09 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:05:37.956597 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4edf6e-6dc4-4fbd-b370-d804c48fac09 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:05:37.956688 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4edf6e-6dc4-4fbd-b370-d804c48fac09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:05:37.974391 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-bf4edf6e-6dc4-4fbd-b370-d804c48fac09 None None] MFA Rules not processed for user `2891b5a315b64f228f665e024b641629`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:05:37.975614 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-bf4edf6e-6dc4-4fbd-b370-d804c48fac09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:05:37.982715 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1459/2918] 10.222.0.13 () {58 vars in 967 bytes} [Wed Jun 29 13:05:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 13:05:37.995672 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aca037-447c-427d-a4ed-84f777115d06 service swift] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:05:38.006282 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aca037-447c-427d-a4ed-84f777115d06 service swift] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:05:38.011168 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b726af-f568-4421-8e77-fff4e4b17ffc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11efdbeeaa5c428aa344f7f0f5b061ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:05:38.011797 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b726af-f568-4421-8e77-fff4e4b17ffc service swift] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:05:38.012079 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b726af-f568-4421-8e77-fff4e4b17ffc service swift] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:05:38.012353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b726af-f568-4421-8e77-fff4e4b17ffc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:05:38.020785 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b726af-f568-4421-8e77-fff4e4b17ffc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:05:38.022366 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b726af-f568-4421-8e77-fff4e4b17ffc service swift] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:05:38.030212 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1460/2919] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Jun 29 13:05:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 29 13:05:39.855610 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4edf6e-6dc4-4fbd-b370-d804c48fac09 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:05:39.867965 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4edf6e-6dc4-4fbd-b370-d804c48fac09 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:05:39.872981 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3c503-62e5-4120-90dc-5112590788c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57c8b894e74c709ea389ed462184fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:05:39.873618 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3c503-62e5-4120-90dc-5112590788c4 service placement] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:05:39.873905 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3c503-62e5-4120-90dc-5112590788c4 service placement] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:05:39.874184 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3c503-62e5-4120-90dc-5112590788c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:05:39.876260 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-1ce3c503-62e5-4120-90dc-5112590788c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:05:39.888624 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3c503-62e5-4120-90dc-5112590788c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:05:39.890379 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3c503-62e5-4120-90dc-5112590788c4 service placement] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:05:39.901447 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1460/2920] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 13:05:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 13:05:39.929807 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b726af-f568-4421-8e77-fff4e4b17ffc service swift] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:05:39.940670 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b726af-f568-4421-8e77-fff4e4b17ffc service swift] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:05:39.946254 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca7e55-283f-44ca-9ee6-655e1b751aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:05:39.947450 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca7e55-283f-44ca-9ee6-655e1b751aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:05:39.947753 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca7e55-283f-44ca-9ee6-655e1b751aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:05:39.948024 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca7e55-283f-44ca-9ee6-655e1b751aad admin admin] PATH_INFO: `/v3/users/d73ba5dfa9e64e5a98c1117a4b9471d0` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:05:39.949420 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca7e55-283f-44ca-9ee6-655e1b751aad admin admin] RBAC: Authorizing `identity:delete_user(user_id=d73ba5dfa9e64e5a98c1117a4b9471d0)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:05:39.951559 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca7e55-283f-44ca-9ee6-655e1b751aad admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:05:39.998127 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-d8ca7e55-283f-44ca-9ee6-655e1b751aad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd73ba5dfa9e64e5a98c1117a4b9471d0'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:05:39.998743 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-d8ca7e55-283f-44ca-9ee6-655e1b751aad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd73ba5dfa9e64e5a98c1117a4b9471d0'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:05:40.011155 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-d8ca7e55-283f-44ca-9ee6-655e1b751aad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd73ba5dfa9e64e5a98c1117a4b9471d0'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:05:40.018238 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-d8ca7e55-283f-44ca-9ee6-655e1b751aad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd73ba5dfa9e64e5a98c1117a4b9471d0'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:05:40.018888 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-d8ca7e55-283f-44ca-9ee6-655e1b751aad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd73ba5dfa9e64e5a98c1117a4b9471d0'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:05:40.031449 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1461/2921] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 13:05:39 2022] DELETE /identity/v3/users/d73ba5dfa9e64e5a98c1117a4b9471d0 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 13:05:40.199676 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3c503-62e5-4120-90dc-5112590788c4 service placement] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:05:40.211195 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3c503-62e5-4120-90dc-5112590788c4 service placement] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:05:40.271224 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133264d-c746-40e1-bb29-c93f01c31c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:05:40.272032 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133264d-c746-40e1-bb29-c93f01c31c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:05:40.272312 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133264d-c746-40e1-bb29-c93f01c31c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:05:40.272590 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133264d-c746-40e1-bb29-c93f01c31c4f admin admin] PATH_INFO: `/v3/projects/1ce766cec60445f3a4c9ed616f78e254` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:05:40.273753 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133264d-c746-40e1-bb29-c93f01c31c4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ce766cec60445f3a4c9ed616f78e254)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:05:40.275706 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133264d-c746-40e1-bb29-c93f01c31c4f admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:05:40.321228 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d133264d-c746-40e1-bb29-c93f01c31c4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ce766cec60445f3a4c9ed616f78e254', 'request_id': 'req-d133264d-c746-40e1-bb29-c93f01c31c4f'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:05:40.328157 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d133264d-c746-40e1-bb29-c93f01c31c4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ce766cec60445f3a4c9ed616f78e254', 'request_id': 'req-d133264d-c746-40e1-bb29-c93f01c31c4f'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:05:40.334182 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d133264d-c746-40e1-bb29-c93f01c31c4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ce766cec60445f3a4c9ed616f78e254', 'request_id': 'req-d133264d-c746-40e1-bb29-c93f01c31c4f'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:05:40.344207 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d133264d-c746-40e1-bb29-c93f01c31c4f admin admin] The token cache is being invalidate because project 1ce766cec60445f3a4c9ed616f78e254 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 13:05:40.344494 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d133264d-c746-40e1-bb29-c93f01c31c4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:05:40.345119 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-d133264d-c746-40e1-bb29-c93f01c31c4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:05:40.346651 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1461/2922] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 13:05:40 2022] DELETE /identity/v3/projects/1ce766cec60445f3a4c9ed616f78e254 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 13:05:40.352332 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495bac6-9d05-47b9-a74a-69c9cbb11a3e None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:05:40.352602 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495bac6-9d05-47b9-a74a-69c9cbb11a3e None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:05:40.352878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495bac6-9d05-47b9-a74a-69c9cbb11a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:05:40.371412 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-d495bac6-9d05-47b9-a74a-69c9cbb11a3e None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:05:40.372641 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-d495bac6-9d05-47b9-a74a-69c9cbb11a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:05:40.430623 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1462/2923] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 13:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 13:05:40.438482 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495ffdf-c7b1-41b9-9476-247b6c7c19a6 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:05:40.438815 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495ffdf-c7b1-41b9-9476-247b6c7c19a6 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:05:40.439091 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495ffdf-c7b1-41b9-9476-247b6c7c19a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:05:40.457581 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-a495ffdf-c7b1-41b9-9476-247b6c7c19a6 None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:05:40.458828 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-a495ffdf-c7b1-41b9-9476-247b6c7c19a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:05:40.466466 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1462/2924] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 13:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 13:05:40.470356 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495bac6-9d05-47b9-a74a-69c9cbb11a3e None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:05:40.479946 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495bac6-9d05-47b9-a74a-69c9cbb11a3e None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:05:40.484469 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb37e3d-ec3c-4a70-9dc3-48ddd8c5460c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:05:40.485113 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb37e3d-ec3c-4a70-9dc3-48ddd8c5460c admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:05:40.485393 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb37e3d-ec3c-4a70-9dc3-48ddd8c5460c admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:05:40.485667 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb37e3d-ec3c-4a70-9dc3-48ddd8c5460c admin admin] PATH_INFO: `/v3/domains` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:05:40.486381 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb37e3d-ec3c-4a70-9dc3-48ddd8c5460c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 13:05:40.486719 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb37e3d-ec3c-4a70-9dc3-48ddd8c5460c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:05:40.488320 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb37e3d-ec3c-4a70-9dc3-48ddd8c5460c admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:05:40.500151 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1463/2925] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 29 13:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 13:05:40.504601 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495ffdf-c7b1-41b9-9476-247b6c7c19a6 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:05:40.514492 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495ffdf-c7b1-41b9-9476-247b6c7c19a6 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:05:40.519072 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce025de8-efd4-4e50-90e2-3a83ebfb6066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:05:40.519711 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce025de8-efd4-4e50-90e2-3a83ebfb6066 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:05:40.519989 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce025de8-efd4-4e50-90e2-3a83ebfb6066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:05:40.520288 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce025de8-efd4-4e50-90e2-3a83ebfb6066 admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:05:40.520974 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce025de8-efd4-4e50-90e2-3a83ebfb6066 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:05:40.522981 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce025de8-efd4-4e50-90e2-3a83ebfb6066 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:05:40.547708 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1463/2926] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 13:05:40 2022] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 13:05:40.551784 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb37e3d-ec3c-4a70-9dc3-48ddd8c5460c admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:05:40.562313 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb37e3d-ec3c-4a70-9dc3-48ddd8c5460c admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:05:40.605323 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:05:40.620128 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb5a77-762a-41ea-8da8-6dfff638bb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:05:40.620791 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb5a77-762a-41ea-8da8-6dfff638bb46 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:05:40.621077 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb5a77-762a-41ea-8da8-6dfff638bb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:05:40.621355 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb5a77-762a-41ea-8da8-6dfff638bb46 admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:05:40.622035 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb5a77-762a-41ea-8da8-6dfff638bb46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:05:40.623999 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb5a77-762a-41ea-8da8-6dfff638bb46 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:05:40.643036 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1464/2927] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 13:05:40 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 13:05:40.647252 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce025de8-efd4-4e50-90e2-3a83ebfb6066 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:05:40.657348 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce025de8-efd4-4e50-90e2-3a83ebfb6066 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:05:40.662826 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90cc6f7-4a1f-4661-83bf-e05bc62ff5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:05:40.663478 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cc6f7-4a1f-4661-83bf-e05bc62ff5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:05:40.663755 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cc6f7-4a1f-4661-83bf-e05bc62ff5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:05:40.664026 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cc6f7-4a1f-4661-83bf-e05bc62ff5c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:05:40.664745 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90cc6f7-4a1f-4661-83bf-e05bc62ff5c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:05:40.666369 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90cc6f7-4a1f-4661-83bf-e05bc62ff5c8 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:05:40.676827 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1464/2928] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 13:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 13:05:40.681367 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb5a77-762a-41ea-8da8-6dfff638bb46 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:05:40.691895 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb5a77-762a-41ea-8da8-6dfff638bb46 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:05:40.696462 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7fa53-5823-4dfc-8b55-7e5938fe4eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:05:40.697114 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7fa53-5823-4dfc-8b55-7e5938fe4eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:05:40.697398 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7fa53-5823-4dfc-8b55-7e5938fe4eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:05:40.697672 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7fa53-5823-4dfc-8b55-7e5938fe4eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:05:40.698394 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7fa53-5823-4dfc-8b55-7e5938fe4eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:05:40.700022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7fa53-5823-4dfc-8b55-7e5938fe4eb8 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:05:40.709703 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1465/2929] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 13:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 13:05:40.713637 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90cc6f7-4a1f-4661-83bf-e05bc62ff5c8 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:05:40.723276 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90cc6f7-4a1f-4661-83bf-e05bc62ff5c8 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:05:40.729390 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976d867-3653-4bd8-adcc-2635213b1c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:05:40.731000 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976d867-3653-4bd8-adcc-2635213b1c92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:05:40.731443 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976d867-3653-4bd8-adcc-2635213b1c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:05:40.731785 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976d867-3653-4bd8-adcc-2635213b1c92 admin admin] PATH_INFO: `/v3/projects/63730beedcc141eca0717ccf997ed4e5/users/fbc60b33923f4f0c87cffb42ba92806a/roles/419e204ede334962ac80ce56c398bd4f` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:05:40.748122 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976d867-3653-4bd8-adcc-2635213b1c92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63730beedcc141eca0717ccf997ed4e5, user_id=fbc60b33923f4f0c87cffb42ba92806a, role_id=419e204ede334962ac80ce56c398bd4f)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:05:40.751106 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976d867-3653-4bd8-adcc-2635213b1c92 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:05:40.763753 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1465/2930] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 13:05:40 2022] PUT /identity/v3/projects/63730beedcc141eca0717ccf997ed4e5/users/fbc60b33923f4f0c87cffb42ba92806a/roles/419e204ede334962ac80ce56c398bd4f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 13:05:40.768708 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4633c-9b8c-4ae4-b883-533799183caf None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:05:40.769024 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4633c-9b8c-4ae4-b883-533799183caf None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:05:40.769301 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4633c-9b8c-4ae4-b883-533799183caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:05:40.786459 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-90d4633c-9b8c-4ae4-b883-533799183caf None None] MFA Rules not processed for user `08fcb1f35af24620b53142bf98880fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:05:40.788181 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-90d4633c-9b8c-4ae4-b883-533799183caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:05:40.844266 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1466/2931] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 13:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 13:05:40.854404 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976d867-3653-4bd8-adcc-2635213b1c92 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:05:40.856678 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-a976d867-3653-4bd8-adcc-2635213b1c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:05:40.867045 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:05:40.914363 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976d867-3653-4bd8-adcc-2635213b1c92 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:05:40.918042 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f81aaa-7d1a-44a6-b91e-d077688cb5ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:05:40.918711 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f81aaa-7d1a-44a6-b91e-d077688cb5ca service neutron] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:05:40.918999 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f81aaa-7d1a-44a6-b91e-d077688cb5ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:05:40.919276 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f81aaa-7d1a-44a6-b91e-d077688cb5ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:05:40.928625 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f81aaa-7d1a-44a6-b91e-d077688cb5ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:05:40.930046 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f81aaa-7d1a-44a6-b91e-d077688cb5ca service neutron] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:05:40.939398 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1466/2932] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 13:05:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 13:05:44.815662 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a1104-2104-4871-8c03-c37b542b57ed None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:05:44.816146 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a1104-2104-4871-8c03-c37b542b57ed None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:05:44.816255 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a1104-2104-4871-8c03-c37b542b57ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:05:44.846061 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-0a8a1104-2104-4871-8c03-c37b542b57ed None None] MFA Rules not processed for user `fbc60b33923f4f0c87cffb42ba92806a`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:05:44.847253 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-0a8a1104-2104-4871-8c03-c37b542b57ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:05:44.913613 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1467/2933] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 13:05:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 13:05:44.918034 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f81aaa-7d1a-44a6-b91e-d077688cb5ca service neutron] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:05:44.927727 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f81aaa-7d1a-44a6-b91e-d077688cb5ca service neutron] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:05:44.932394 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a4082-63b5-412d-a595-3244c623c666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:05:44.933072 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a4082-63b5-412d-a595-3244c623c666 admin admin] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:05:44.933353 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a4082-63b5-412d-a595-3244c623c666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:05:44.933627 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a4082-63b5-412d-a595-3244c623c666 admin admin] PATH_INFO: `/v3/projects` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:05:44.934328 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a4082-63b5-412d-a595-3244c623c666 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:05:44.936274 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a4082-63b5-412d-a595-3244c623c666 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:05:44.963919 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1467/2934] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 29 13:05:44 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 13:05:44.968043 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a1104-2104-4871-8c03-c37b542b57ed None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:05:44.979546 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a1104-2104-4871-8c03-c37b542b57ed None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:05:45.048561 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:05:45.056313 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09f082-3662-4689-8944-23462d5cfc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:05:45.057005 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09f082-3662-4689-8944-23462d5cfc97 admin admin] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:05:45.057290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09f082-3662-4689-8944-23462d5cfc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:05:45.057613 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09f082-3662-4689-8944-23462d5cfc97 admin admin] PATH_INFO: `/v3/users` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:05:45.058949 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09f082-3662-4689-8944-23462d5cfc97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:05:45.061174 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09f082-3662-4689-8944-23462d5cfc97 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:05:45.086846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1468/2935] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 29 13:05:44 2022] POST /identity/v3/users => generated 299 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 13:05:45.088017 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a4082-63b5-412d-a595-3244c623c666 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:05:45.098440 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a4082-63b5-412d-a595-3244c623c666 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:05:45.107937 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a889c25-7d09-4f8d-8cf8-35ad6c925ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:05:45.108620 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a889c25-7d09-4f8d-8cf8-35ad6c925ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:05:45.108901 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a889c25-7d09-4f8d-8cf8-35ad6c925ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:05:45.109176 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a889c25-7d09-4f8d-8cf8-35ad6c925ca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:05:45.110045 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a889c25-7d09-4f8d-8cf8-35ad6c925ca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:05:45.111687 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a889c25-7d09-4f8d-8cf8-35ad6c925ca0 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:05:45.126698 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1468/2936] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 13:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 13:05:45.127878 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09f082-3662-4689-8944-23462d5cfc97 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:05:45.138616 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09f082-3662-4689-8944-23462d5cfc97 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:05:45.143292 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c7cac-061c-4b68-92be-655bcfa3d2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:05:45.144216 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c7cac-061c-4b68-92be-655bcfa3d2be admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:05:45.144497 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c7cac-061c-4b68-92be-655bcfa3d2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:05:45.144771 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c7cac-061c-4b68-92be-655bcfa3d2be admin admin] PATH_INFO: `/v3/projects/9d34d4848abd451eb4d36a43fa76ab75/users/ca3d4dfc60064ead8572b2e50d61dd3d/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:05:45.161325 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c7cac-061c-4b68-92be-655bcfa3d2be admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d34d4848abd451eb4d36a43fa76ab75, user_id=ca3d4dfc60064ead8572b2e50d61dd3d, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:05:45.164118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c7cac-061c-4b68-92be-655bcfa3d2be admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:05:45.178163 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1469/2937] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 13:05:45 2022] PUT /identity/v3/projects/9d34d4848abd451eb4d36a43fa76ab75/users/ca3d4dfc60064ead8572b2e50d61dd3d/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 13:05:45.182303 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a889c25-7d09-4f8d-8cf8-35ad6c925ca0 admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:05:45.192599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a889c25-7d09-4f8d-8cf8-35ad6c925ca0 admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:05:45.251754 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69fe74-2e46-4034-a830-12e1583d39c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:05:45.252361 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69fe74-2e46-4034-a830-12e1583d39c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:05:45.252646 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69fe74-2e46-4034-a830-12e1583d39c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:05:45.252921 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69fe74-2e46-4034-a830-12e1583d39c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:05:45.253647 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69fe74-2e46-4034-a830-12e1583d39c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:05:45.255471 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69fe74-2e46-4034-a830-12e1583d39c6 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:05:45.269262 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1469/2938] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 29 13:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 13:05:45.270846 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c7cac-061c-4b68-92be-655bcfa3d2be admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:05:45.281970 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c7cac-061c-4b68-92be-655bcfa3d2be admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:05:45.286949 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ceb3a6-97dd-417f-8d4d-f0f598f94525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:05:45.287853 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ceb3a6-97dd-417f-8d4d-f0f598f94525 admin admin] REQUEST_METHOD: `PUT` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:05:45.288133 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ceb3a6-97dd-417f-8d4d-f0f598f94525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:05:45.288467 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ceb3a6-97dd-417f-8d4d-f0f598f94525 admin admin] PATH_INFO: `/v3/projects/9d34d4848abd451eb4d36a43fa76ab75/users/ca3d4dfc60064ead8572b2e50d61dd3d/roles/5ef3464f4436446b88430cdf7cc1a3d7` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:05:45.290442 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ceb3a6-97dd-417f-8d4d-f0f598f94525 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d34d4848abd451eb4d36a43fa76ab75, user_id=ca3d4dfc60064ead8572b2e50d61dd3d, role_id=5ef3464f4436446b88430cdf7cc1a3d7)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:05:45.293160 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ceb3a6-97dd-417f-8d4d-f0f598f94525 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:05:45.304424 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1470/2939] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 29 13:05:45 2022] PUT /identity/v3/projects/9d34d4848abd451eb4d36a43fa76ab75/users/ca3d4dfc60064ead8572b2e50d61dd3d/roles/5ef3464f4436446b88430cdf7cc1a3d7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 13:05:49.704251 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bcd167-c159-455e-9a43-254377acff02 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:05:49.704723 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bcd167-c159-455e-9a43-254377acff02 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:05:49.705398 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bcd167-c159-455e-9a43-254377acff02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:05:49.739794 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-24bcd167-c159-455e-9a43-254377acff02 None None] MFA Rules not processed for user `ca3d4dfc60064ead8572b2e50d61dd3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:05:49.741746 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-24bcd167-c159-455e-9a43-254377acff02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:05:49.809499 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:05:49.816360 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1470/2940] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 13:05:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 13:05:49.827996 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ceb3a6-97dd-417f-8d4d-f0f598f94525 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:05:49.830207 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-14ceb3a6-97dd-417f-8d4d-f0f598f94525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:05:49.892534 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ceb3a6-97dd-417f-8d4d-f0f598f94525 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:05:49.896118 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2dba5-003b-4062-bf65-3c27d0087e8f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09d603d756a9484bbf48cfd6d56bdb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:05:49.896793 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2dba5-003b-4062-bf65-3c27d0087e8f service glance] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:05:49.897080 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2dba5-003b-4062-bf65-3c27d0087e8f service glance] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:05:49.897363 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2dba5-003b-4062-bf65-3c27d0087e8f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:05:49.955735 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2dba5-003b-4062-bf65-3c27d0087e8f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:05:49.957292 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2dba5-003b-4062-bf65-3c27d0087e8f service glance] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:05:49.966976 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1471/2941] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 13:05:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 13:05:50.068892 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975afba-94dc-4f00-981e-42ad216cdb52 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:05:50.069274 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975afba-94dc-4f00-981e-42ad216cdb52 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:05:50.069643 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975afba-94dc-4f00-981e-42ad216cdb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:05:50.088052 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-f975afba-94dc-4f00-981e-42ad216cdb52 None None] MFA Rules not processed for user `2891b5a315b64f228f665e024b641629`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:05:50.089326 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-f975afba-94dc-4f00-981e-42ad216cdb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:05:50.148002 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1471/2942] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Jun 29 13:05:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 13:05:50.160377 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2dba5-003b-4062-bf65-3c27d0087e8f service glance] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:05:50.161843 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-00e2dba5-003b-4062-bf65-3c27d0087e8f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:05:50.229875 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:05:50.234724 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2dba5-003b-4062-bf65-3c27d0087e8f service glance] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:05:50.240971 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf17e91-55eb-44c4-9c63-46292f2c1de6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11efdbeeaa5c428aa344f7f0f5b061ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:05:50.241684 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf17e91-55eb-44c4-9c63-46292f2c1de6 service swift] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:05:50.241963 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf17e91-55eb-44c4-9c63-46292f2c1de6 service swift] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:05:50.242234 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf17e91-55eb-44c4-9c63-46292f2c1de6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:05:50.250737 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf17e91-55eb-44c4-9c63-46292f2c1de6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:05:50.252334 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf17e91-55eb-44c4-9c63-46292f2c1de6 service swift] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:05:50.269224 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1472/2943] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Jun 29 13:05:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 13:05:58.827984 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd6f64-cb83-4538-9a66-850ab69a9d31 None None] REQUEST_METHOD: `POST` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:05:58.828563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd6f64-cb83-4538-9a66-850ab69a9d31 None None] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:05:58.828563 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd6f64-cb83-4538-9a66-850ab69a9d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:05:58.848188 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.auth.core [None req-39bd6f64-cb83-4538-9a66-850ab69a9d31 None None] MFA Rules not processed for user `fbc60b33923f4f0c87cffb42ba92806a`. Rule list: `[]` (Enabled: `True`). {{(pid=80081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:05:58.850824 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-39bd6f64-cb83-4538-9a66-850ab69a9d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:05:58.861289 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1472/2944] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 29 13:05:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 13:06:00.257970 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=4 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:06:00.658768 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd071a-12f1-442e-9f71-92a1b1f66d9f None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:06:00.659064 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd071a-12f1-442e-9f71-92a1b1f66d9f None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:06:00.659346 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd071a-12f1-442e-9f71-92a1b1f66d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:06:00.679765 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-cedd071a-12f1-442e-9f71-92a1b1f66d9f None None] MFA Rules not processed for user `2891b5a315b64f228f665e024b641629`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:06:00.680995 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-cedd071a-12f1-442e-9f71-92a1b1f66d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:06:00.689500 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1473/2945] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Jun 29 13:06:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 13:06:00.703447 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd6f64-cb83-4538-9a66-850ab69a9d31 None None] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:06:00.716080 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd6f64-cb83-4538-9a66-850ab69a9d31 None None] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:06:00.722103 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d3309-0b33-48fa-bbc5-fe764386a24a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11efdbeeaa5c428aa344f7f0f5b061ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:06:00.723051 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d3309-0b33-48fa-bbc5-fe764386a24a service swift] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:06:00.723440 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d3309-0b33-48fa-bbc5-fe764386a24a service swift] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:06:00.723814 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d3309-0b33-48fa-bbc5-fe764386a24a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:06:00.733513 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d3309-0b33-48fa-bbc5-fe764386a24a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:06:00.735263 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d3309-0b33-48fa-bbc5-fe764386a24a service swift] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:06:00.744411 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1473/2946] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Jun 29 13:06:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 13:06:10.674229 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=3 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:06:10.741631 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=35 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:06:26.998259 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd071a-12f1-442e-9f71-92a1b1f66d9f None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:06:26.999693 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-cedd071a-12f1-442e-9f71-92a1b1f66d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:06:27.058811 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd071a-12f1-442e-9f71-92a1b1f66d9f None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:06:27.062310 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7f59f-3195-4af5-9553-238ee2de79fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50f5cc247f6b445f81fc3715d7bce92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:06:27.063007 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7f59f-3195-4af5-9553-238ee2de79fc service neutron] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:06:27.063290 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7f59f-3195-4af5-9553-238ee2de79fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:06:27.063567 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7f59f-3195-4af5-9553-238ee2de79fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:06:27.072870 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7f59f-3195-4af5-9553-238ee2de79fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:06:27.074352 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7f59f-3195-4af5-9553-238ee2de79fc service neutron] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:06:27.083652 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1474/2947] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 13:06:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 13:06:28.826589 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d3309-0b33-48fa-bbc5-fe764386a24a service swift] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:06:28.827600 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-664d3309-0b33-48fa-bbc5-fe764386a24a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:06:28.950252 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d3309-0b33-48fa-bbc5-fe764386a24a service swift] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:06:28.958498 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3c530-041f-4055-b021-320431e86a91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbcf547421b42e4b520f9246326bff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:06:28.959256 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3c530-041f-4055-b021-320431e86a91 service nova] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:06:28.959544 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3c530-041f-4055-b021-320431e86a91 service nova] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:06:28.959819 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3c530-041f-4055-b021-320431e86a91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:06:28.962898 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-b2a3c530-041f-4055-b021-320431e86a91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:06:28.981414 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3c530-041f-4055-b021-320431e86a91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:06:28.983498 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3c530-041f-4055-b021-320431e86a91 service nova] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:06:29.008752 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1474/2948] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 13:06:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 13:06:37.079581 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=26 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:06:38.990672 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=34 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:07:47.496582 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b82010-ff8a-4edd-bdfc-ee0312ab4379 None None] REQUEST_METHOD: `POST` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:07:47.497081 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b82010-ff8a-4edd-bdfc-ee0312ab4379 None None] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:07:47.497177 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b82010-ff8a-4edd-bdfc-ee0312ab4379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:07:47.534384 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.auth.core [None req-e7b82010-ff8a-4edd-bdfc-ee0312ab4379 None None] MFA Rules not processed for user `2891b5a315b64f228f665e024b641629`. Rule list: `[]` (Enabled: `True`). {{(pid=80082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 13:07:47.535614 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-e7b82010-ff8a-4edd-bdfc-ee0312ab4379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:07:47.561491 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1475/2949] 10.222.0.13 () {58 vars in 967 bytes} [Wed Jun 29 13:07:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 13:07:47.602741 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3c530-041f-4055-b021-320431e86a91 service nova] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:07:47.632463 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3c530-041f-4055-b021-320431e86a91 service nova] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:07:47.637621 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a7662-9580-4a7d-b37f-2641def40026 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11efdbeeaa5c428aa344f7f0f5b061ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:07:47.638265 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a7662-9580-4a7d-b37f-2641def40026 service swift] REQUEST_METHOD: `GET` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:07:47.638546 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a7662-9580-4a7d-b37f-2641def40026 service swift] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:07:47.638857 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a7662-9580-4a7d-b37f-2641def40026 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:07:47.648135 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a7662-9580-4a7d-b37f-2641def40026 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:07:47.649238 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a7662-9580-4a7d-b37f-2641def40026 service swift] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:07:47.657807 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1475/2950] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Jun 29 13:07:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 13:07:54.151353 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b82010-ff8a-4edd-bdfc-ee0312ab4379 None None] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:07:54.217016 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b82010-ff8a-4edd-bdfc-ee0312ab4379 None None] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:07:54.221445 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfff43-34a2-4fb3-967c-71fd473e75f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:07:54.222311 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfff43-34a2-4fb3-967c-71fd473e75f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:07:54.222595 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfff43-34a2-4fb3-967c-71fd473e75f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:07:54.222898 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfff43-34a2-4fb3-967c-71fd473e75f9 admin admin] PATH_INFO: `/v3/users/fbc60b33923f4f0c87cffb42ba92806a` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:07:54.224075 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfff43-34a2-4fb3-967c-71fd473e75f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbc60b33923f4f0c87cffb42ba92806a)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:07:54.226036 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfff43-34a2-4fb3-967c-71fd473e75f9 admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:07:54.273478 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-2acfff43-34a2-4fb3-967c-71fd473e75f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbc60b33923f4f0c87cffb42ba92806a'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:07:54.274063 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-2acfff43-34a2-4fb3-967c-71fd473e75f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbc60b33923f4f0c87cffb42ba92806a'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:07:54.286126 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-2acfff43-34a2-4fb3-967c-71fd473e75f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbc60b33923f4f0c87cffb42ba92806a'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:07:54.293055 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-2acfff43-34a2-4fb3-967c-71fd473e75f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbc60b33923f4f0c87cffb42ba92806a'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:07:54.293666 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-2acfff43-34a2-4fb3-967c-71fd473e75f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbc60b33923f4f0c87cffb42ba92806a'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:07:54.306393 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1476/2951] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 13:07:54 2022] DELETE /identity/v3/users/fbc60b33923f4f0c87cffb42ba92806a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 13:07:54.475058 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a7662-9580-4a7d-b37f-2641def40026 service swift] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:07:54.490221 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a7662-9580-4a7d-b37f-2641def40026 service swift] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:07:54.545121 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a960e-bbd1-4ee7-9c79-fb2458bdc5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:07:54.545986 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a960e-bbd1-4ee7-9c79-fb2458bdc5fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:07:54.546270 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a960e-bbd1-4ee7-9c79-fb2458bdc5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:07:54.546543 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a960e-bbd1-4ee7-9c79-fb2458bdc5fa admin admin] PATH_INFO: `/v3/projects/63730beedcc141eca0717ccf997ed4e5` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:07:54.548300 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a960e-bbd1-4ee7-9c79-fb2458bdc5fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=63730beedcc141eca0717ccf997ed4e5)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:07:54.550196 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a960e-bbd1-4ee7-9c79-fb2458bdc5fa admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:07:54.596018 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-963a960e-bbd1-4ee7-9c79-fb2458bdc5fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63730beedcc141eca0717ccf997ed4e5', 'request_id': 'req-963a960e-bbd1-4ee7-9c79-fb2458bdc5fa'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:07:54.604178 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-963a960e-bbd1-4ee7-9c79-fb2458bdc5fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63730beedcc141eca0717ccf997ed4e5', 'request_id': 'req-963a960e-bbd1-4ee7-9c79-fb2458bdc5fa'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:07:54.610882 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-963a960e-bbd1-4ee7-9c79-fb2458bdc5fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63730beedcc141eca0717ccf997ed4e5', 'request_id': 'req-963a960e-bbd1-4ee7-9c79-fb2458bdc5fa'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:07:54.621154 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-963a960e-bbd1-4ee7-9c79-fb2458bdc5fa admin admin] The token cache is being invalidate because project 63730beedcc141eca0717ccf997ed4e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 13:07:54.621436 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-963a960e-bbd1-4ee7-9c79-fb2458bdc5fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:07:54.622055 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-963a960e-bbd1-4ee7-9c79-fb2458bdc5fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:07:54.623664 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1476/2952] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 13:07:54 2022] DELETE /identity/v3/projects/63730beedcc141eca0717ccf997ed4e5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 13:07:54.628067 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfff43-34a2-4fb3-967c-71fd473e75f9 admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:07:54.629441 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-2acfff43-34a2-4fb3-967c-71fd473e75f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:07:54.642881 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfff43-34a2-4fb3-967c-71fd473e75f9 admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:07:54.674721 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:07:54.700756 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151ac05-b161-4a49-9b24-21b6af752edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:07:54.701617 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151ac05-b161-4a49-9b24-21b6af752edf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:07:54.701900 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151ac05-b161-4a49-9b24-21b6af752edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:07:54.702174 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151ac05-b161-4a49-9b24-21b6af752edf admin admin] PATH_INFO: `/v3/users/ca3d4dfc60064ead8572b2e50d61dd3d` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:07:54.703359 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151ac05-b161-4a49-9b24-21b6af752edf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca3d4dfc60064ead8572b2e50d61dd3d)` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:07:54.705274 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151ac05-b161-4a49-9b24-21b6af752edf admin admin] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:07:54.753473 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a151ac05-b161-4a49-9b24-21b6af752edf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca3d4dfc60064ead8572b2e50d61dd3d'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:07:54.754144 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a151ac05-b161-4a49-9b24-21b6af752edf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca3d4dfc60064ead8572b2e50d61dd3d'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:07:54.765992 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a151ac05-b161-4a49-9b24-21b6af752edf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca3d4dfc60064ead8572b2e50d61dd3d'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:07:54.773197 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a151ac05-b161-4a49-9b24-21b6af752edf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca3d4dfc60064ead8572b2e50d61dd3d'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:07:54.773812 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.notifications [None req-a151ac05-b161-4a49-9b24-21b6af752edf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca3d4dfc60064ead8572b2e50d61dd3d'} {{(pid=80082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:07:54.785712 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1477/2953] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 29 13:07:54 2022] DELETE /identity/v3/users/ca3d4dfc60064ead8572b2e50d61dd3d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 13:07:54.955598 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a960e-bbd1-4ee7-9c79-fb2458bdc5fa admin admin] Authenticating user token {{(pid=80081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:07:54.957325 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.fernet_utils [None req-963a960e-bbd1-4ee7-9c79-fb2458bdc5fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:07:54.974465 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a960e-bbd1-4ee7-9c79-fb2458bdc5fa admin admin] Validating token access rules against request {{(pid=80081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:07:55.030711 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c8742-9020-4ae6-9702-bff88275f401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fcb1f35af24620b53142bf98880fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e1ea071109496291a5ab7856fef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:07:55.032125 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c8742-9020-4ae6-9702-bff88275f401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:07:55.032410 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c8742-9020-4ae6-9702-bff88275f401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:07:55.032687 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c8742-9020-4ae6-9702-bff88275f401 admin admin] PATH_INFO: `/v3/projects/9d34d4848abd451eb4d36a43fa76ab75` {{(pid=80081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:07:55.033853 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c8742-9020-4ae6-9702-bff88275f401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d34d4848abd451eb4d36a43fa76ab75)` {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:07:55.035801 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c8742-9020-4ae6-9702-bff88275f401 admin admin] RBAC: Authorization granted {{(pid=80081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:07:55.043652 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:07:55.081866 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-6d3c8742-9020-4ae6-9702-bff88275f401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d34d4848abd451eb4d36a43fa76ab75', 'request_id': 'req-6d3c8742-9020-4ae6-9702-bff88275f401'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:07:55.088203 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-6d3c8742-9020-4ae6-9702-bff88275f401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d34d4848abd451eb4d36a43fa76ab75', 'request_id': 'req-6d3c8742-9020-4ae6-9702-bff88275f401'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:07:55.094904 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-6d3c8742-9020-4ae6-9702-bff88275f401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d34d4848abd451eb4d36a43fa76ab75', 'request_id': 'req-6d3c8742-9020-4ae6-9702-bff88275f401'} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:07:55.105567 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-6d3c8742-9020-4ae6-9702-bff88275f401 admin admin] The token cache is being invalidate because project 9d34d4848abd451eb4d36a43fa76ab75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 13:07:55.105858 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-6d3c8742-9020-4ae6-9702-bff88275f401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:07:55.106495 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG keystone.notifications [None req-6d3c8742-9020-4ae6-9702-bff88275f401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 13:07:55.108067 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: [pid: 80081|app: 0|req: 1477/2954] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 29 13:07:54 2022] DELETE /identity/v3/projects/9d34d4848abd451eb4d36a43fa76ab75 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 13:08:04.782581 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=37,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:08:05.102599 dv-cinder-797608-38-iscsi devstack@keystone.service[80081]: DEBUG dbcounter [-] [80081] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 13:10:13.248581 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151ac05-b161-4a49-9b24-21b6af752edf admin admin] Authenticating user token {{(pid=80082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 13:10:13.249980 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-a151ac05-b161-4a49-9b24-21b6af752edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:10:13.328971 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151ac05-b161-4a49-9b24-21b6af752edf admin admin] Validating token access rules against request {{(pid=80082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 13:10:13.386848 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a3607-e254-4136-befc-f01eeb199c6e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57c8b894e74c709ea389ed462184fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489877ae137244c5b83291671c703c99', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 13:10:13.387739 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a3607-e254-4136-befc-f01eeb199c6e service placement] REQUEST_METHOD: `GET` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 13:10:13.388022 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a3607-e254-4136-befc-f01eeb199c6e service placement] SCRIPT_NAME: `/identity` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 13:10:13.388293 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a3607-e254-4136-befc-f01eeb199c6e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 13:10:13.390028 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.fernet_utils [None req-8c1a3607-e254-4136-befc-f01eeb199c6e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 13:10:13.401365 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a3607-e254-4136-befc-f01eeb199c6e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 13:10:13.402975 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a3607-e254-4136-befc-f01eeb199c6e service placement] RBAC: Authorization granted {{(pid=80082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 13:10:13.413218 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: [pid: 80082|app: 0|req: 1478/2955] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 29 13:10:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 13:10:23.408365 dv-cinder-797608-38-iscsi devstack@keystone.service[80082]: DEBUG dbcounter [-] [80082] Writing DB stats keystone:SELECT=63 {{(pid=80082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}